-- Logs begin at Wed 2022-05-25 13:53:56 UTC, end at Wed 2022-05-25 14:58:35 UTC. -- May 25 14:26:18.933560 dv-cinder-787296-9-smb systemd[1]: Starting Devstack devstack@keystone.service... May 25 14:26:18.942711 dv-cinder-787296-9-smb devstack@keystone.service[80467]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini May 25 14:26:18.944759 dv-cinder-787296-9-smb devstack@keystone.service[80467]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed May 25 14:26:18 2022] *** May 25 14:26:18.944759 dv-cinder-787296-9-smb devstack@keystone.service[80467]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 25 14:26:18.944759 dv-cinder-787296-9-smb devstack@keystone.service[80467]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 25 14:26:18.944759 dv-cinder-787296-9-smb devstack@keystone.service[80467]: nodename: dv-cinder-787296-9-smb May 25 14:26:18.944759 dv-cinder-787296-9-smb devstack@keystone.service[80467]: machine: x86_64 May 25 14:26:18.944759 dv-cinder-787296-9-smb devstack@keystone.service[80467]: clock source: unix May 25 14:26:18.944759 dv-cinder-787296-9-smb devstack@keystone.service[80467]: pcre jit disabled May 25 14:26:18.944759 dv-cinder-787296-9-smb devstack@keystone.service[80467]: detected number of CPU cores: 4 May 25 14:26:18.944759 dv-cinder-787296-9-smb devstack@keystone.service[80467]: current working directory: / May 25 14:26:18.944759 dv-cinder-787296-9-smb devstack@keystone.service[80467]: detected binary path: /usr/bin/uwsgi-core May 25 14:26:18.944759 dv-cinder-787296-9-smb devstack@keystone.service[80467]: your processes number limit is 47680 May 25 14:26:18.945437 dv-cinder-787296-9-smb devstack@keystone.service[80467]: your memory page size is 4096 bytes May 25 14:26:18.945437 dv-cinder-787296-9-smb devstack@keystone.service[80467]: detected max file descriptor number: 2048 May 25 14:26:18.945437 dv-cinder-787296-9-smb devstack@keystone.service[80467]: lock engine: pthread robust mutexes May 25 14:26:18.945437 dv-cinder-787296-9-smb devstack@keystone.service[80467]: thunder lock: enabled May 25 14:26:18.945437 dv-cinder-787296-9-smb devstack@keystone.service[80467]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 May 25 14:26:18.945437 dv-cinder-787296-9-smb devstack@keystone.service[80467]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 25 14:26:18.990459 dv-cinder-787296-9-smb devstack@keystone.service[80467]: Python main interpreter initialized at 0x55832fde09c0 May 25 14:26:18.990459 dv-cinder-787296-9-smb devstack@keystone.service[80467]: python threads support enabled May 25 14:26:18.990459 dv-cinder-787296-9-smb devstack@keystone.service[80467]: your server socket listen backlog is limited to 100 connections May 25 14:26:18.990459 dv-cinder-787296-9-smb devstack@keystone.service[80467]: your mercy for graceful operations on workers is 90 seconds May 25 14:26:18.990812 dv-cinder-787296-9-smb devstack@keystone.service[80467]: mapped 403077 bytes (393 KB) for 2 cores May 25 14:26:18.990889 dv-cinder-787296-9-smb devstack@keystone.service[80467]: *** Operational MODE: preforking *** May 25 14:26:18.991173 dv-cinder-787296-9-smb devstack@keystone.service[80467]: *** uWSGI is running in multiple interpreter mode *** May 25 14:26:18.991173 dv-cinder-787296-9-smb devstack@keystone.service[80467]: spawned uWSGI master process (pid: 80467) May 25 14:26:18.991376 dv-cinder-787296-9-smb systemd[1]: Started Devstack devstack@keystone.service. May 25 14:26:18.992446 dv-cinder-787296-9-smb devstack@keystone.service[80467]: spawned uWSGI worker 1 (pid: 80474, cores: 1) May 25 14:26:18.992446 dv-cinder-787296-9-smb devstack@keystone.service[80467]: spawned uWSGI worker 2 (pid: 80475, cores: 1) May 25 14:26:18.992446 dv-cinder-787296-9-smb devstack@keystone.service[80467]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 25 14:26:24.825029 dv-cinder-787296-9-smb devstack@keystone.service[80474]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 25 14:26:24.825029 dv-cinder-787296-9-smb devstack@keystone.service[80474]: from cryptography.utils import int_from_bytes May 25 14:26:24.825800 dv-cinder-787296-9-smb devstack@keystone.service[80474]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 25 14:26:24.825800 dv-cinder-787296-9-smb devstack@keystone.service[80474]: from cryptography.utils import int_from_bytes May 25 14:26:24.870975 dv-cinder-787296-9-smb devstack@keystone.service[80475]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 25 14:26:24.870975 dv-cinder-787296-9-smb devstack@keystone.service[80475]: from cryptography.utils import int_from_bytes May 25 14:26:24.871538 dv-cinder-787296-9-smb devstack@keystone.service[80475]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 25 14:26:24.871538 dv-cinder-787296-9-smb devstack@keystone.service[80475]: from cryptography.utils import int_from_bytes May 25 14:26:24.876053 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 25 14:26:24.876246 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 25 14:26:24.876436 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] command line args: [] {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 25 14:26:24.876700 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 25 14:26:24.876874 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] ================================================================================ {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 25 14:26:24.877123 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] admin_token = **** {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:26:24.877361 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] config_dir = [] {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:26:24.877543 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:26:24.877721 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] config_source = [] {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:26:24.877897 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] debug = True {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:26:24.878091 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:26:24.878448 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:26:24.878625 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:26:24.878872 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:26:24.879141 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:26:24.879368 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] list_limit = None {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:26:24.879545 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] log_config_append = None {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:26:24.879852 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:26:24.879946 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] log_dir = None {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:26:24.880102 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] log_file = None {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:26:24.880283 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:26:24.880532 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:26:24.880783 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:26:24.881017 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:26:24.881193 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:26:24.881369 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:26:24.881609 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:26:24.881850 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:26:24.882078 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:26:24.882307 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:26:24.882536 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:26:24.882764 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:26:24.883023 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:26:24.883271 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:26:24.883543 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:26:24.884022 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.67/identity {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:26:24.884201 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] publish_errors = False {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:26:24.884429 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:26:24.884653 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:26:24.884828 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:26:24.885073 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:26:24.885305 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:26:24.885534 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] standard_threads = False {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:26:24.885759 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:26:24.885998 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:26:24.886179 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:26:24.886341 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] use_journal = False {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:26:24.886512 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] use_json = False {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:26:24.886685 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] use_stderr = False {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:26:24.886856 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] use_syslog = False {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:26:24.887102 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:26:24.887357 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.887594 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.887849 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.888083 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.888329 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.888567 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.888812 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.889044 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.889287 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.889531 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.889776 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.890006 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.890249 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.891038 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.891271 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.891517 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.891756 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.892004 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.892255 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.892496 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.892730 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.892979 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.893236 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.893486 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.893731 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.893959 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.894185 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.894411 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.894642 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.894887 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.895153 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.895381 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.895614 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.895858 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.896101 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.896335 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.896580 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.896806 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.897037 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.897267 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.897492 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.897718 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.897945 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.898170 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.898401 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.898645 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.898870 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.899122 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.899351 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.899580 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.899810 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.900054 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.900280 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.900512 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.900743 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.900975 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.901207 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.901791 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.902031 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.902279 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.902511 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.902744 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.902974 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.903251 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.903485 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.903712 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.903945 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.904179 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.904444 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.904676 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.904920 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.905162 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.905392 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.905631 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.905863 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.906127 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.906953 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.907214 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.907455 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.907689 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.907924 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.908155 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.908388 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.908620 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.908876 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.909111 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.909347 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.909581 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.909818 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.910050 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.910282 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.910515 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.910742 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.910968 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.911219 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.911449 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.911676 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.911910 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.912141 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.912385 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.912619 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.912870 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.913124 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.913361 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.913587 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] auth.external = None {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.913814 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.914104 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.914331 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.914558 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] auth.password = None {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.914784 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] auth.token = None {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.915040 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.915275 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.915518 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.915751 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.915996 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.916240 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.916467 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.916696 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] credential.caching = True {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.916940 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.917184 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.917429 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.917663 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.917905 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.918135 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.918393 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.918642 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.918876 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.919151 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.919430 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.919673 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.919917 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 25 14:26:24.919997 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.920114 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 25 14:26:24.920205 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.920307 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] command line args: [] {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 25 14:26:24.920384 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.920579 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 25 14:26:24.920663 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] federation.caching = True {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.920743 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] ================================================================================ {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 25 14:26:24.920836 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.921001 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] admin_token = **** {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:26:24.921087 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.921249 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] config_dir = [] {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:26:24.921327 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.921436 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:26:24.921522 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.921618 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] config_source = [] {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:26:24.921788 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.921924 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] debug = True {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:26:24.922006 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.922141 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:26:24.922247 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:26:24.922320 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.922420 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:26:24.922619 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.922738 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:26:24.922873 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.922985 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:26:24.923140 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.923248 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] list_limit = None {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:26:24.923352 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] log_config_append = None {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:26:24.923460 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.923558 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:26:24.923661 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] identity.caching = True {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.923741 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] log_dir = None {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:26:24.923859 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.923942 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] log_file = None {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:26:24.924045 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:26:24.924126 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.924274 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.924353 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:26:24.924506 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.924589 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:26:24.924751 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.924839 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:26:24.924960 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:26:24.925043 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.925161 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:26:24.925247 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.925357 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:26:24.925481 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.925558 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:26:24.925676 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.925792 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:26:24.925877 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.926010 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:26:24.926089 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.926247 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:26:24.926328 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.926480 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:26:24.926725 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:26:24.926971 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:26:24.927112 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.927272 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.927351 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:26:24.927519 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.927762 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.67/identity {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:26:24.927915 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.928042 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] publish_errors = False {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:26:24.928165 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.928288 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:26:24.928426 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.928550 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:26:24.928677 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.928811 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:26:24.928947 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.929077 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:26:24.929213 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.929341 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:26:24.929470 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.929592 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] standard_threads = False {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:26:24.929719 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.929845 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:26:24.930044 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.930175 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:26:24.930303 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.930431 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:26:24.930431 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] use_journal = False {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:26:24.930671 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.930816 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] use_json = False {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:26:24.930941 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.931088 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] use_stderr = False {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:26:24.931088 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] use_syslog = False {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:26:24.931330 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.931456 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:26:24.931598 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.931732 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.931859 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.931859 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.932098 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.932225 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.932363 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.932512 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.932651 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.932779 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.932911 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.933039 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.933165 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.933302 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.933429 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.933556 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.933633 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.933712 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.933791 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.933871 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.933944 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.934020 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.934092 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.934162 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.934232 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.934313 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.934387 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.934457 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.934528 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.934606 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.934681 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.934763 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.934836 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.934907 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.934978 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.935083 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.935155 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.935242 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.935316 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.935413 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.935494 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.935576 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.935649 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.935720 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] ldap.user = None {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.935867 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.935955 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.936128 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.936206 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.936385 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.936464 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.936637 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.936725 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.936872 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.937073 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.937153 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.937324 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.937467 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.937585 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.937836 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.937921 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.938087 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.938166 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.938320 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.938406 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.938554 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.938633 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.938804 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.938883 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.939051 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.939147 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.939300 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.939379 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.939545 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.939624 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.939775 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.939862 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.940013 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.940092 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.940248 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.940327 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.940474 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.940565 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.940704 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.940782 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.940938 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.941017 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.941169 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.941255 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.941402 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.941487 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.941633 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.941713 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.941869 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.941955 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.942108 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.942188 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.942338 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.942422 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.942574 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.942661 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.942814 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.942893 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.943075 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.943158 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.943310 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.943468 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.943545 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.943617 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.943761 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.943841 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.944000 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.944080 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.944238 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.944317 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.944467 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.944547 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.944697 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.944777 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.944931 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] resource.caching = True {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.945010 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.945178 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.945280 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.945418 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.945529 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.945652 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.945768 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.945912 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.946016 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.946151 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.946263 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.946385 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.946497 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.946624 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.946741 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.946863 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.946976 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.947158 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.947239 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.947399 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.947479 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] role.caching = True {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.947650 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.947731 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] role.driver = sql {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.947895 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.947976 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.948133 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.948213 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.948370 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.948451 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.948608 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.948689 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.948851 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.948931 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.949089 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.949168 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.949330 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.949411 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.949571 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.949649 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.949809 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.949895 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.950036 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.950115 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.950273 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.950352 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.950510 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.950590 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.950747 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.950827 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.951045 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.951129 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.951264 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.951402 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.951507 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.951636 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.951746 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.951884 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.951973 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.952131 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.952211 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.952375 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.952455 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.952621 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.952714 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.952853 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.952933 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.953611 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.953698 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.953850 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.953941 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.954145 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.954224 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.954297 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.954369 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.954534 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.954625 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.954770 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.954849 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.955043 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.955126 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.955287 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.955377 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.955545 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.955624 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.955804 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.955884 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.956034 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.956121 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.956262 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.956343 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] auth.external = None {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.956493 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.956571 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] token.caching = True {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.956724 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.956814 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.956969 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.957049 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.957200 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.957279 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] auth.password = None {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.957449 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.957531 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] auth.token = None {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.957674 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.957772 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.957911 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.957990 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.958150 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.958231 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.958381 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.958459 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.958620 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.958699 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.958853 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.958934 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.959110 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.959191 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.959341 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.959420 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] credential.caching = True {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.959584 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.959666 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.959827 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.959906 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.960063 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.960149 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.960299 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.960378 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.960545 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.960625 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.960780 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.960859 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] database.connection = **** {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.961045 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.961134 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.961292 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.961371 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.961528 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.961606 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.961763 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.961841 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.961994 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.962075 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.962226 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.962306 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.962459 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.962539 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.962692 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.962773 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.962933 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.963053 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.963190 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.963294 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] federation.caching = True {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.963433 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.963536 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.963664 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.963785 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.963910 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.964062 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.964139 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.964256 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.964368 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.964503 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.964583 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.964744 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.964824 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.965001 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.965081 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.965185 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 25 14:26:24.965264 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.965483 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.965721 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.965969 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.966205 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] identity.caching = True {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.966455 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.966703 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.966940 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.967217 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.967467 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.967701 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.967940 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.968192 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.968446 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.969398 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.969620 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.969857 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.970107 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.970357 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.970607 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.970864 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.971139 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.971414 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.971715 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.971995 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.972265 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.972568 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.972865 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.973107 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.973353 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.973596 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.973850 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.974085 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.974335 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.974589 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.974827 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.975103 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.975363 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.975598 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.975839 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.976072 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.976312 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.976552 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.976799 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.977039 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.977278 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.977531 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.977782 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.978015 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.978250 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.978500 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.978750 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.979009 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.979250 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.979488 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.979722 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] ldap.user = None {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.979963 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.980224 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.980457 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.980706 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.980954 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.981202 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.981439 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.981671 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.981907 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.982142 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.982381 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.982613 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.982862 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.983137 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.983387 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.983637 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.983886 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.984118 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.984406 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.984640 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.984888 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.985127 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.985371 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.985621 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.985871 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.986111 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.986368 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.986602 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.986848 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.987112 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.987352 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.987591 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.987839 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.988086 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.988321 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.988561 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.988801 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] resource.caching = True {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.989053 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.989303 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.989539 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.989791 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.990042 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.990281 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.990531 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.990771 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.991034 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.991277 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] role.caching = True {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.991532 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] role.driver = sql {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.991745 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.992003 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.992357 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.992612 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.992862 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.993117 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.993368 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.993620 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.993871 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.994108 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.994614 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.994869 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.995145 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.995406 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.995816 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.996051 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.996305 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.996557 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.996808 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.997055 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.997292 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.997550 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.997807 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.998049 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.998286 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.998710 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.999006 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.999347 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.999609 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:24.999876 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:25.000478 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:25.000827 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:25.001144 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:25.001387 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] token.caching = True {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:25.001630 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:25.001882 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:25.002191 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:25.002571 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:25.002830 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:25.003112 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:25.003364 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:25.003612 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:25.003876 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:25.004117 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:25.004363 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:25.004602 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:25.004855 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:25.005108 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:25.005343 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:25.005591 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:25.005898 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:25.006166 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] database.connection = **** {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:25.006415 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:25.006666 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:25.006907 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:25.007074 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80474) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 14:26:25.007162 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:25.007405 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80474) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 14:26:25.007494 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:25.007674 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:25.007740 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80474) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 14:26:25.007875 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:25.008126 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:25.008373 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:25.008613 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:25.008859 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:25.009098 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:25.009349 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:25.009587 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:25.009834 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:25.010066 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:25.010307 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:25.010544 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:26:25.010714 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 25 14:26:25.017646 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80474) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 14:26:25.038855 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80475) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 14:26:25.039250 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80475) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 14:26:25.039483 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80475) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 14:26:25.046606 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80474) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 14:26:25.046931 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80474) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 14:26:25.048473 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80475) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 14:26:25.067115 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80475) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 14:26:25.067348 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80475) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 14:26:25.100981 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80474) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 14:26:25.105743 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80475) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 14:26:25.153374 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80474) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 14:26:25.153612 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80474) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 14:26:25.154088 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80475) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 14:26:25.154328 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80475) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 14:26:25.221618 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80474) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 14:26:25.221759 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80475) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 14:26:25.221852 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80474) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 14:26:25.222007 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80475) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 14:26:25.222178 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80474) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 14:26:25.222318 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80475) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 14:26:25.222452 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80474) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 14:26:25.222582 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80475) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 14:26:25.222724 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80474) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 14:26:25.222856 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80475) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 14:26:25.223012 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80474) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 14:26:25.223155 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80475) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 14:26:25.246854 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80474) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 14:26:25.247077 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80475) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 14:26:25.247172 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80474) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 14:26:25.247253 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80475) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 14:26:25.247330 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80474) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 14:26:25.247439 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80475) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 14:26:25.247562 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80474) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 14:26:25.247657 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80475) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 14:26:25.247787 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80474) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 14:26:25.247869 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80475) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 14:26:25.248004 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80474) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 14:26:25.248087 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80475) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 14:26:25.248220 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80474) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 14:26:25.248304 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80475) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 14:26:25.262171 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80474) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 14:26:25.263724 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80475) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 14:26:25.274879 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80474) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 14:26:25.275175 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80474) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 14:26:25.275396 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80474) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 14:26:25.275527 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80475) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 14:26:25.275612 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80474) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 14:26:25.275764 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80475) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 14:26:25.275861 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80474) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 14:26:25.275994 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80475) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 14:26:25.276078 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80474) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 14:26:25.276221 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80475) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 14:26:25.276303 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80474) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 14:26:25.276440 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80475) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 14:26:25.276656 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80475) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 14:26:25.276871 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80475) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 14:26:25.296157 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:26:25.296368 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 25 14:26:25.296569 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:26:25.296708 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:26:25.297537 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 25 14:26:25.297940 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 25 14:26:25.298020 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:26:25.298020 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 25 14:26:25.298154 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:26:25.298237 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:26:25.298313 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:26:25.298386 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:26:25.298459 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:26:25.298532 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:26:25.298613 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:26:25.298793 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:26:25.309721 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:26:25.309866 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:26:25.309999 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:26:25.310147 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:26:25.310272 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:26:25.310419 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:26:25.310554 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:26:25.310703 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:26:25.318746 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80474) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 14:26:25.318865 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80475) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 14:26:25.322092 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80474) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 14:26:25.322179 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80475) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 14:26:25.322375 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:26:25.322457 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:26:25.322658 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:26:25.322741 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:26:25.322943 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:26:25.323041 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:26:25.323250 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:26:25.323333 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:26:25.323509 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:26:25.323592 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:26:25.323886 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:26:25.323968 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:26:25.324163 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:26:25.324254 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:26:25.324438 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:26:25.324518 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:26:25.324713 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:26:25.324793 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:26:25.324979 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:26:25.325059 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:26:25.351990 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:26:25.352226 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:26:25.353673 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80474) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 14:26:25.353953 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:26:25.354047 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80475) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 14:26:25.354232 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:26:25.360011 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80474) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 14:26:25.360425 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80475) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 14:26:25.360504 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:26:25.360594 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:26:25.360672 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:26:25.360747 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:26:25.367847 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80474) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 14:26:25.368000 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80475) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 14:26:25.368134 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:26:25.368283 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:26:25.372906 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80474) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 14:26:25.373072 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80475) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 14:26:25.373308 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:26:25.373472 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:26:25.373595 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:26:25.373755 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:26:25.373880 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:26:25.374038 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:26:25.374159 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:26:25.374317 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:26:25.374433 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:26:25.374590 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:26:25.374703 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:26:25.374878 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:26:25.375077 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:26:25.376069 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:26:25.394008 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:26:25.394124 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:26:25.394287 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:26:25.394387 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:26:25.398941 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80475) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 14:26:25.399047 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80474) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 14:26:25.402589 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:26:25.402671 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:26:25.402882 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:26:25.402963 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:26:25.408591 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80474) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 14:26:25.408691 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80475) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 14:26:25.412247 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80474) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 14:26:25.412332 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80475) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 14:26:25.416047 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:26:25.416129 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:26:25.416348 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:26:25.416428 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:26:25.416643 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:26:25.416808 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:26:25.416933 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:26:25.417015 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:26:25.417214 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:26:25.417293 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:26:25.417489 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:26:25.417569 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:26:25.437060 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80475) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 14:26:25.437288 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80474) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 14:26:25.437370 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:26:25.437736 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:26:25.437817 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:26:25.438039 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:26:25.438143 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:26:25.438410 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:26:25.446113 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:26:25.446849 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:26:25.447845 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:26:25.448123 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:26:25.448619 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:26:25.448900 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:26:25.451208 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80475) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 14:26:25.451493 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:26:25.451781 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:26:25.452006 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80474) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 14:26:25.452087 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:26:25.452292 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:26:25.452373 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:26:25.452573 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:26:25.452852 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:26:25.453162 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:26:25.466295 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80475) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 14:26:25.466572 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:26:25.466666 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80474) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 14:26:25.466847 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:26:25.466929 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:26:25.467157 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:26:25.467241 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:26:25.467438 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:26:25.467520 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:26:25.467713 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:26:25.467803 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:26:25.467994 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:26:25.468075 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:26:25.468296 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:26:25.487345 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80475) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 14:26:25.487837 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80474) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 14:26:25.490628 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80475) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 14:26:25.491145 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80474) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 14:26:25.493984 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:26:25.494741 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:26:25.495885 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:26:25.496396 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:26:25.497514 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80475) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 14:26:25.497804 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:26:25.498060 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80474) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 14:26:25.498142 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:26:25.498350 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:26:25.498635 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:26:25.505962 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:26:25.506117 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:26:25.507616 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80475) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 14:26:25.507774 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80474) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 14:26:25.510896 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:26:25.511061 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:26:25.511211 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:26:25.511354 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:26:25.511495 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:26:25.511640 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:26:25.511771 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:26:25.511915 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:26:25.521047 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80475) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 14:26:25.521143 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80474) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 14:26:25.521333 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:26:25.521415 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:26:25.521714 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:26:25.521796 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:26:25.529600 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80475) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 14:26:25.529720 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80474) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 14:26:25.529881 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:26:25.530032 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:26:25.530166 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:26:25.530275 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:26:25.530447 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:26:25.530537 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:26:25.530722 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:26:25.530802 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:26:25.531622 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:26:25.531716 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:26:25.531805 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:26:25.531958 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:26:25.532085 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:26:25.532228 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:26:25.532398 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:26:25.532513 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:26:25.532623 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:26:25.532782 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:26:25.532892 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:26:25.533045 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:26:25.533151 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:26:25.533295 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:26:25.533414 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:26:25.533566 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:26:25.533687 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:26:25.533826 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:26:25.573041 dv-cinder-787296-9-smb devstack@keystone.service[80475]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x55832fde09c0 pid: 80475 (default app) May 25 14:26:25.573443 dv-cinder-787296-9-smb devstack@keystone.service[80474]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x55832fde09c0 pid: 80474 (default app) May 25 14:26:25.576266 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ea2f93-efe4-4a8d-9dbe-6247ceaca45b None None] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:26:25.576569 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ea2f93-efe4-4a8d-9dbe-6247ceaca45b None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:26:25.576852 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ea2f93-efe4-4a8d-9dbe-6247ceaca45b None None] PATH_INFO: `/v3` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:26:25.581539 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1/1] 10.222.0.67 () {50 vars in 791 bytes} [Wed May 25 14:26:25 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:26:33.642966 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e02886-69c8-4dc6-9ac3-386cad478225 None None] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:26:33.643548 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e02886-69c8-4dc6-9ac3-386cad478225 None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:26:33.643548 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e02886-69c8-4dc6-9ac3-386cad478225 None None] PATH_INFO: `/` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:26:33.647988 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1/2] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 14:26:33 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 14:26:33.653029 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aabc1de-cd2c-4c95-aeb3-3437b886681e None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:26:33.653451 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aabc1de-cd2c-4c95-aeb3-3437b886681e None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:26:33.653585 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aabc1de-cd2c-4c95-aeb3-3437b886681e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:26:33.721271 dv-cinder-787296-9-smb devstack@keystone.service[80475]: INFO dbcounter [None req-9aabc1de-cd2c-4c95-aeb3-3437b886681e None None] Registered counter for database keystone May 25 14:26:33.743116 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG oslo_db.sqlalchemy.engines [None req-9aabc1de-cd2c-4c95-aeb3-3437b886681e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80475) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 25 14:26:33.749576 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writer thread running {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 25 14:26:33.927387 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG passlib.handlers.bcrypt [None req-9aabc1de-cd2c-4c95-aeb3-3437b886681e None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80475) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 25 14:26:33.927732 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG passlib.handlers.bcrypt [None req-9aabc1de-cd2c-4c95-aeb3-3437b886681e None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80475) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 25 14:26:33.982600 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-9aabc1de-cd2c-4c95-aeb3-3437b886681e None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:26:33.984725 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-9aabc1de-cd2c-4c95-aeb3-3437b886681e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:26:34.107396 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 2/3] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 14:26:33 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 455 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) May 25 14:26:34.259279 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e02886-69c8-4dc6-9ac3-386cad478225 None None] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:26:34.333515 dv-cinder-787296-9-smb devstack@keystone.service[80474]: INFO dbcounter [None req-f2e02886-69c8-4dc6-9ac3-386cad478225 None None] Registered counter for database keystone May 25 14:26:34.352840 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG oslo_db.sqlalchemy.engines [None req-f2e02886-69c8-4dc6-9ac3-386cad478225 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80474) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 25 14:26:34.358962 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writer thread running {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 25 14:26:34.479318 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e02886-69c8-4dc6-9ac3-386cad478225 None None] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:26:34.483552 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3104408-85eb-4362-9468-d17f35489456 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:26:34.484880 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3104408-85eb-4362-9468-d17f35489456 admin admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:26:34.485163 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3104408-85eb-4362-9468-d17f35489456 admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:26:34.485440 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3104408-85eb-4362-9468-d17f35489456 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:26:34.493568 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3104408-85eb-4362-9468-d17f35489456 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:26:34.545213 dv-cinder-787296-9-smb devstack@keystone.service[80474]: WARNING keystone.common.rbac_enforcer.enforcer [None req-b3104408-85eb-4362-9468-d17f35489456 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 25 14:26:34.545548 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3104408-85eb-4362-9468-d17f35489456 admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:26:34.555821 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 2/4] 10.222.0.67 () {58 vars in 1324 bytes} [Wed May 25 14:26:34 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 25 14:26:34.561802 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aabc1de-cd2c-4c95-aeb3-3437b886681e None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:26:34.576112 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aabc1de-cd2c-4c95-aeb3-3437b886681e None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:26:34.580545 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd87d67b-dea2-4f69-91e1-adeedf7ba3aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:26:34.581659 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd87d67b-dea2-4f69-91e1-adeedf7ba3aa admin admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:26:34.581947 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd87d67b-dea2-4f69-91e1-adeedf7ba3aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:26:34.582228 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd87d67b-dea2-4f69-91e1-adeedf7ba3aa admin admin] PATH_INFO: `/v3/projects/277acbf9eb0e4a9b87508241a478db4f` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:26:34.583756 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd87d67b-dea2-4f69-91e1-adeedf7ba3aa admin admin] RBAC: Authorizing `identity:get_project(project_id=277acbf9eb0e4a9b87508241a478db4f)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:26:34.640259 dv-cinder-787296-9-smb devstack@keystone.service[80475]: WARNING keystone.common.rbac_enforcer.enforcer [None req-bd87d67b-dea2-4f69-91e1-adeedf7ba3aa admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 25 14:26:34.641336 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd87d67b-dea2-4f69-91e1-adeedf7ba3aa admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:26:34.647256 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 3/5] 10.222.0.67 () {56 vars in 1207 bytes} [Wed May 25 14:26:34 2022] GET /identity/v3/projects/277acbf9eb0e4a9b87508241a478db4f => generated 344 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:26:36.855520 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a732f0f7-fe87-45ad-b57f-76f4a1acefbf None None] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:26:36.855943 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a732f0f7-fe87-45ad-b57f-76f4a1acefbf None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:26:36.856091 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a732f0f7-fe87-45ad-b57f-76f4a1acefbf None None] PATH_INFO: `/` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:26:36.861094 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 3/6] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 14:26:36 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 14:26:36.866645 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5de467-f8e6-4694-81e0-bdedca8aa509 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:26:36.867083 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5de467-f8e6-4694-81e0-bdedca8aa509 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:26:36.867239 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5de467-f8e6-4694-81e0-bdedca8aa509 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:26:36.887023 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-2d5de467-f8e6-4694-81e0-bdedca8aa509 None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:26:36.888517 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-2d5de467-f8e6-4694-81e0-bdedca8aa509 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:26:36.896631 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 4/7] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 14:26:36 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) May 25 14:26:36.918640 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a732f0f7-fe87-45ad-b57f-76f4a1acefbf None None] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:26:36.931267 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a732f0f7-fe87-45ad-b57f-76f4a1acefbf None None] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:26:36.935448 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdb0b68-cfa1-495b-958a-b97f2b3ac7ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:26:36.936086 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdb0b68-cfa1-495b-958a-b97f2b3ac7ae admin admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:26:36.936374 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdb0b68-cfa1-495b-958a-b97f2b3ac7ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:26:36.936657 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdb0b68-cfa1-495b-958a-b97f2b3ac7ae admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:26:36.944909 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdb0b68-cfa1-495b-958a-b97f2b3ac7ae admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:26:36.946688 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdb0b68-cfa1-495b-958a-b97f2b3ac7ae admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:26:36.955677 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 4/8] 10.222.0.67 () {58 vars in 1324 bytes} [Wed May 25 14:26:36 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 25 14:26:36.960923 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5de467-f8e6-4694-81e0-bdedca8aa509 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:26:36.969852 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5de467-f8e6-4694-81e0-bdedca8aa509 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:26:36.974235 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b28551-a46f-4f63-9d63-2c2e37c29704 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:26:36.975125 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b28551-a46f-4f63-9d63-2c2e37c29704 admin admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:26:36.975414 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b28551-a46f-4f63-9d63-2c2e37c29704 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:26:36.975692 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b28551-a46f-4f63-9d63-2c2e37c29704 admin admin] PATH_INFO: `/v3/users/be354bf3692549b095099e6268f938f3` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:26:36.977082 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b28551-a46f-4f63-9d63-2c2e37c29704 admin admin] RBAC: Authorizing `identity:get_user(user_id=be354bf3692549b095099e6268f938f3)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:26:36.978905 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b28551-a46f-4f63-9d63-2c2e37c29704 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:26:36.980486 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 5/9] 10.222.0.67 () {56 vars in 1198 bytes} [Wed May 25 14:26:36 2022] GET /identity/v3/users/be354bf3692549b095099e6268f938f3 => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:26:39.233197 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffca6d1-cbde-4a15-84e8-46a247e6bdf3 None None] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:26:39.233696 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffca6d1-cbde-4a15-84e8-46a247e6bdf3 None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:26:39.233696 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffca6d1-cbde-4a15-84e8-46a247e6bdf3 None None] PATH_INFO: `/` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:26:39.235674 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 5/10] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 14:26:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 14:26:39.240863 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddf0cb5-3b89-4a31-a79d-70d6c2594238 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:26:39.241264 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddf0cb5-3b89-4a31-a79d-70d6c2594238 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:26:39.241426 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddf0cb5-3b89-4a31-a79d-70d6c2594238 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:26:39.259237 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-0ddf0cb5-3b89-4a31-a79d-70d6c2594238 None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:26:39.260409 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-0ddf0cb5-3b89-4a31-a79d-70d6c2594238 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:26:39.283848 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da80b48d-4d6a-45c4-8363-fbb40150212a None None] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:26:39.284224 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da80b48d-4d6a-45c4-8363-fbb40150212a None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:26:39.284512 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da80b48d-4d6a-45c4-8363-fbb40150212a None None] PATH_INFO: `/` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:26:39.285872 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 6/11] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 14:26:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 14:26:39.291015 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a4c4fd-a6c8-4ffb-9564-c9afb6930d49 None None] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:26:39.291311 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a4c4fd-a6c8-4ffb-9564-c9afb6930d49 None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:26:39.291596 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a4c4fd-a6c8-4ffb-9564-c9afb6930d49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:26:39.332110 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG passlib.handlers.bcrypt [None req-f4a4c4fd-a6c8-4ffb-9564-c9afb6930d49 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80474) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 25 14:26:39.332541 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG passlib.handlers.bcrypt [None req-f4a4c4fd-a6c8-4ffb-9564-c9afb6930d49 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80474) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 25 14:26:39.340936 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 6/12] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 14:26:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 14:26:39.364041 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddf0cb5-3b89-4a31-a79d-70d6c2594238 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:26:39.380710 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.auth.core [None req-f4a4c4fd-a6c8-4ffb-9564-c9afb6930d49 None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:26:39.382444 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-f4a4c4fd-a6c8-4ffb-9564-c9afb6930d49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:26:39.390124 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:26:39.473766 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddf0cb5-3b89-4a31-a79d-70d6c2594238 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:26:39.485294 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 7/13] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 14:26:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 14:26:39.507507 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a4c4fd-a6c8-4ffb-9564-c9afb6930d49 None None] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:26:39.508509 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a150043-0f56-4d6b-a0a9-86f7cb28ce95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:26:39.509311 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a150043-0f56-4d6b-a0a9-86f7cb28ce95 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:26:39.509600 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a150043-0f56-4d6b-a0a9-86f7cb28ce95 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:26:39.509883 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a150043-0f56-4d6b-a0a9-86f7cb28ce95 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:26:39.635787 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a150043-0f56-4d6b-a0a9-86f7cb28ce95 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:26:39.647912 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application [None req-7a150043-0f56-4d6b-a0a9-86f7cb28ce95 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 14:26:39.647912 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:26:39.647912 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:26:39.647912 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:26:39.647912 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:26:39.647912 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:26:39.647912 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:26:39.647912 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:26:39.647912 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:26:39.647912 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:26:39.647912 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:26:39.647912 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:26:39.647912 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:26:39.647912 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:26:39.647912 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:26:39.647912 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:26:39.649003 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:26:39.649003 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:26:39.649003 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:26:39.649003 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:26:39.649003 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:26:39.649003 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:26:39.649003 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:26:39.649003 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:26:39.649003 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:26:39.649003 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:26:39.649003 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:26:39.649003 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application with Lock( May 25 14:26:39.649003 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:26:39.649003 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._enter() May 25 14:26:39.649003 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:26:39.649003 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:26:39.649863 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:26:39.649863 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.creator() May 25 14:26:39.649863 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:26:39.649863 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application created_value = creator( May 25 14:26:39.649863 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:26:39.649863 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:26:39.649863 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:26:39.649863 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:26:39.649863 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:26:39.649863 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:26:39.649863 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 14:26:39.649863 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:26:39.649863 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 7/14] 10.222.0.67 () {56 vars in 1096 bytes} [Wed May 25 14:26:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 14:26:39.655305 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a150043-0f56-4d6b-a0a9-86f7cb28ce95 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:26:39.730202 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a4c4fd-a6c8-4ffb-9564-c9afb6930d49 None None] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:26:39.732887 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:26:39.739776 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:26:39.759522 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a150043-0f56-4d6b-a0a9-86f7cb28ce95 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:26:39.770764 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d78c203-d25d-476c-bff8-0b4340dc58e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:26:39.771702 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d78c203-d25d-476c-bff8-0b4340dc58e4 None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:26:39.771996 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d78c203-d25d-476c-bff8-0b4340dc58e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:26:39.772283 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d78c203-d25d-476c-bff8-0b4340dc58e4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:26:39.793002 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e18b2e-ea96-4f61-9cb7-6d405db9a6f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:26:39.793666 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e18b2e-ea96-4f61-9cb7-6d405db9a6f5 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:26:39.793953 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e18b2e-ea96-4f61-9cb7-6d405db9a6f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:26:39.794235 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e18b2e-ea96-4f61-9cb7-6d405db9a6f5 None admin] PATH_INFO: `/v3/roles` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:26:39.794980 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e18b2e-ea96-4f61-9cb7-6d405db9a6f5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:26:39.795316 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e18b2e-ea96-4f61-9cb7-6d405db9a6f5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:26:39.797403 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e18b2e-ea96-4f61-9cb7-6d405db9a6f5 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:26:39.808801 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 8/15] 10.222.0.67 () {56 vars in 1099 bytes} [Wed May 25 14:26:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:26:39.814214 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e18b2e-ea96-4f61-9cb7-6d405db9a6f5 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:26:39.842456 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d78c203-d25d-476c-bff8-0b4340dc58e4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:26:39.845182 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d78c203-d25d-476c-bff8-0b4340dc58e4 None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:26:39.915631 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e18b2e-ea96-4f61-9cb7-6d405db9a6f5 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:26:39.944459 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 8/16] 10.222.0.67 () {58 vars in 1282 bytes} [Wed May 25 14:26:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 437 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 25 14:26:39.950177 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d78c203-d25d-476c-bff8-0b4340dc58e4 None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:26:39.951013 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791eba93-b907-41dc-acbf-52e2cdaf6264 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:26:39.951903 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791eba93-b907-41dc-acbf-52e2cdaf6264 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:26:39.952192 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791eba93-b907-41dc-acbf-52e2cdaf6264 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:26:39.952489 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791eba93-b907-41dc-acbf-52e2cdaf6264 None admin] PATH_INFO: `/v3/users/be354bf3692549b095099e6268f938f3` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:26:39.953871 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:26:39.954405 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791eba93-b907-41dc-acbf-52e2cdaf6264 None admin] RBAC: Authorizing `identity:get_user(user_id=be354bf3692549b095099e6268f938f3)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:26:39.955956 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791eba93-b907-41dc-acbf-52e2cdaf6264 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:26:39.961784 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 9/17] 10.222.0.67 () {56 vars in 1177 bytes} [Wed May 25 14:26:39 2022] GET /identity/v3/users/be354bf3692549b095099e6268f938f3 => generated 247 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:26:39.963238 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791eba93-b907-41dc-acbf-52e2cdaf6264 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:26:39.978276 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:26:40.056513 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d78c203-d25d-476c-bff8-0b4340dc58e4 None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:26:40.066188 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791eba93-b907-41dc-acbf-52e2cdaf6264 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:26:40.090126 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5497ebca-20da-4e7a-a298-bbc541d3a327 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:26:40.090926 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5497ebca-20da-4e7a-a298-bbc541d3a327 None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:26:40.091241 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5497ebca-20da-4e7a-a298-bbc541d3a327 None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:26:40.091521 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5497ebca-20da-4e7a-a298-bbc541d3a327 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:26:40.099140 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8bbf00-27b4-4f7a-acaa-f59f523c9327 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:26:40.099929 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8bbf00-27b4-4f7a-acaa-f59f523c9327 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:26:40.100217 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8bbf00-27b4-4f7a-acaa-f59f523c9327 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:26:40.100497 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8bbf00-27b4-4f7a-acaa-f59f523c9327 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:26:40.101675 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8bbf00-27b4-4f7a-acaa-f59f523c9327 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:26:40.103169 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8bbf00-27b4-4f7a-acaa-f59f523c9327 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:26:40.104793 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 10/18] 10.222.0.67 () {56 vars in 1108 bytes} [Wed May 25 14:26:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:26:40.110599 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5497ebca-20da-4e7a-a298-bbc541d3a327 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:26:40.111063 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8bbf00-27b4-4f7a-acaa-f59f523c9327 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:26:40.112108 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5497ebca-20da-4e7a-a298-bbc541d3a327 None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:26:40.134655 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application [None req-5497ebca-20da-4e7a-a298-bbc541d3a327 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:26:40.134655 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:26:40.134655 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:26:40.134655 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:26:40.134655 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:26:40.134655 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:26:40.134655 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:26:40.134655 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:26:40.134655 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:26:40.134655 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:26:40.134655 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:26:40.134655 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:26:40.134655 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 14:26:40.134655 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 14:26:40.134655 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 14:26:40.135550 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 14:26:40.135550 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:26:40.135550 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:26:40.135550 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:26:40.135550 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:26:40.135550 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:26:40.135550 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:26:40.135550 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:26:40.135550 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application with Lock( May 25 14:26:40.135550 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:26:40.135550 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self._enter() May 25 14:26:40.135550 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:26:40.135550 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:26:40.135550 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:26:40.135550 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.creator() May 25 14:26:40.135550 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:26:40.135550 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application created_value = creator( May 25 14:26:40.136357 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 14:26:40.136357 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 14:26:40.136357 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:26:40.136357 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application May 25 14:26:40.136357 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 9/19] 10.222.0.67 () {56 vars in 1108 bytes} [Wed May 25 14:26:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 14:26:40.141837 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5497ebca-20da-4e7a-a298-bbc541d3a327 None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:26:40.193138 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:26:40.199911 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:26:40.212293 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8bbf00-27b4-4f7a-acaa-f59f523c9327 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:26:40.246295 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5497ebca-20da-4e7a-a298-bbc541d3a327 None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:26:40.246831 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f4bfa0-1c0e-44be-8b4f-f049266cb126 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:26:40.247245 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f4bfa0-1c0e-44be-8b4f-f049266cb126 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:26:40.247529 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f4bfa0-1c0e-44be-8b4f-f049266cb126 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:26:40.247809 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f4bfa0-1c0e-44be-8b4f-f049266cb126 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:26:40.248639 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f4bfa0-1c0e-44be-8b4f-f049266cb126 None admin] RBAC: Adding query filter params (role.id=399893e19eac4ab5a8e596f7c07be13c, scope.domain.id=default, user.id=be354bf3692549b095099e6268f938f3) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:26:40.248953 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f4bfa0-1c0e-44be-8b4f-f049266cb126 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:26:40.250616 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f4bfa0-1c0e-44be-8b4f-f049266cb126 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:26:40.257262 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 11/20] 10.222.0.67 () {56 vars in 1322 bytes} [Wed May 25 14:26:40 2022] GET /identity/v3/role_assignments?user.id=be354bf3692549b095099e6268f938f3&scope.domain.id=default&role.id=399893e19eac4ab5a8e596f7c07be13c => generated 233 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:26:40.281591 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f737a94e-54a2-435c-9545-ed5bcf862547 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:26:40.282358 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f737a94e-54a2-435c-9545-ed5bcf862547 None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:26:40.282657 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f737a94e-54a2-435c-9545-ed5bcf862547 None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:26:40.282941 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f737a94e-54a2-435c-9545-ed5bcf862547 None admin] PATH_INFO: `/v3/domains` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:26:40.283762 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f737a94e-54a2-435c-9545-ed5bcf862547 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:26:40.284055 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f737a94e-54a2-435c-9545-ed5bcf862547 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:26:40.285500 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f737a94e-54a2-435c-9545-ed5bcf862547 None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:26:40.305607 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 10/21] 10.222.0.67 () {56 vars in 1109 bytes} [Wed May 25 14:26:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:26:42.907784 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb094223-0a32-4930-837c-cff45f0c3b0a None None] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:26:42.908740 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb094223-0a32-4930-837c-cff45f0c3b0a None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:26:42.909244 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb094223-0a32-4930-837c-cff45f0c3b0a None None] PATH_INFO: `/` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:26:42.910826 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 12/22] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 14:26:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:26:42.916323 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648f55b8-4499-4d90-92ec-ca64618739cc None None] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:26:42.917177 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648f55b8-4499-4d90-92ec-ca64618739cc None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:26:42.917676 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648f55b8-4499-4d90-92ec-ca64618739cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:26:42.930811 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e499c23-fb7f-465b-ae28-5833bb4099d6 None None] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:26:42.931456 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e499c23-fb7f-465b-ae28-5833bb4099d6 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:26:42.931960 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e499c23-fb7f-465b-ae28-5833bb4099d6 None None] PATH_INFO: `/` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:26:42.933518 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 13/23] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 14:26:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 14:26:42.939302 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771e52a3-125a-4a6a-a75b-3a52e09d2203 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:26:42.939861 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771e52a3-125a-4a6a-a75b-3a52e09d2203 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:26:42.940341 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771e52a3-125a-4a6a-a75b-3a52e09d2203 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:26:42.959748 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.auth.core [None req-648f55b8-4499-4d90-92ec-ca64618739cc None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:26:42.961484 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-648f55b8-4499-4d90-92ec-ca64618739cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:26:42.967713 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-771e52a3-125a-4a6a-a75b-3a52e09d2203 None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:26:42.970880 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-771e52a3-125a-4a6a-a75b-3a52e09d2203 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:26:43.137670 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 11/24] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 14:26:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 14:26:43.165576 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 14/25] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 14:26:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 14:26:43.171735 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648f55b8-4499-4d90-92ec-ca64618739cc None None] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:26:43.200791 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771e52a3-125a-4a6a-a75b-3a52e09d2203 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:26:43.254933 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:26:43.312742 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648f55b8-4499-4d90-92ec-ca64618739cc None None] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:26:43.351059 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ca6393-9e8a-4143-9841-d33530acc61c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:26:43.352234 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ca6393-9e8a-4143-9841-d33530acc61c None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:26:43.353482 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ca6393-9e8a-4143-9841-d33530acc61c None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:26:43.354605 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ca6393-9e8a-4143-9841-d33530acc61c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:26:43.376804 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ca6393-9e8a-4143-9841-d33530acc61c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:26:43.388685 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application [None req-67ca6393-9e8a-4143-9841-d33530acc61c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 14:26:43.388685 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:26:43.388685 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:26:43.388685 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:26:43.388685 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:26:43.388685 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:26:43.388685 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:26:43.388685 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:26:43.388685 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:26:43.388685 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:26:43.388685 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:26:43.388685 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:26:43.388685 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:26:43.388685 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:26:43.388685 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:26:43.388685 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:26:43.389533 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:26:43.389533 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:26:43.389533 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:26:43.389533 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:26:43.389533 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:26:43.389533 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:26:43.389533 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:26:43.389533 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:26:43.389533 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:26:43.389533 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:26:43.389533 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:26:43.389533 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application with Lock( May 25 14:26:43.389533 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:26:43.389533 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self._enter() May 25 14:26:43.389533 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:26:43.389533 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:26:43.390866 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:26:43.390866 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.creator() May 25 14:26:43.390866 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:26:43.390866 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application created_value = creator( May 25 14:26:43.390866 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:26:43.390866 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:26:43.390866 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:26:43.390866 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:26:43.390866 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:26:43.390866 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:26:43.390866 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 14:26:43.390866 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application May 25 14:26:43.398146 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:26:43.401141 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 12/26] 10.222.0.67 () {56 vars in 1096 bytes} [Wed May 25 14:26:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:26:43.403938 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e274fe-26f6-4353-be74-2e0728f65514 None None] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:26:43.405092 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e274fe-26f6-4353-be74-2e0728f65514 None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:26:43.405571 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e274fe-26f6-4353-be74-2e0728f65514 None None] PATH_INFO: `/` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:26:43.407577 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 13/27] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 14:26:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:26:43.409990 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e274fe-26f6-4353-be74-2e0728f65514 None None] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:26:43.449510 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771e52a3-125a-4a6a-a75b-3a52e09d2203 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:26:43.485628 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153a1928-b221-47f6-9e02-fe1b3bc7c2d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:26:43.486425 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153a1928-b221-47f6-9e02-fe1b3bc7c2d6 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:26:43.486711 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153a1928-b221-47f6-9e02-fe1b3bc7c2d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:26:43.486981 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153a1928-b221-47f6-9e02-fe1b3bc7c2d6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:26:43.499171 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153a1928-b221-47f6-9e02-fe1b3bc7c2d6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:26:43.502010 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153a1928-b221-47f6-9e02-fe1b3bc7c2d6 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:26:43.521965 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application [None req-153a1928-b221-47f6-9e02-fe1b3bc7c2d6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:26:43.521965 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:26:43.521965 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:26:43.521965 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:26:43.521965 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:26:43.521965 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:26:43.521965 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:26:43.521965 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:26:43.521965 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:26:43.521965 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:26:43.521965 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:26:43.521965 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:26:43.521965 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 14:26:43.521965 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 14:26:43.521965 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 14:26:43.523062 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 14:26:43.523062 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:26:43.523062 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:26:43.523062 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:26:43.523062 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:26:43.523062 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:26:43.523062 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:26:43.523062 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:26:43.523062 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application with Lock( May 25 14:26:43.523062 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:26:43.523062 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._enter() May 25 14:26:43.523062 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:26:43.523062 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:26:43.523062 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:26:43.523062 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.creator() May 25 14:26:43.523062 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:26:43.523062 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application created_value = creator( May 25 14:26:43.524205 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 14:26:43.524205 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 14:26:43.524205 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:26:43.524205 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:26:43.525015 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 15/28] 10.222.0.67 () {56 vars in 1108 bytes} [Wed May 25 14:26:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 325 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 14:26:43.530892 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74a63aa-d152-400f-976b-dce605d14e5a None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:26:43.531356 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74a63aa-d152-400f-976b-dce605d14e5a None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:26:43.531945 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74a63aa-d152-400f-976b-dce605d14e5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:26:43.538499 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e274fe-26f6-4353-be74-2e0728f65514 None None] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:26:43.546766 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:26:43.549874 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-c74a63aa-d152-400f-976b-dce605d14e5a None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:26:43.550875 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-c74a63aa-d152-400f-976b-dce605d14e5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:26:43.577814 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affd27ca-8131-493d-8267-9ba9b202c2b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:26:43.579429 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affd27ca-8131-493d-8267-9ba9b202c2b5 None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:26:43.579899 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affd27ca-8131-493d-8267-9ba9b202c2b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:26:43.580354 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affd27ca-8131-493d-8267-9ba9b202c2b5 None admin] PATH_INFO: `/v3/roles` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:26:43.581303 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affd27ca-8131-493d-8267-9ba9b202c2b5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:26:43.581819 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affd27ca-8131-493d-8267-9ba9b202c2b5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:26:43.583456 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affd27ca-8131-493d-8267-9ba9b202c2b5 None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:26:43.597012 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 14/29] 10.222.0.67 () {56 vars in 1099 bytes} [Wed May 25 14:26:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:26:43.598652 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a8693d-7a9f-4d2d-8d38-7d3b58cd4082 None None] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:26:43.599154 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a8693d-7a9f-4d2d-8d38-7d3b58cd4082 None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:26:43.599638 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a8693d-7a9f-4d2d-8d38-7d3b58cd4082 None None] PATH_INFO: `/` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:26:43.601054 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 15/30] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 14:26:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:26:43.602030 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a8693d-7a9f-4d2d-8d38-7d3b58cd4082 None None] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:26:43.622800 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 16/31] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 14:26:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 14:26:43.624017 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74a63aa-d152-400f-976b-dce605d14e5a None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:26:43.683237 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:26:43.715251 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a8693d-7a9f-4d2d-8d38-7d3b58cd4082 None None] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:26:43.728477 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74a63aa-d152-400f-976b-dce605d14e5a None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:26:43.753319 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8719edc-2b52-46b6-9a96-e6a9d63b0d8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:26:43.754328 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8719edc-2b52-46b6-9a96-e6a9d63b0d8f None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:26:43.754849 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8719edc-2b52-46b6-9a96-e6a9d63b0d8f None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:26:43.755349 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8719edc-2b52-46b6-9a96-e6a9d63b0d8f None admin] PATH_INFO: `/v3/domains` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:26:43.756345 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8719edc-2b52-46b6-9a96-e6a9d63b0d8f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:26:43.756880 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8719edc-2b52-46b6-9a96-e6a9d63b0d8f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:26:43.758538 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8719edc-2b52-46b6-9a96-e6a9d63b0d8f None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:26:43.764536 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e587e83-4e58-4894-95ee-007069ff4279 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:26:43.765936 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e587e83-4e58-4894-95ee-007069ff4279 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:26:43.766219 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e587e83-4e58-4894-95ee-007069ff4279 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:26:43.766497 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e587e83-4e58-4894-95ee-007069ff4279 None admin] PATH_INFO: `/v3/users/be354bf3692549b095099e6268f938f3` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:26:43.768133 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e587e83-4e58-4894-95ee-007069ff4279 None admin] RBAC: Authorizing `identity:get_user(user_id=be354bf3692549b095099e6268f938f3)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:26:43.769174 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e587e83-4e58-4894-95ee-007069ff4279 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:26:43.770794 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 17/32] 10.222.0.67 () {56 vars in 1177 bytes} [Wed May 25 14:26:43 2022] GET /identity/v3/users/be354bf3692549b095099e6268f938f3 => generated 247 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:26:43.771997 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf80fd3-d758-458a-9d34-510d4ad5b872 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:26:43.772304 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf80fd3-d758-458a-9d34-510d4ad5b872 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:26:43.772551 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf80fd3-d758-458a-9d34-510d4ad5b872 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:26:43.774859 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 16/33] 10.222.0.67 () {56 vars in 1109 bytes} [Wed May 25 14:26:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:26:43.776245 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8719edc-2b52-46b6-9a96-e6a9d63b0d8f None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:26:43.793871 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-adf80fd3-d758-458a-9d34-510d4ad5b872 None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:26:43.795080 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-adf80fd3-d758-458a-9d34-510d4ad5b872 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:26:43.811298 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:26:43.865731 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 18/34] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 14:26:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 14:26:43.866417 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf80fd3-d758-458a-9d34-510d4ad5b872 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:26:43.911579 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8719edc-2b52-46b6-9a96-e6a9d63b0d8f None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:26:43.922785 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:26:43.957291 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54be4a97-5097-4a57-9598-5a9d0c608d96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:26:43.958068 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54be4a97-5097-4a57-9598-5a9d0c608d96 None admin] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:26:43.958362 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54be4a97-5097-4a57-9598-5a9d0c608d96 None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:26:43.958640 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54be4a97-5097-4a57-9598-5a9d0c608d96 None admin] PATH_INFO: `/v3/roles` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:26:43.959447 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54be4a97-5097-4a57-9598-5a9d0c608d96 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:26:43.960838 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54be4a97-5097-4a57-9598-5a9d0c608d96 None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:26:43.972978 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf80fd3-d758-458a-9d34-510d4ad5b872 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:26:44.012284 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70d8199-caa6-4608-9fcd-714b28f0ffc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:26:44.013084 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70d8199-caa6-4608-9fcd-714b28f0ffc7 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:26:44.013474 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70d8199-caa6-4608-9fcd-714b28f0ffc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:26:44.013757 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70d8199-caa6-4608-9fcd-714b28f0ffc7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:26:44.015090 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70d8199-caa6-4608-9fcd-714b28f0ffc7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:26:44.017260 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70d8199-caa6-4608-9fcd-714b28f0ffc7 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:26:44.019187 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 19/35] 10.222.0.67 () {56 vars in 1108 bytes} [Wed May 25 14:26:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:26:44.020030 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70d8199-caa6-4608-9fcd-714b28f0ffc7 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:26:44.090876 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 17/36] 10.222.0.67 () {60 vars in 1131 bytes} [Wed May 25 14:26:43 2022] POST /identity/v3/roles => generated 219 bytes in 315 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:26:44.091697 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54be4a97-5097-4a57-9598-5a9d0c608d96 None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:26:44.164885 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70d8199-caa6-4608-9fcd-714b28f0ffc7 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:26:44.196201 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:26:44.210923 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54be4a97-5097-4a57-9598-5a9d0c608d96 None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:26:44.213147 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:26:44.243629 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350c2c7c-5f44-45df-abb5-73ce0bf02d31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:26:44.244309 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350c2c7c-5f44-45df-abb5-73ce0bf02d31 None admin] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:26:44.244851 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350c2c7c-5f44-45df-abb5-73ce0bf02d31 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:26:44.245139 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350c2c7c-5f44-45df-abb5-73ce0bf02d31 None admin] PATH_INFO: `/v3/projects` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:26:44.245868 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350c2c7c-5f44-45df-abb5-73ce0bf02d31 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:26:44.247633 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350c2c7c-5f44-45df-abb5-73ce0bf02d31 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:26:44.249897 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a95f84-7c8b-462f-8906-2cad5cdc9a2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:26:44.250666 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a95f84-7c8b-462f-8906-2cad5cdc9a2a None admin] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:26:44.250955 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a95f84-7c8b-462f-8906-2cad5cdc9a2a None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:26:44.251266 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a95f84-7c8b-462f-8906-2cad5cdc9a2a None admin] PATH_INFO: `/v3/roles` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:26:44.252046 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a95f84-7c8b-462f-8906-2cad5cdc9a2a None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:26:44.253622 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a95f84-7c8b-462f-8906-2cad5cdc9a2a None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:26:44.295481 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 18/37] 10.222.0.67 () {60 vars in 1131 bytes} [Wed May 25 14:26:44 2022] POST /identity/v3/roles => generated 225 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:26:44.297885 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a95f84-7c8b-462f-8906-2cad5cdc9a2a None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:26:44.457723 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 20/38] 10.222.0.67 () {60 vars in 1141 bytes} [Wed May 25 14:26:44 2022] POST /identity/v3/projects => generated 301 bytes in 438 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:26:44.459666 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17500ea-d6f0-46b9-9ffe-c0ef6cb62761 None None] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:26:44.459978 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17500ea-d6f0-46b9-9ffe-c0ef6cb62761 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:26:44.460305 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17500ea-d6f0-46b9-9ffe-c0ef6cb62761 None None] PATH_INFO: `/` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:26:44.462244 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 21/39] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 14:26:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:26:44.468393 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d5e65e-661d-43c2-b357-602a604bfeb7 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:26:44.468698 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d5e65e-661d-43c2-b357-602a604bfeb7 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:26:44.468987 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d5e65e-661d-43c2-b357-602a604bfeb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:26:44.491421 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-71d5e65e-661d-43c2-b357-602a604bfeb7 None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:26:44.493995 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-71d5e65e-661d-43c2-b357-602a604bfeb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:26:44.517023 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a95f84-7c8b-462f-8906-2cad5cdc9a2a None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:26:44.599173 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705402bd-4472-43f5-805d-f82ddadfa853 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:26:44.600089 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705402bd-4472-43f5-805d-f82ddadfa853 None admin] REQUEST_METHOD: `PUT` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:26:44.600375 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705402bd-4472-43f5-805d-f82ddadfa853 None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:26:44.600655 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705402bd-4472-43f5-805d-f82ddadfa853 None admin] PATH_INFO: `/v3/domains/default/users/be354bf3692549b095099e6268f938f3/roles/399893e19eac4ab5a8e596f7c07be13c` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:26:44.605717 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705402bd-4472-43f5-805d-f82ddadfa853 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=be354bf3692549b095099e6268f938f3, role_id=399893e19eac4ab5a8e596f7c07be13c)` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:26:44.607297 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705402bd-4472-43f5-805d-f82ddadfa853 None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:26:44.647770 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 19/40] 10.222.0.67 () {58 vars in 1361 bytes} [Wed May 25 14:26:44 2022] PUT /identity/v3/domains/default/users/be354bf3692549b095099e6268f938f3/roles/399893e19eac4ab5a8e596f7c07be13c => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:26:44.651853 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 22/41] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 14:26:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 14:26:44.677087 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705402bd-4472-43f5-805d-f82ddadfa853 None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:26:44.690853 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:26:44.763157 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f402ebf-3466-4c87-90c5-551b9db39aab None None] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:26:44.763726 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f402ebf-3466-4c87-90c5-551b9db39aab None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:26:44.764015 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f402ebf-3466-4c87-90c5-551b9db39aab None None] PATH_INFO: `/` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:26:44.766369 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 23/42] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 14:26:44 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:26:44.772070 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12c7b22-28ea-467b-9a10-35e8ac8e5ee1 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:26:44.772364 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12c7b22-28ea-467b-9a10-35e8ac8e5ee1 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:26:44.772643 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12c7b22-28ea-467b-9a10-35e8ac8e5ee1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:26:44.805763 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-f12c7b22-28ea-467b-9a10-35e8ac8e5ee1 None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:26:44.807084 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-f12c7b22-28ea-467b-9a10-35e8ac8e5ee1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:26:44.812640 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705402bd-4472-43f5-805d-f82ddadfa853 None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:26:44.861599 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa6e631-2dee-4b62-94ba-8dadac6be1ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:26:44.862294 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa6e631-2dee-4b62-94ba-8dadac6be1ab None admin] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:26:44.862581 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa6e631-2dee-4b62-94ba-8dadac6be1ab None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:26:44.862863 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa6e631-2dee-4b62-94ba-8dadac6be1ab None admin] PATH_INFO: `/v3/roles` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:26:44.863677 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa6e631-2dee-4b62-94ba-8dadac6be1ab None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:26:44.865105 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa6e631-2dee-4b62-94ba-8dadac6be1ab None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:26:44.881560 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 20/43] 10.222.0.67 () {60 vars in 1131 bytes} [Wed May 25 14:26:44 2022] POST /identity/v3/roles => generated 223 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:26:44.905543 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 24/44] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 14:26:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 14:26:44.932346 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa6e631-2dee-4b62-94ba-8dadac6be1ab None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:26:45.011732 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:26:45.051983 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa6e631-2dee-4b62-94ba-8dadac6be1ab None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:26:45.088974 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ecac65-d692-45c2-925b-21fec9c9f502 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:26:45.089790 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ecac65-d692-45c2-925b-21fec9c9f502 None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:26:45.090081 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ecac65-d692-45c2-925b-21fec9c9f502 None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:26:45.090364 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ecac65-d692-45c2-925b-21fec9c9f502 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:26:45.091636 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ecac65-d692-45c2-925b-21fec9c9f502 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:26:45.093172 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ecac65-d692-45c2-925b-21fec9c9f502 None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:26:45.095878 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 21/45] 10.222.0.67 () {56 vars in 1108 bytes} [Wed May 25 14:26:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:26:45.101246 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12c7b22-28ea-467b-9a10-35e8ac8e5ee1 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:26:45.138898 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:26:45.217338 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12c7b22-28ea-467b-9a10-35e8ac8e5ee1 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:26:45.252513 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb422d0-1ae7-40ba-b784-8d6f9eacde98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:26:45.253186 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb422d0-1ae7-40ba-b784-8d6f9eacde98 None admin] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:26:45.253476 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb422d0-1ae7-40ba-b784-8d6f9eacde98 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:26:45.253760 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb422d0-1ae7-40ba-b784-8d6f9eacde98 None admin] PATH_INFO: `/v3/projects` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:26:45.254497 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb422d0-1ae7-40ba-b784-8d6f9eacde98 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:26:45.256136 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb422d0-1ae7-40ba-b784-8d6f9eacde98 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:26:45.280934 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 25/46] 10.222.0.67 () {60 vars in 1141 bytes} [Wed May 25 14:26:45 2022] POST /identity/v3/projects => generated 312 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:26:47.016003 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e523c6c9-0541-4e59-9500-62488d13837f None None] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:26:47.016548 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e523c6c9-0541-4e59-9500-62488d13837f None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:26:47.016634 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e523c6c9-0541-4e59-9500-62488d13837f None None] PATH_INFO: `/` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:26:47.018112 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 22/47] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 14:26:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:26:47.023251 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74d32ac-eb87-4947-a893-fde8e1adeb89 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:26:47.023655 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74d32ac-eb87-4947-a893-fde8e1adeb89 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:26:47.023948 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74d32ac-eb87-4947-a893-fde8e1adeb89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:26:47.041987 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-d74d32ac-eb87-4947-a893-fde8e1adeb89 None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:26:47.043221 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-d74d32ac-eb87-4947-a893-fde8e1adeb89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:26:47.110931 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 26/48] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 14:26:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 14:26:47.134376 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e523c6c9-0541-4e59-9500-62488d13837f None None] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:26:47.234957 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e523c6c9-0541-4e59-9500-62488d13837f None None] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:26:47.268344 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd0c0a7-f825-4f1d-a333-0d72a8f0586e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:26:47.269145 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd0c0a7-f825-4f1d-a333-0d72a8f0586e None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:26:47.269434 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd0c0a7-f825-4f1d-a333-0d72a8f0586e None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:26:47.269713 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd0c0a7-f825-4f1d-a333-0d72a8f0586e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:26:47.272374 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:26:47.280528 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd0c0a7-f825-4f1d-a333-0d72a8f0586e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:26:47.288830 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application [None req-abd0c0a7-f825-4f1d-a333-0d72a8f0586e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 14:26:47.288830 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:26:47.288830 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:26:47.288830 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:26:47.288830 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:26:47.288830 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:26:47.288830 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:26:47.288830 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:26:47.288830 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:26:47.288830 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:26:47.288830 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:26:47.288830 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:26:47.288830 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:26:47.288830 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:26:47.288830 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:26:47.288830 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:26:47.289726 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:26:47.289726 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:26:47.289726 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:26:47.289726 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:26:47.289726 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:26:47.289726 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:26:47.289726 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:26:47.289726 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:26:47.289726 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:26:47.289726 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:26:47.289726 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:26:47.289726 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application with Lock( May 25 14:26:47.289726 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:26:47.289726 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self._enter() May 25 14:26:47.289726 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:26:47.289726 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:26:47.290781 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:26:47.290781 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.creator() May 25 14:26:47.290781 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:26:47.290781 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application created_value = creator( May 25 14:26:47.290781 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:26:47.290781 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:26:47.290781 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:26:47.290781 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:26:47.290781 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:26:47.290781 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:26:47.290781 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 14:26:47.290781 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application May 25 14:26:47.290781 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 23/49] 10.222.0.67 () {56 vars in 1096 bytes} [Wed May 25 14:26:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 14:26:47.295733 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74d32ac-eb87-4947-a893-fde8e1adeb89 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:26:47.313684 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:26:47.400900 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74d32ac-eb87-4947-a893-fde8e1adeb89 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:26:47.434359 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc956913-dc3c-46f2-aa80-c6a3a48be1fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:26:47.435064 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc956913-dc3c-46f2-aa80-c6a3a48be1fd None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:26:47.435359 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc956913-dc3c-46f2-aa80-c6a3a48be1fd None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:26:47.435645 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc956913-dc3c-46f2-aa80-c6a3a48be1fd None admin] PATH_INFO: `/v3/roles` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:26:47.436403 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc956913-dc3c-46f2-aa80-c6a3a48be1fd None admin] RBAC: Adding query filter params (name=admin) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:26:47.436718 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc956913-dc3c-46f2-aa80-c6a3a48be1fd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:26:47.438127 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc956913-dc3c-46f2-aa80-c6a3a48be1fd None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:26:47.446218 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 27/50] 10.222.0.67 () {56 vars in 1099 bytes} [Wed May 25 14:26:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:26:47.451861 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd0c0a7-f825-4f1d-a333-0d72a8f0586e None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:26:47.546012 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f59f15b-d8f4-488d-9b4f-3673db0c00ff None None] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:26:47.546313 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f59f15b-d8f4-488d-9b4f-3673db0c00ff None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:26:47.546681 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f59f15b-d8f4-488d-9b4f-3673db0c00ff None None] PATH_INFO: `/` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:26:47.548834 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 28/51] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 14:26:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:26:47.554028 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7dd1bb-2758-4f54-9498-dbe467dada9c None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:26:47.554323 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7dd1bb-2758-4f54-9498-dbe467dada9c None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:26:47.554611 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7dd1bb-2758-4f54-9498-dbe467dada9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:26:47.571826 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-ee7dd1bb-2758-4f54-9498-dbe467dada9c None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:26:47.573122 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-ee7dd1bb-2758-4f54-9498-dbe467dada9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:26:47.578398 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd0c0a7-f825-4f1d-a333-0d72a8f0586e None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:26:47.616076 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8426ada-83fb-4b56-8e72-22140a898c41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:26:47.616981 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8426ada-83fb-4b56-8e72-22140a898c41 None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:26:47.617274 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8426ada-83fb-4b56-8e72-22140a898c41 None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:26:47.617555 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8426ada-83fb-4b56-8e72-22140a898c41 None admin] PATH_INFO: `/v3/users/be354bf3692549b095099e6268f938f3` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:26:47.618953 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8426ada-83fb-4b56-8e72-22140a898c41 None admin] RBAC: Authorizing `identity:get_user(user_id=be354bf3692549b095099e6268f938f3)` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:26:47.620719 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8426ada-83fb-4b56-8e72-22140a898c41 None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:26:47.622673 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 24/52] 10.222.0.67 () {56 vars in 1177 bytes} [Wed May 25 14:26:47 2022] GET /identity/v3/users/be354bf3692549b095099e6268f938f3 => generated 247 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:26:47.628595 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8426ada-83fb-4b56-8e72-22140a898c41 None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:26:47.653432 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 29/53] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 14:26:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 14:26:47.676307 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7dd1bb-2758-4f54-9498-dbe467dada9c None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:26:47.686208 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:26:47.697787 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:26:47.737928 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8426ada-83fb-4b56-8e72-22140a898c41 None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:26:47.781700 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a80b6d-3ea7-44c4-a20a-b03214409e82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:26:47.782511 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a80b6d-3ea7-44c4-a20a-b03214409e82 None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:26:47.783266 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a80b6d-3ea7-44c4-a20a-b03214409e82 None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:26:47.783549 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a80b6d-3ea7-44c4-a20a-b03214409e82 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:26:47.785056 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a80b6d-3ea7-44c4-a20a-b03214409e82 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:26:47.786561 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a80b6d-3ea7-44c4-a20a-b03214409e82 None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:26:47.788188 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 25/54] 10.222.0.67 () {56 vars in 1108 bytes} [Wed May 25 14:26:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:26:47.793946 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a80b6d-3ea7-44c4-a20a-b03214409e82 None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:26:47.794902 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7dd1bb-2758-4f54-9498-dbe467dada9c None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:26:47.832765 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57ea07b-f6d9-41c3-99bb-6c1fe00b6a15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:26:47.833569 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57ea07b-f6d9-41c3-99bb-6c1fe00b6a15 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:26:47.833874 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57ea07b-f6d9-41c3-99bb-6c1fe00b6a15 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:26:47.834142 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57ea07b-f6d9-41c3-99bb-6c1fe00b6a15 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:26:47.835356 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57ea07b-f6d9-41c3-99bb-6c1fe00b6a15 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:26:47.836851 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57ea07b-f6d9-41c3-99bb-6c1fe00b6a15 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:26:47.838480 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 30/55] 10.222.0.67 () {56 vars in 1108 bytes} [Wed May 25 14:26:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:26:47.843955 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57ea07b-f6d9-41c3-99bb-6c1fe00b6a15 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:26:47.896110 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a80b6d-3ea7-44c4-a20a-b03214409e82 None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:26:47.918586 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:26:47.925411 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:26:47.930654 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f15d87e-f7b2-422f-a040-588adf538654 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:26:47.931354 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f15d87e-f7b2-422f-a040-588adf538654 None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:26:47.931642 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f15d87e-f7b2-422f-a040-588adf538654 None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:26:47.931923 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f15d87e-f7b2-422f-a040-588adf538654 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:26:47.932768 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f15d87e-f7b2-422f-a040-588adf538654 None admin] RBAC: Adding query filter params (role.id=399893e19eac4ab5a8e596f7c07be13c, scope.domain.id=default, user.id=be354bf3692549b095099e6268f938f3) {{(pid=80474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:26:47.933091 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f15d87e-f7b2-422f-a040-588adf538654 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:26:47.934536 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f15d87e-f7b2-422f-a040-588adf538654 None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:26:47.941996 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57ea07b-f6d9-41c3-99bb-6c1fe00b6a15 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:26:47.942967 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 26/56] 10.222.0.67 () {56 vars in 1322 bytes} [Wed May 25 14:26:47 2022] GET /identity/v3/role_assignments?user.id=be354bf3692549b095099e6268f938f3&scope.domain.id=default&role.id=399893e19eac4ab5a8e596f7c07be13c => generated 530 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:26:47.979070 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c5074f-eab1-4d97-932f-8baff18f440e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:26:47.979762 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c5074f-eab1-4d97-932f-8baff18f440e None admin] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:26:47.980052 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c5074f-eab1-4d97-932f-8baff18f440e None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:26:47.980335 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c5074f-eab1-4d97-932f-8baff18f440e None admin] PATH_INFO: `/v3/projects` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:26:47.981070 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c5074f-eab1-4d97-932f-8baff18f440e None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:26:47.982578 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c5074f-eab1-4d97-932f-8baff18f440e None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:26:48.012633 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 31/57] 10.222.0.67 () {60 vars in 1140 bytes} [Wed May 25 14:26:47 2022] POST /identity/v3/projects => generated 298 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 14:26:50.230375 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9650840-dfdb-421b-80bf-516bde29ccf4 None None] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:26:50.230864 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9650840-dfdb-421b-80bf-516bde29ccf4 None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:26:50.230864 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9650840-dfdb-421b-80bf-516bde29ccf4 None None] PATH_INFO: `/` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:26:50.232279 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 27/58] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 14:26:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:26:50.237576 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11845583-bfa1-4928-a972-1206d87bac41 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:26:50.237998 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11845583-bfa1-4928-a972-1206d87bac41 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:26:50.238154 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11845583-bfa1-4928-a972-1206d87bac41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:26:50.256361 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-11845583-bfa1-4928-a972-1206d87bac41 None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:26:50.257533 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-11845583-bfa1-4928-a972-1206d87bac41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:26:50.322489 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 32/59] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 14:26:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 14:26:50.347885 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9650840-dfdb-421b-80bf-516bde29ccf4 None None] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:26:50.450037 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9650840-dfdb-421b-80bf-516bde29ccf4 None None] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:26:50.490650 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554650a4-1fa0-4f99-8996-92509ca74bcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:26:50.492202 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554650a4-1fa0-4f99-8996-92509ca74bcd None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:26:50.492489 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554650a4-1fa0-4f99-8996-92509ca74bcd None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:26:50.492766 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554650a4-1fa0-4f99-8996-92509ca74bcd None admin] PATH_INFO: `/v3/domains/default` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:26:50.493939 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554650a4-1fa0-4f99-8996-92509ca74bcd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:26:50.496493 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554650a4-1fa0-4f99-8996-92509ca74bcd None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:26:50.498090 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 28/60] 10.222.0.67 () {56 vars in 1108 bytes} [Wed May 25 14:26:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:26:50.503971 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11845583-bfa1-4928-a972-1206d87bac41 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:26:50.560714 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:26:50.601941 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11845583-bfa1-4928-a972-1206d87bac41 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:26:50.634411 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4c6386-1cde-444b-b194-21efb9b89364 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:26:50.635100 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4c6386-1cde-444b-b194-21efb9b89364 None admin] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:26:50.635387 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4c6386-1cde-444b-b194-21efb9b89364 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:26:50.635665 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4c6386-1cde-444b-b194-21efb9b89364 None admin] PATH_INFO: `/v3/users` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:26:50.636371 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4c6386-1cde-444b-b194-21efb9b89364 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:26:50.637826 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4c6386-1cde-444b-b194-21efb9b89364 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:26:50.662362 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 33/61] 10.222.0.67 () {60 vars in 1132 bytes} [Wed May 25 14:26:50 2022] POST /identity/v3/users => generated 275 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:26:54.080756 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c925fdc8-cb4c-4526-9b19-ce1e7a1b708c None None] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:26:54.081607 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c925fdc8-cb4c-4526-9b19-ce1e7a1b708c None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:26:54.082031 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c925fdc8-cb4c-4526-9b19-ce1e7a1b708c None None] PATH_INFO: `/` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:26:54.083610 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 29/62] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 14:26:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:26:54.088934 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c23a00-acc9-4b4e-b07d-7cf3305bd334 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:26:54.089359 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c23a00-acc9-4b4e-b07d-7cf3305bd334 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:26:54.089502 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c23a00-acc9-4b4e-b07d-7cf3305bd334 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:26:54.113027 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-60c23a00-acc9-4b4e-b07d-7cf3305bd334 None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:26:54.114131 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-60c23a00-acc9-4b4e-b07d-7cf3305bd334 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:26:54.196856 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87964db-d570-4ecc-8391-15eca98791fc None None] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:26:54.197487 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87964db-d570-4ecc-8391-15eca98791fc None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:26:54.197964 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87964db-d570-4ecc-8391-15eca98791fc None None] PATH_INFO: `/` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:26:54.199847 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 30/63] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 14:26:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:26:54.206249 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1981b2-3c1f-4831-b203-ca871ece6425 None None] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:26:54.206636 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1981b2-3c1f-4831-b203-ca871ece6425 None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:26:54.206882 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1981b2-3c1f-4831-b203-ca871ece6425 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:26:54.217598 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 34/64] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 14:26:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 14:26:54.244049 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c23a00-acc9-4b4e-b07d-7cf3305bd334 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:26:54.248069 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.auth.core [None req-7d1981b2-3c1f-4831-b203-ca871ece6425 None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:26:54.249673 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-7d1981b2-3c1f-4831-b203-ca871ece6425 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:26:54.302645 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:26:54.331396 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:26:54.341388 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 31/65] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 14:26:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 14:26:54.343418 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e401b7-7bf3-4e91-9b95-858c682e1f52 None None] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:26:54.343945 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e401b7-7bf3-4e91-9b95-858c682e1f52 None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:26:54.344225 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e401b7-7bf3-4e91-9b95-858c682e1f52 None None] PATH_INFO: `/` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:26:54.345802 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 32/66] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 14:26:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:26:54.352722 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a009572e-2620-4942-b367-6245fdca65f8 None None] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:26:54.353239 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a009572e-2620-4942-b367-6245fdca65f8 None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:26:54.353663 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a009572e-2620-4942-b367-6245fdca65f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:26:54.380421 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c23a00-acc9-4b4e-b07d-7cf3305bd334 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:26:54.382824 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.auth.core [None req-a009572e-2620-4942-b367-6245fdca65f8 None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:26:54.384265 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-a009572e-2620-4942-b367-6245fdca65f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:26:54.417640 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8dd765-8e3a-4861-ae71-78748b934895 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:26:54.418712 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8dd765-8e3a-4861-ae71-78748b934895 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:26:54.419021 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8dd765-8e3a-4861-ae71-78748b934895 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:26:54.419450 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8dd765-8e3a-4861-ae71-78748b934895 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:26:54.431538 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8dd765-8e3a-4861-ae71-78748b934895 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:26:54.440147 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application [None req-2e8dd765-8e3a-4861-ae71-78748b934895 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 14:26:54.440147 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:26:54.440147 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:26:54.440147 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:26:54.440147 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:26:54.440147 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:26:54.440147 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:26:54.440147 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:26:54.440147 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:26:54.440147 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:26:54.440147 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:26:54.440147 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:26:54.440147 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:26:54.440147 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:26:54.440147 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:26:54.440147 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:26:54.441007 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:26:54.441007 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:26:54.441007 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:26:54.441007 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:26:54.441007 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:26:54.441007 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:26:54.441007 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:26:54.441007 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:26:54.441007 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:26:54.441007 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:26:54.441007 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:26:54.441007 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application with Lock( May 25 14:26:54.441007 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:26:54.441007 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._enter() May 25 14:26:54.441007 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:26:54.441007 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:26:54.441786 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:26:54.441786 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.creator() May 25 14:26:54.441786 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:26:54.441786 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application created_value = creator( May 25 14:26:54.441786 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:26:54.441786 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:26:54.441786 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:26:54.441786 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:26:54.441786 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:26:54.441786 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:26:54.441786 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 14:26:54.441786 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:26:54.441786 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 35/67] 10.222.0.67 () {56 vars in 1096 bytes} [Wed May 25 14:26:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 14:26:54.442546 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8dd765-8e3a-4861-ae71-78748b934895 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:26:54.467821 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 33/68] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 14:26:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 14:26:54.475246 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a009572e-2620-4942-b367-6245fdca65f8 None None] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:26:54.575654 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8dd765-8e3a-4861-ae71-78748b934895 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:26:54.579052 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:26:54.606562 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a009572e-2620-4942-b367-6245fdca65f8 None None] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:26:54.612601 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8b0579-bf04-4bf7-ab59-1a1e109fc743 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:26:54.613404 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8b0579-bf04-4bf7-ab59-1a1e109fc743 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:26:54.613696 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8b0579-bf04-4bf7-ab59-1a1e109fc743 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:26:54.613972 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8b0579-bf04-4bf7-ab59-1a1e109fc743 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:26:54.625576 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8b0579-bf04-4bf7-ab59-1a1e109fc743 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:26:54.633224 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:26:54.633588 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application [None req-da8b0579-bf04-4bf7-ab59-1a1e109fc743 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 25 14:26:54.633588 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:26:54.633588 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:26:54.633588 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:26:54.633588 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:26:54.633588 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:26:54.633588 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:26:54.633588 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:26:54.633588 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:26:54.633588 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:26:54.633588 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:26:54.633588 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:26:54.633588 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:26:54.633588 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:26:54.633588 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:26:54.633588 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:26:54.634407 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:26:54.634407 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:26:54.634407 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:26:54.634407 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:26:54.634407 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:26:54.634407 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:26:54.634407 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:26:54.634407 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:26:54.634407 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:26:54.634407 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:26:54.634407 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:26:54.634407 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application with Lock( May 25 14:26:54.634407 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:26:54.634407 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._enter() May 25 14:26:54.634407 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:26:54.634407 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:26:54.635236 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:26:54.635236 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.creator() May 25 14:26:54.635236 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:26:54.635236 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application created_value = creator( May 25 14:26:54.635236 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:26:54.635236 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:26:54.635236 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:26:54.635236 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:26:54.635236 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:26:54.635236 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:26:54.635236 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 25 14:26:54.635236 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:26:54.635236 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 36/69] 10.222.0.67 () {56 vars in 1099 bytes} [Wed May 25 14:26:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:26:54.635863 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8b0579-bf04-4bf7-ab59-1a1e109fc743 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:26:54.648619 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21901359-f9d6-4544-9855-b33791df13ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:26:54.649302 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21901359-f9d6-4544-9855-b33791df13ea None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:26:54.649595 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21901359-f9d6-4544-9855-b33791df13ea None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:26:54.649882 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21901359-f9d6-4544-9855-b33791df13ea None admin] PATH_INFO: `/v3/roles` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:26:54.650645 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21901359-f9d6-4544-9855-b33791df13ea None admin] RBAC: Adding query filter params (name=admin) {{(pid=80474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:26:54.651408 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21901359-f9d6-4544-9855-b33791df13ea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:26:54.653182 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21901359-f9d6-4544-9855-b33791df13ea None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:26:54.667126 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 34/70] 10.222.0.67 () {56 vars in 1099 bytes} [Wed May 25 14:26:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:26:54.667126 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064e1124-86b8-4110-b204-42fba2adb744 None None] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:26:54.667126 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064e1124-86b8-4110-b204-42fba2adb744 None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:26:54.667126 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064e1124-86b8-4110-b204-42fba2adb744 None None] PATH_INFO: `/` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:26:54.667126 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 35/71] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 14:26:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:26:54.668096 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064e1124-86b8-4110-b204-42fba2adb744 None None] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:26:54.746869 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8b0579-bf04-4bf7-ab59-1a1e109fc743 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:26:54.769794 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064e1124-86b8-4110-b204-42fba2adb744 None None] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:26:54.780398 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1793c8ba-0dca-44ea-9d97-64f60253fa3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:26:54.781503 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1793c8ba-0dca-44ea-9d97-64f60253fa3f None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:26:54.781795 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1793c8ba-0dca-44ea-9d97-64f60253fa3f None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:26:54.782077 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1793c8ba-0dca-44ea-9d97-64f60253fa3f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:26:54.792122 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1793c8ba-0dca-44ea-9d97-64f60253fa3f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:26:54.800201 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application [None req-1793c8ba-0dca-44ea-9d97-64f60253fa3f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 14:26:54.800201 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:26:54.800201 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:26:54.800201 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:26:54.800201 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:26:54.800201 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:26:54.800201 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:26:54.800201 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:26:54.800201 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:26:54.800201 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:26:54.800201 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:26:54.800201 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:26:54.800201 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:26:54.800201 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:26:54.800201 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:26:54.800201 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:26:54.801105 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:26:54.801105 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:26:54.801105 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:26:54.801105 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:26:54.801105 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:26:54.801105 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:26:54.801105 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:26:54.801105 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:26:54.801105 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:26:54.801105 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:26:54.801105 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:26:54.801105 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application with Lock( May 25 14:26:54.801105 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:26:54.801105 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._enter() May 25 14:26:54.801105 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:26:54.801105 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:26:54.801942 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:26:54.801942 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.creator() May 25 14:26:54.801942 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:26:54.801942 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application created_value = creator( May 25 14:26:54.801942 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:26:54.801942 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:26:54.801942 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:26:54.801942 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:26:54.801942 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:26:54.801942 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:26:54.801942 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 14:26:54.801942 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:26:54.801942 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 37/72] 10.222.0.67 () {56 vars in 1114 bytes} [Wed May 25 14:26:54 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:26:54.802572 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1793c8ba-0dca-44ea-9d97-64f60253fa3f None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:26:54.804418 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed69571-99d5-46de-b110-6c3edec3ba41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:26:54.805100 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed69571-99d5-46de-b110-6c3edec3ba41 None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:26:54.805393 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed69571-99d5-46de-b110-6c3edec3ba41 None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:26:54.805678 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed69571-99d5-46de-b110-6c3edec3ba41 None admin] PATH_INFO: `/v3/roles` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:26:54.806449 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed69571-99d5-46de-b110-6c3edec3ba41 None admin] RBAC: Adding query filter params (name=member) {{(pid=80474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:26:54.806764 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed69571-99d5-46de-b110-6c3edec3ba41 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:26:54.808193 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed69571-99d5-46de-b110-6c3edec3ba41 None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:26:54.819806 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 36/73] 10.222.0.67 () {56 vars in 1101 bytes} [Wed May 25 14:26:54 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:26:54.822230 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dbf3b4-2ffa-4571-9f24-4369b7e963d6 None None] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:26:54.822605 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dbf3b4-2ffa-4571-9f24-4369b7e963d6 None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:26:54.822898 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dbf3b4-2ffa-4571-9f24-4369b7e963d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:26:54.831426 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:26:54.845295 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.auth.core [None req-f2dbf3b4-2ffa-4571-9f24-4369b7e963d6 None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:26:54.846487 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-f2dbf3b4-2ffa-4571-9f24-4369b7e963d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:26:54.891692 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:26:54.909172 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1793c8ba-0dca-44ea-9d97-64f60253fa3f None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:26:54.915351 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 37/74] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 14:26:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 14:26:54.916653 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bb0027-5672-4b7e-ad13-f6f895df3b81 None None] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:26:54.916952 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bb0027-5672-4b7e-ad13-f6f895df3b81 None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:26:54.917234 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bb0027-5672-4b7e-ad13-f6f895df3b81 None None] PATH_INFO: `/` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:26:54.918515 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 38/75] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 14:26:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:26:54.919239 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bb0027-5672-4b7e-ad13-f6f895df3b81 None None] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:26:54.957123 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b454fa4b-5e09-4061-8fce-47b05e48b538 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:26:54.957994 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b454fa4b-5e09-4061-8fce-47b05e48b538 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:26:54.958280 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b454fa4b-5e09-4061-8fce-47b05e48b538 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:26:54.958559 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b454fa4b-5e09-4061-8fce-47b05e48b538 None admin] PATH_INFO: `/v3/users/be354bf3692549b095099e6268f938f3` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:26:54.959779 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b454fa4b-5e09-4061-8fce-47b05e48b538 None admin] RBAC: Authorizing `identity:get_user(user_id=be354bf3692549b095099e6268f938f3)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:26:54.961245 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b454fa4b-5e09-4061-8fce-47b05e48b538 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:26:54.962861 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 38/76] 10.222.0.67 () {56 vars in 1177 bytes} [Wed May 25 14:26:54 2022] GET /identity/v3/users/be354bf3692549b095099e6268f938f3 => generated 247 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:26:54.963653 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b454fa4b-5e09-4061-8fce-47b05e48b538 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:26:55.023221 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bb0027-5672-4b7e-ad13-f6f895df3b81 None None] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:26:55.053717 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:26:55.057833 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f30901-18ec-493e-bff0-4a49335cad05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:26:55.058508 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f30901-18ec-493e-bff0-4a49335cad05 None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:26:55.058796 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f30901-18ec-493e-bff0-4a49335cad05 None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:26:55.059114 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f30901-18ec-493e-bff0-4a49335cad05 None admin] PATH_INFO: `/v3/roles` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:26:55.059877 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f30901-18ec-493e-bff0-4a49335cad05 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:26:55.060192 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f30901-18ec-493e-bff0-4a49335cad05 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:26:55.061570 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f30901-18ec-493e-bff0-4a49335cad05 None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:26:55.063328 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b454fa4b-5e09-4061-8fce-47b05e48b538 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:26:55.070771 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 39/77] 10.222.0.67 () {56 vars in 1111 bytes} [Wed May 25 14:26:54 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:26:55.071816 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048207c6-eaa6-4ccd-8af9-84fe73a5dc22 None None] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:26:55.072111 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048207c6-eaa6-4ccd-8af9-84fe73a5dc22 None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:26:55.072398 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048207c6-eaa6-4ccd-8af9-84fe73a5dc22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:26:55.088046 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.auth.core [None req-048207c6-eaa6-4ccd-8af9-84fe73a5dc22 None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:26:55.089233 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-048207c6-eaa6-4ccd-8af9-84fe73a5dc22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:26:55.100436 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb7e810-5445-4d42-910f-46cb7eb45290 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:26:55.101313 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb7e810-5445-4d42-910f-46cb7eb45290 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:26:55.101604 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb7e810-5445-4d42-910f-46cb7eb45290 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:26:55.101888 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb7e810-5445-4d42-910f-46cb7eb45290 None admin] PATH_INFO: `/v3/users/57a4a797d2d54ecd9eeb8857c043b617` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:26:55.115442 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb7e810-5445-4d42-910f-46cb7eb45290 None admin] RBAC: Authorizing `identity:get_user(user_id=57a4a797d2d54ecd9eeb8857c043b617)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:26:55.116906 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb7e810-5445-4d42-910f-46cb7eb45290 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:26:55.118551 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 39/78] 10.222.0.67 () {56 vars in 1177 bytes} [Wed May 25 14:26:54 2022] GET /identity/v3/users/57a4a797d2d54ecd9eeb8857c043b617 => generated 275 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:26:55.122846 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb7e810-5445-4d42-910f-46cb7eb45290 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:26:55.124104 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:26:55.157621 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 40/79] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 14:26:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 14:26:55.158374 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048207c6-eaa6-4ccd-8af9-84fe73a5dc22 None None] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:26:55.221090 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb7e810-5445-4d42-910f-46cb7eb45290 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:26:55.255406 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c970f37-51a8-42d2-b3a2-77551d996460 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:26:55.256204 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c970f37-51a8-42d2-b3a2-77551d996460 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:26:55.256493 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c970f37-51a8-42d2-b3a2-77551d996460 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:26:55.256772 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c970f37-51a8-42d2-b3a2-77551d996460 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:26:55.266946 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c970f37-51a8-42d2-b3a2-77551d996460 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:26:55.267608 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048207c6-eaa6-4ccd-8af9-84fe73a5dc22 None None] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:26:55.274828 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application [None req-2c970f37-51a8-42d2-b3a2-77551d996460 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 25 14:26:55.274828 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:26:55.274828 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:26:55.274828 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:26:55.274828 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:26:55.274828 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:26:55.274828 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:26:55.274828 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:26:55.274828 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:26:55.274828 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:26:55.274828 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:26:55.274828 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:26:55.274828 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:26:55.274828 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:26:55.274828 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:26:55.274828 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:26:55.275714 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:26:55.275714 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:26:55.275714 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:26:55.275714 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:26:55.275714 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:26:55.275714 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:26:55.275714 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:26:55.275714 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:26:55.275714 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:26:55.275714 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:26:55.275714 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:26:55.275714 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application with Lock( May 25 14:26:55.275714 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:26:55.275714 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._enter() May 25 14:26:55.275714 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:26:55.275714 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:26:55.276517 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:26:55.276517 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.creator() May 25 14:26:55.276517 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:26:55.276517 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application created_value = creator( May 25 14:26:55.276517 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:26:55.276517 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:26:55.276517 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:26:55.276517 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:26:55.276517 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:26:55.276517 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:26:55.276517 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 25 14:26:55.276517 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:26:55.276517 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 40/80] 10.222.0.67 () {56 vars in 1099 bytes} [Wed May 25 14:26:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:26:55.277149 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c970f37-51a8-42d2-b3a2-77551d996460 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:26:55.291054 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:26:55.309731 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d167a0a-b0e4-4ca7-b65d-5cd1fc30aeb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:26:55.310390 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d167a0a-b0e4-4ca7-b65d-5cd1fc30aeb2 None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:26:55.310676 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d167a0a-b0e4-4ca7-b65d-5cd1fc30aeb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:26:55.310953 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d167a0a-b0e4-4ca7-b65d-5cd1fc30aeb2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:26:55.349629 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:26:55.379545 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d167a0a-b0e4-4ca7-b65d-5cd1fc30aeb2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:26:55.379732 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c970f37-51a8-42d2-b3a2-77551d996460 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:26:55.381019 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d167a0a-b0e4-4ca7-b65d-5cd1fc30aeb2 None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:26:55.413145 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0ddb1d-00b4-4e0d-b144-dcda8c8c3ef2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:26:55.413956 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0ddb1d-00b4-4e0d-b144-dcda8c8c3ef2 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:26:55.414244 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0ddb1d-00b4-4e0d-b144-dcda8c8c3ef2 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:26:55.414522 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0ddb1d-00b4-4e0d-b144-dcda8c8c3ef2 None admin] PATH_INFO: `/v3/users/57a4a797d2d54ecd9eeb8857c043b617` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:26:55.415750 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0ddb1d-00b4-4e0d-b144-dcda8c8c3ef2 None admin] RBAC: Authorizing `identity:get_user(user_id=57a4a797d2d54ecd9eeb8857c043b617)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:26:55.417219 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0ddb1d-00b4-4e0d-b144-dcda8c8c3ef2 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:26:55.418846 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 41/81] 10.222.0.67 () {56 vars in 1177 bytes} [Wed May 25 14:26:55 2022] GET /identity/v3/users/57a4a797d2d54ecd9eeb8857c043b617 => generated 275 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:26:55.419645 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0ddb1d-00b4-4e0d-b144-dcda8c8c3ef2 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:26:55.481529 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 41/82] 10.222.0.67 () {58 vars in 1282 bytes} [Wed May 25 14:26:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 14:26:55.482357 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d167a0a-b0e4-4ca7-b65d-5cd1fc30aeb2 None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:26:55.504838 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:26:55.526174 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0ddb1d-00b4-4e0d-b144-dcda8c8c3ef2 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:26:55.550240 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:26:55.560490 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ced0e7-8944-437e-a868-e3a97c64d3fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:26:55.561141 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ced0e7-8944-437e-a868-e3a97c64d3fe None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:26:55.561430 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ced0e7-8944-437e-a868-e3a97c64d3fe None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:26:55.561708 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ced0e7-8944-437e-a868-e3a97c64d3fe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:26:55.582007 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d167a0a-b0e4-4ca7-b65d-5cd1fc30aeb2 None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:26:55.616232 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a791847-f707-4713-b792-21dc6a3f6a5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:26:55.617031 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a791847-f707-4713-b792-21dc6a3f6a5d None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:26:55.617313 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a791847-f707-4713-b792-21dc6a3f6a5d None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:26:55.617589 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a791847-f707-4713-b792-21dc6a3f6a5d None admin] PATH_INFO: `/v3/domains/default` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:26:55.618757 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a791847-f707-4713-b792-21dc6a3f6a5d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:26:55.620502 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a791847-f707-4713-b792-21dc6a3f6a5d None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:26:55.622107 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 42/83] 10.222.0.67 () {56 vars in 1108 bytes} [Wed May 25 14:26:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:26:55.627109 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a791847-f707-4713-b792-21dc6a3f6a5d None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:26:55.630815 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ced0e7-8944-437e-a868-e3a97c64d3fe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:26:55.632752 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ced0e7-8944-437e-a868-e3a97c64d3fe None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:26:55.708897 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:26:55.722407 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a791847-f707-4713-b792-21dc6a3f6a5d None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:26:55.730714 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 42/84] 10.222.0.67 () {58 vars in 1282 bytes} [Wed May 25 14:26:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 14:26:55.731558 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ced0e7-8944-437e-a868-e3a97c64d3fe None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:26:55.756725 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8884b0c6-ec6a-49d5-a0b8-78a96d728f90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:26:55.757395 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8884b0c6-ec6a-49d5-a0b8-78a96d728f90 None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:26:55.757692 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8884b0c6-ec6a-49d5-a0b8-78a96d728f90 None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:26:55.757959 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8884b0c6-ec6a-49d5-a0b8-78a96d728f90 None admin] PATH_INFO: `/v3/roles` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:26:55.758702 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8884b0c6-ec6a-49d5-a0b8-78a96d728f90 None admin] RBAC: Adding query filter params (name=member) {{(pid=80474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:26:55.759040 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8884b0c6-ec6a-49d5-a0b8-78a96d728f90 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:26:55.760420 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8884b0c6-ec6a-49d5-a0b8-78a96d728f90 None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:26:55.766070 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:26:55.771139 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 43/85] 10.222.0.67 () {56 vars in 1101 bytes} [Wed May 25 14:26:55 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:26:55.772168 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8884b0c6-ec6a-49d5-a0b8-78a96d728f90 None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:26:55.833355 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ced0e7-8944-437e-a868-e3a97c64d3fe None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:26:55.868004 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a5f7b9-a1af-43b8-962c-c8f3919d1cc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:26:55.868654 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a5f7b9-a1af-43b8-962c-c8f3919d1cc3 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:26:55.868939 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a5f7b9-a1af-43b8-962c-c8f3919d1cc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:26:55.869218 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a5f7b9-a1af-43b8-962c-c8f3919d1cc3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:26:55.870330 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8884b0c6-ec6a-49d5-a0b8-78a96d728f90 None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:26:55.904328 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d78923-9a92-47b9-bfc5-7ef27e676cca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:26:55.905195 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d78923-9a92-47b9-bfc5-7ef27e676cca None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:26:55.905484 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d78923-9a92-47b9-bfc5-7ef27e676cca None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:26:55.906380 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d78923-9a92-47b9-bfc5-7ef27e676cca None admin] PATH_INFO: `/v3/projects/652aa39dec91415abc8e6c301800eb00` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:26:55.907651 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d78923-9a92-47b9-bfc5-7ef27e676cca None admin] RBAC: Authorizing `identity:get_project(project_id=652aa39dec91415abc8e6c301800eb00)` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:26:55.909120 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d78923-9a92-47b9-bfc5-7ef27e676cca None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:26:55.910820 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 44/86] 10.222.0.67 () {56 vars in 1186 bytes} [Wed May 25 14:26:55 2022] GET /identity/v3/projects/652aa39dec91415abc8e6c301800eb00 => generated 298 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:26:55.911623 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d78923-9a92-47b9-bfc5-7ef27e676cca None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:26:55.916221 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:26:55.939643 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a5f7b9-a1af-43b8-962c-c8f3919d1cc3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:26:55.941109 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a5f7b9-a1af-43b8-962c-c8f3919d1cc3 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:26:55.976092 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:26:56.009121 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d78923-9a92-47b9-bfc5-7ef27e676cca None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:26:56.039149 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 43/87] 10.222.0.67 () {58 vars in 1282 bytes} [Wed May 25 14:26:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 14:26:56.039990 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a5f7b9-a1af-43b8-962c-c8f3919d1cc3 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:26:56.046172 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebd5aef-9269-4f73-aab9-5e65a5f38e3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:26:56.046860 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebd5aef-9269-4f73-aab9-5e65a5f38e3e None admin] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:26:56.047182 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebd5aef-9269-4f73-aab9-5e65a5f38e3e None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:26:56.047465 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebd5aef-9269-4f73-aab9-5e65a5f38e3e None admin] PATH_INFO: `/v3/users` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:26:56.048197 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebd5aef-9269-4f73-aab9-5e65a5f38e3e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:26:56.049659 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebd5aef-9269-4f73-aab9-5e65a5f38e3e None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:26:56.076862 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 45/88] 10.222.0.67 () {60 vars in 1132 bytes} [Wed May 25 14:26:55 2022] POST /identity/v3/users => generated 289 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:26:56.078584 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebd5aef-9269-4f73-aab9-5e65a5f38e3e None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:26:56.125702 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:26:56.151816 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a5f7b9-a1af-43b8-962c-c8f3919d1cc3 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:26:56.192712 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ddc676-2373-4a5d-96c7-6d0a1518b3b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:26:56.193861 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ddc676-2373-4a5d-96c7-6d0a1518b3b8 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:26:56.194153 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ddc676-2373-4a5d-96c7-6d0a1518b3b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:26:56.194441 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ddc676-2373-4a5d-96c7-6d0a1518b3b8 None admin] PATH_INFO: `/v3/projects/652aa39dec91415abc8e6c301800eb00` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:26:56.195773 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ddc676-2373-4a5d-96c7-6d0a1518b3b8 None admin] RBAC: Authorizing `identity:get_project(project_id=652aa39dec91415abc8e6c301800eb00)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:26:56.197278 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ddc676-2373-4a5d-96c7-6d0a1518b3b8 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:26:56.199227 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 44/89] 10.222.0.67 () {56 vars in 1186 bytes} [Wed May 25 14:26:56 2022] GET /identity/v3/projects/652aa39dec91415abc8e6c301800eb00 => generated 298 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:26:56.199863 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ddc676-2373-4a5d-96c7-6d0a1518b3b8 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:26:56.205615 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebd5aef-9269-4f73-aab9-5e65a5f38e3e None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:26:56.233441 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:26:56.248452 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdbb7c7-69c6-40ff-b5bd-ff0ca0763e3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:26:56.249354 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdbb7c7-69c6-40ff-b5bd-ff0ca0763e3f None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:26:56.250340 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdbb7c7-69c6-40ff-b5bd-ff0ca0763e3f None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:26:56.250631 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdbb7c7-69c6-40ff-b5bd-ff0ca0763e3f None admin] PATH_INFO: `/v3/users/57a4a797d2d54ecd9eeb8857c043b617` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:26:56.251996 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdbb7c7-69c6-40ff-b5bd-ff0ca0763e3f None admin] RBAC: Authorizing `identity:get_user(user_id=57a4a797d2d54ecd9eeb8857c043b617)` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:26:56.253491 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdbb7c7-69c6-40ff-b5bd-ff0ca0763e3f None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:26:56.255188 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 46/90] 10.222.0.67 () {56 vars in 1177 bytes} [Wed May 25 14:26:56 2022] GET /identity/v3/users/57a4a797d2d54ecd9eeb8857c043b617 => generated 275 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:26:56.256126 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdbb7c7-69c6-40ff-b5bd-ff0ca0763e3f None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:26:56.329789 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ddc676-2373-4a5d-96c7-6d0a1518b3b8 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:26:56.385399 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d7b6de-f442-4000-9b86-12d97ffe60d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:26:56.386459 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d7b6de-f442-4000-9b86-12d97ffe60d3 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:26:56.386919 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d7b6de-f442-4000-9b86-12d97ffe60d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:26:56.387536 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d7b6de-f442-4000-9b86-12d97ffe60d3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:26:56.388549 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d7b6de-f442-4000-9b86-12d97ffe60d3 None admin] RBAC: Adding query filter params (role.id=399893e19eac4ab5a8e596f7c07be13c, scope.project.id=652aa39dec91415abc8e6c301800eb00, user.id=be354bf3692549b095099e6268f938f3) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:26:56.389031 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d7b6de-f442-4000-9b86-12d97ffe60d3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:26:56.391556 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d7b6de-f442-4000-9b86-12d97ffe60d3 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:26:56.392830 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdbb7c7-69c6-40ff-b5bd-ff0ca0763e3f None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:26:56.398805 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 45/91] 10.222.0.67 () {56 vars in 1374 bytes} [Wed May 25 14:26:56 2022] GET /identity/v3/role_assignments?user.id=be354bf3692549b095099e6268f938f3&scope.project.id=652aa39dec91415abc8e6c301800eb00&role.id=399893e19eac4ab5a8e596f7c07be13c => generated 259 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:26:56.400022 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d7b6de-f442-4000-9b86-12d97ffe60d3 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:26:56.431457 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:26:56.441117 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633adc29-1567-40bb-a9aa-2c8338103966 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:26:56.442217 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633adc29-1567-40bb-a9aa-2c8338103966 None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:26:56.442512 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633adc29-1567-40bb-a9aa-2c8338103966 None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:26:56.443190 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633adc29-1567-40bb-a9aa-2c8338103966 None admin] PATH_INFO: `/v3/projects/652aa39dec91415abc8e6c301800eb00` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:26:56.444788 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633adc29-1567-40bb-a9aa-2c8338103966 None admin] RBAC: Authorizing `identity:get_project(project_id=652aa39dec91415abc8e6c301800eb00)` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:26:56.446263 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633adc29-1567-40bb-a9aa-2c8338103966 None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:26:56.449171 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 47/92] 10.222.0.67 () {56 vars in 1186 bytes} [Wed May 25 14:26:56 2022] GET /identity/v3/projects/652aa39dec91415abc8e6c301800eb00 => generated 298 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:26:56.450001 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633adc29-1567-40bb-a9aa-2c8338103966 None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:26:56.540193 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d7b6de-f442-4000-9b86-12d97ffe60d3 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:26:56.548194 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:26:56.581325 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bf9a3d-f35b-48af-b083-13960ca45114 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:26:56.582503 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bf9a3d-f35b-48af-b083-13960ca45114 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:26:56.583095 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bf9a3d-f35b-48af-b083-13960ca45114 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:26:56.583620 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bf9a3d-f35b-48af-b083-13960ca45114 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:26:56.584669 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96bf9a3d-f35b-48af-b083-13960ca45114 None admin] RBAC: Adding query filter params (role.id=48808901834b4d5eab2c7e6b5b03791e, scope.project.id=652aa39dec91415abc8e6c301800eb00, user.id=57a4a797d2d54ecd9eeb8857c043b617) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:26:56.585292 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96bf9a3d-f35b-48af-b083-13960ca45114 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:26:56.587058 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96bf9a3d-f35b-48af-b083-13960ca45114 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:26:56.599132 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 46/93] 10.222.0.67 () {56 vars in 1374 bytes} [Wed May 25 14:26:56 2022] GET /identity/v3/role_assignments?user.id=57a4a797d2d54ecd9eeb8857c043b617&scope.project.id=652aa39dec91415abc8e6c301800eb00&role.id=48808901834b4d5eab2c7e6b5b03791e => generated 259 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:26:56.600560 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bf9a3d-f35b-48af-b083-13960ca45114 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:26:56.622454 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633adc29-1567-40bb-a9aa-2c8338103966 None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:26:56.682676 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3622f6d-50fa-4305-bf6a-5c07df5026e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:26:56.688758 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3622f6d-50fa-4305-bf6a-5c07df5026e5 None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:26:56.689092 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3622f6d-50fa-4305-bf6a-5c07df5026e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:26:56.689326 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3622f6d-50fa-4305-bf6a-5c07df5026e5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:26:56.784405 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3622f6d-50fa-4305-bf6a-5c07df5026e5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:26:56.786229 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3622f6d-50fa-4305-bf6a-5c07df5026e5 None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:26:56.819870 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:26:56.878127 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bf9a3d-f35b-48af-b083-13960ca45114 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:26:56.885363 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:26:56.939078 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 48/94] 10.222.0.67 () {58 vars in 1282 bytes} [Wed May 25 14:26:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 489 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 14:26:56.948206 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3622f6d-50fa-4305-bf6a-5c07df5026e5 None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:26:57.000850 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fefedc9-7078-4f98-9f58-8960447f2afa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:26:57.001869 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fefedc9-7078-4f98-9f58-8960447f2afa None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:26:57.002337 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fefedc9-7078-4f98-9f58-8960447f2afa None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:26:57.002796 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fefedc9-7078-4f98-9f58-8960447f2afa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:26:57.003871 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fefedc9-7078-4f98-9f58-8960447f2afa None admin] RBAC: Adding query filter params (role.id=3e87d9311f1d411395a3fcd41ac81431, scope.project.id=652aa39dec91415abc8e6c301800eb00, user.id=57a4a797d2d54ecd9eeb8857c043b617) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:26:57.004356 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fefedc9-7078-4f98-9f58-8960447f2afa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:26:57.006034 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fefedc9-7078-4f98-9f58-8960447f2afa None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:26:57.033049 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 47/95] 10.222.0.67 () {56 vars in 1374 bytes} [Wed May 25 14:26:56 2022] GET /identity/v3/role_assignments?user.id=57a4a797d2d54ecd9eeb8857c043b617&scope.project.id=652aa39dec91415abc8e6c301800eb00&role.id=3e87d9311f1d411395a3fcd41ac81431 => generated 259 bytes in 433 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:26:57.085720 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3622f6d-50fa-4305-bf6a-5c07df5026e5 None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:26:57.156739 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55767ee7-e0d6-4fdf-96c2-36458660d523 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:26:57.157636 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55767ee7-e0d6-4fdf-96c2-36458660d523 None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:26:57.157921 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55767ee7-e0d6-4fdf-96c2-36458660d523 None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:26:57.158196 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55767ee7-e0d6-4fdf-96c2-36458660d523 None admin] PATH_INFO: `/v3/projects/e93e9593aa734bcb9e7dbfa9bfdc6485` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:26:57.159511 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55767ee7-e0d6-4fdf-96c2-36458660d523 None admin] RBAC: Authorizing `identity:get_project(project_id=e93e9593aa734bcb9e7dbfa9bfdc6485)` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:26:57.161036 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55767ee7-e0d6-4fdf-96c2-36458660d523 None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:26:57.162879 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 49/96] 10.222.0.67 () {56 vars in 1186 bytes} [Wed May 25 14:26:56 2022] GET /identity/v3/projects/e93e9593aa734bcb9e7dbfa9bfdc6485 => generated 312 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:26:57.168850 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fefedc9-7078-4f98-9f58-8960447f2afa None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:26:57.337678 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fefedc9-7078-4f98-9f58-8960447f2afa None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:26:57.395580 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3314d6f4-9e89-448d-98c8-c5ea8bac5f12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:26:57.396615 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3314d6f4-9e89-448d-98c8-c5ea8bac5f12 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:26:57.397149 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3314d6f4-9e89-448d-98c8-c5ea8bac5f12 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:26:57.397642 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3314d6f4-9e89-448d-98c8-c5ea8bac5f12 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:26:57.398697 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3314d6f4-9e89-448d-98c8-c5ea8bac5f12 None admin] RBAC: Adding query filter params (role.id=48808901834b4d5eab2c7e6b5b03791e, scope.project.id=e93e9593aa734bcb9e7dbfa9bfdc6485, user.id=57a4a797d2d54ecd9eeb8857c043b617) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:26:57.399247 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3314d6f4-9e89-448d-98c8-c5ea8bac5f12 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:26:57.400904 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3314d6f4-9e89-448d-98c8-c5ea8bac5f12 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:26:57.408048 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 48/97] 10.222.0.67 () {56 vars in 1374 bytes} [Wed May 25 14:26:57 2022] GET /identity/v3/role_assignments?user.id=57a4a797d2d54ecd9eeb8857c043b617&scope.project.id=e93e9593aa734bcb9e7dbfa9bfdc6485&role.id=48808901834b4d5eab2c7e6b5b03791e => generated 259 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:26:59.228667 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1748de76-daef-49b1-917e-17eb2b05ea38 None None] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:26:59.229205 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1748de76-daef-49b1-917e-17eb2b05ea38 None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:26:59.229205 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1748de76-daef-49b1-917e-17eb2b05ea38 None None] PATH_INFO: `/` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:26:59.230762 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 50/98] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 14:26:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:26:59.241115 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8304de94-a2bc-493f-ab52-53b84af90631 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:26:59.241662 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8304de94-a2bc-493f-ab52-53b84af90631 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:26:59.241662 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8304de94-a2bc-493f-ab52-53b84af90631 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:26:59.253053 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:26:59.272319 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-8304de94-a2bc-493f-ab52-53b84af90631 None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:26:59.273591 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-8304de94-a2bc-493f-ab52-53b84af90631 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:26:59.356678 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 49/99] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 14:26:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 14:26:59.396384 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1748de76-daef-49b1-917e-17eb2b05ea38 None None] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:26:59.429711 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:26:59.513658 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff35ba7-35c4-459c-853a-62f32b4595fb None None] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:26:59.514183 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff35ba7-35c4-459c-853a-62f32b4595fb None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:26:59.514616 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff35ba7-35c4-459c-853a-62f32b4595fb None None] PATH_INFO: `/` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:26:59.516701 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 50/100] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 14:26:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 14:26:59.521835 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd19a68-509d-4b58-98c2-1c6767ce86b8 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:26:59.522309 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd19a68-509d-4b58-98c2-1c6767ce86b8 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:26:59.522754 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd19a68-509d-4b58-98c2-1c6767ce86b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:26:59.548938 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-4cd19a68-509d-4b58-98c2-1c6767ce86b8 None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:26:59.549770 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1748de76-daef-49b1-917e-17eb2b05ea38 None None] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:26:59.560026 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-4cd19a68-509d-4b58-98c2-1c6767ce86b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:26:59.621068 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a715d840-f24c-4467-b1b9-7bb1f0d3fb48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:26:59.621886 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a715d840-f24c-4467-b1b9-7bb1f0d3fb48 None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:26:59.622175 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a715d840-f24c-4467-b1b9-7bb1f0d3fb48 None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:26:59.622453 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a715d840-f24c-4467-b1b9-7bb1f0d3fb48 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:26:59.635895 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a715d840-f24c-4467-b1b9-7bb1f0d3fb48 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:26:59.644803 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application [None req-a715d840-f24c-4467-b1b9-7bb1f0d3fb48 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 25 14:26:59.644803 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:26:59.644803 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:26:59.644803 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:26:59.644803 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:26:59.644803 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:26:59.644803 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:26:59.644803 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:26:59.644803 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:26:59.644803 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:26:59.644803 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:26:59.644803 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:26:59.644803 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:26:59.644803 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:26:59.644803 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:26:59.644803 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:26:59.645960 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:26:59.645960 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:26:59.645960 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:26:59.645960 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:26:59.645960 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:26:59.645960 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:26:59.645960 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:26:59.645960 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:26:59.645960 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:26:59.645960 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:26:59.645960 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:26:59.645960 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application with Lock( May 25 14:26:59.645960 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:26:59.645960 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self._enter() May 25 14:26:59.645960 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:26:59.645960 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:26:59.647056 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:26:59.647056 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.creator() May 25 14:26:59.647056 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:26:59.647056 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application created_value = creator( May 25 14:26:59.647056 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:26:59.647056 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:26:59.647056 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:26:59.647056 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:26:59.647056 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:26:59.647056 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:26:59.647056 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 25 14:26:59.647056 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application May 25 14:26:59.647056 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 51/101] 10.222.0.67 () {56 vars in 1099 bytes} [Wed May 25 14:26:59 2022] GET /identity/v3/roles/reader => generated 84 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:26:59.651633 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09589bcc-a2ec-4006-84d5-0c00cc9dd111 None None] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:26:59.651951 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09589bcc-a2ec-4006-84d5-0c00cc9dd111 None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:26:59.652228 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09589bcc-a2ec-4006-84d5-0c00cc9dd111 None None] PATH_INFO: `/` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:26:59.653992 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 52/102] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 14:26:59 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:26:59.658018 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09589bcc-a2ec-4006-84d5-0c00cc9dd111 None None] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:26:59.671097 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 51/103] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 14:26:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 14:26:59.672625 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68721217-11e8-4dc2-9f3d-fea9a7c0a2c6 None None] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:26:59.673061 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68721217-11e8-4dc2-9f3d-fea9a7c0a2c6 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:26:59.673349 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68721217-11e8-4dc2-9f3d-fea9a7c0a2c6 None None] PATH_INFO: `/` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:26:59.675242 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 52/104] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 14:26:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:26:59.676531 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7f1e28-503c-48ea-a963-2167f9f46cc3 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:26:59.676827 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7f1e28-503c-48ea-a963-2167f9f46cc3 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:26:59.677112 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7f1e28-503c-48ea-a963-2167f9f46cc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:26:59.695776 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-9e7f1e28-503c-48ea-a963-2167f9f46cc3 None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:26:59.697113 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-9e7f1e28-503c-48ea-a963-2167f9f46cc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:26:59.758786 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:26:59.764136 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:26:59.773314 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09589bcc-a2ec-4006-84d5-0c00cc9dd111 None None] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:26:59.776822 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 53/105] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 14:26:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 14:26:59.782740 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb426b4c-ad5c-4a93-93fc-26ee64a0f87f None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:26:59.783132 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb426b4c-ad5c-4a93-93fc-26ee64a0f87f None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:26:59.783426 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb426b4c-ad5c-4a93-93fc-26ee64a0f87f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:26:59.810975 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67aaccd9-9a09-4678-a42d-041ba9475cfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:26:59.812077 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67aaccd9-9a09-4678-a42d-041ba9475cfa None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:26:59.812576 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67aaccd9-9a09-4678-a42d-041ba9475cfa None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:26:59.813060 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67aaccd9-9a09-4678-a42d-041ba9475cfa None admin] PATH_INFO: `/v3/roles` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:26:59.814021 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67aaccd9-9a09-4678-a42d-041ba9475cfa None admin] RBAC: Adding query filter params (name=reader) {{(pid=80474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:26:59.814541 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67aaccd9-9a09-4678-a42d-041ba9475cfa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:26:59.816116 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-bb426b4c-ad5c-4a93-93fc-26ee64a0f87f None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:26:59.816400 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67aaccd9-9a09-4678-a42d-041ba9475cfa None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:26:59.817372 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-bb426b4c-ad5c-4a93-93fc-26ee64a0f87f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:26:59.830620 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 53/106] 10.222.0.67 () {56 vars in 1101 bytes} [Wed May 25 14:26:59 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:26:59.831842 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67aaccd9-9a09-4678-a42d-041ba9475cfa None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:26:59.897810 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 54/107] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 14:26:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 14:26:59.898437 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb426b4c-ad5c-4a93-93fc-26ee64a0f87f None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:26:59.937793 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67aaccd9-9a09-4678-a42d-041ba9475cfa None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:26:59.979716 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9449dfb9-4906-4288-8565-3752922a5916 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:26:59.980758 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9449dfb9-4906-4288-8565-3752922a5916 None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:26:59.981284 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9449dfb9-4906-4288-8565-3752922a5916 None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:26:59.982310 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9449dfb9-4906-4288-8565-3752922a5916 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:26:59.984793 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9449dfb9-4906-4288-8565-3752922a5916 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:26:59.987134 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9449dfb9-4906-4288-8565-3752922a5916 None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:26:59.989374 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 54/108] 10.222.0.67 () {56 vars in 1108 bytes} [Wed May 25 14:26:59 2022] GET /identity/v3/domains/default => generated 199 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:26:59.991059 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9449dfb9-4906-4288-8565-3752922a5916 None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:27:00.012448 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb426b4c-ad5c-4a93-93fc-26ee64a0f87f None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:27:00.017086 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:27:00.043149 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:27:00.056826 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f2dd86-1e3a-4ed2-865d-85ad03058f27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:27:00.058058 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f2dd86-1e3a-4ed2-865d-85ad03058f27 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:00.058503 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f2dd86-1e3a-4ed2-865d-85ad03058f27 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:00.058937 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f2dd86-1e3a-4ed2-865d-85ad03058f27 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:00.071113 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f2dd86-1e3a-4ed2-865d-85ad03058f27 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:27:00.080693 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application [None req-e0f2dd86-1e3a-4ed2-865d-85ad03058f27 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 14:27:00.080693 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:27:00.080693 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:27:00.080693 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:27:00.080693 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:27:00.080693 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:27:00.080693 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:27:00.080693 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:27:00.080693 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:27:00.080693 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:27:00.080693 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:27:00.080693 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:27:00.080693 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:27:00.080693 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:27:00.080693 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:27:00.080693 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:27:00.081573 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:27:00.081573 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:27:00.081573 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:27:00.081573 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:27:00.081573 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:27:00.081573 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:27:00.081573 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:27:00.081573 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:27:00.081573 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:27:00.081573 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:27:00.081573 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:27:00.081573 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application with Lock( May 25 14:27:00.081573 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:27:00.081573 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._enter() May 25 14:27:00.081573 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:27:00.081573 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:27:00.082394 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:27:00.082394 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.creator() May 25 14:27:00.082394 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:27:00.082394 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application created_value = creator( May 25 14:27:00.082394 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:27:00.082394 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:27:00.082394 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:27:00.082394 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:27:00.082394 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:27:00.082394 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:27:00.082394 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 14:27:00.082394 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:27:00.089320 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 55/109] 10.222.0.67 () {56 vars in 1096 bytes} [Wed May 25 14:26:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:27:00.090348 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f2dd86-1e3a-4ed2-865d-85ad03058f27 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:27:00.111275 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9449dfb9-4906-4288-8565-3752922a5916 None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:27:00.147514 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba3cdea-dff7-40bc-b173-d79359736ce3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:27:00.148556 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba3cdea-dff7-40bc-b173-d79359736ce3 None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:00.148944 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba3cdea-dff7-40bc-b173-d79359736ce3 None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:00.149352 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba3cdea-dff7-40bc-b173-d79359736ce3 None admin] PATH_INFO: `/v3/users/1c5fe246fb4b40c08d0ad5ddecdeccb4` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:00.165401 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba3cdea-dff7-40bc-b173-d79359736ce3 None admin] RBAC: Authorizing `identity:get_user(user_id=1c5fe246fb4b40c08d0ad5ddecdeccb4)` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:27:00.167018 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba3cdea-dff7-40bc-b173-d79359736ce3 None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:27:00.168872 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 55/110] 10.222.0.67 () {56 vars in 1177 bytes} [Wed May 25 14:26:59 2022] GET /identity/v3/users/1c5fe246fb4b40c08d0ad5ddecdeccb4 => generated 289 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:27:00.174644 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba3cdea-dff7-40bc-b173-d79359736ce3 None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:27:00.205383 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f2dd86-1e3a-4ed2-865d-85ad03058f27 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:27:00.245433 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda1f606-8988-454e-be7f-a810f62d13a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:27:00.247137 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda1f606-8988-454e-be7f-a810f62d13a7 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:00.247777 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda1f606-8988-454e-be7f-a810f62d13a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:00.248241 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda1f606-8988-454e-be7f-a810f62d13a7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:00.255540 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:27:00.263474 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda1f606-8988-454e-be7f-a810f62d13a7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:27:00.272368 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application [None req-fda1f606-8988-454e-be7f-a810f62d13a7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 25 14:27:00.272368 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:27:00.272368 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:27:00.272368 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:27:00.272368 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:27:00.272368 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:27:00.272368 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:27:00.272368 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:27:00.272368 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:27:00.272368 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:27:00.272368 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:27:00.272368 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:27:00.272368 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:27:00.272368 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:27:00.272368 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:27:00.272368 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:27:00.273252 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:27:00.273252 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:27:00.273252 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:27:00.273252 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:27:00.273252 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:27:00.273252 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:27:00.273252 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:27:00.273252 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:27:00.273252 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:27:00.273252 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:27:00.273252 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:27:00.273252 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application with Lock( May 25 14:27:00.273252 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:27:00.273252 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._enter() May 25 14:27:00.273252 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:27:00.273252 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:27:00.274026 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:27:00.274026 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.creator() May 25 14:27:00.274026 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:27:00.274026 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application created_value = creator( May 25 14:27:00.274026 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:27:00.274026 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:27:00.274026 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:27:00.274026 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:27:00.274026 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:27:00.274026 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:27:00.274026 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 25 14:27:00.274026 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:27:00.276878 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 56/111] 10.222.0.67 () {56 vars in 1099 bytes} [Wed May 25 14:27:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:27:00.278061 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda1f606-8988-454e-be7f-a810f62d13a7 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:27:00.280510 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba3cdea-dff7-40bc-b173-d79359736ce3 None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:27:00.317676 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569b579f-f513-4765-b4f2-09b1c30e3d20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:27:00.319063 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569b579f-f513-4765-b4f2-09b1c30e3d20 None admin] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:00.319063 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569b579f-f513-4765-b4f2-09b1c30e3d20 None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:00.319063 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569b579f-f513-4765-b4f2-09b1c30e3d20 None admin] PATH_INFO: `/v3/projects` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:00.320054 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569b579f-f513-4765-b4f2-09b1c30e3d20 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:27:00.321615 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569b579f-f513-4765-b4f2-09b1c30e3d20 None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:27:00.335372 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:27:00.350780 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 56/112] 10.222.0.67 () {60 vars in 1141 bytes} [Wed May 25 14:27:00 2022] POST /identity/v3/projects => generated 302 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:27:00.351884 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569b579f-f513-4765-b4f2-09b1c30e3d20 None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:27:00.398907 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda1f606-8988-454e-be7f-a810f62d13a7 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:27:00.474246 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569b579f-f513-4765-b4f2-09b1c30e3d20 None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:27:00.478651 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26411873-a980-4dcf-b067-9afa5a662e2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:27:00.483287 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26411873-a980-4dcf-b067-9afa5a662e2a None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:00.483905 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26411873-a980-4dcf-b067-9afa5a662e2a None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:00.484556 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26411873-a980-4dcf-b067-9afa5a662e2a None admin] PATH_INFO: `/v3/roles` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:00.485523 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26411873-a980-4dcf-b067-9afa5a662e2a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:27:00.486000 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26411873-a980-4dcf-b067-9afa5a662e2a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:27:00.493311 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26411873-a980-4dcf-b067-9afa5a662e2a None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:27:00.506423 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:27:00.513240 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 57/113] 10.222.0.67 () {56 vars in 1099 bytes} [Wed May 25 14:27:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:27:00.513936 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26411873-a980-4dcf-b067-9afa5a662e2a None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:27:00.529354 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2902935b-b203-4074-813d-f8fae85f97fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:27:00.529956 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2902935b-b203-4074-813d-f8fae85f97fa None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:00.531566 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2902935b-b203-4074-813d-f8fae85f97fa None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:00.531948 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2902935b-b203-4074-813d-f8fae85f97fa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:00.647867 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2902935b-b203-4074-813d-f8fae85f97fa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:27:00.649357 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2902935b-b203-4074-813d-f8fae85f97fa None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:27:00.679110 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26411873-a980-4dcf-b067-9afa5a662e2a None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:27:00.681515 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:27:00.727477 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29e0a0f-e419-4776-8549-9ec7f541d53e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:27:00.728173 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29e0a0f-e419-4776-8549-9ec7f541d53e None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:00.728467 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29e0a0f-e419-4776-8549-9ec7f541d53e None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:00.728756 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29e0a0f-e419-4776-8549-9ec7f541d53e None admin] PATH_INFO: `/v3/roles` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:00.729513 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29e0a0f-e419-4776-8549-9ec7f541d53e None admin] RBAC: Adding query filter params (name=member) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:27:00.729829 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29e0a0f-e419-4776-8549-9ec7f541d53e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:27:00.731259 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29e0a0f-e419-4776-8549-9ec7f541d53e None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:27:00.741546 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 58/114] 10.222.0.67 () {56 vars in 1101 bytes} [Wed May 25 14:27:00 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:27:00.742155 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29e0a0f-e419-4776-8549-9ec7f541d53e None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:27:00.786365 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 57/115] 10.222.0.67 () {58 vars in 1282 bytes} [Wed May 25 14:27:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 14:27:00.788175 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e984f1-0d2d-4334-b1fa-a564b8ceaf48 None None] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:00.788692 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e984f1-0d2d-4334-b1fa-a564b8ceaf48 None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:00.789174 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e984f1-0d2d-4334-b1fa-a564b8ceaf48 None None] PATH_INFO: `/` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:00.790710 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 58/116] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 14:27:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:27:00.791671 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e984f1-0d2d-4334-b1fa-a564b8ceaf48 None None] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:27:00.843909 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:27:00.866469 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29e0a0f-e419-4776-8549-9ec7f541d53e None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:27:00.900505 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e984f1-0d2d-4334-b1fa-a564b8ceaf48 None None] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:27:00.902702 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd29030-41c5-42af-9513-6375105de6f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:27:00.904262 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd29030-41c5-42af-9513-6375105de6f9 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:00.904262 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd29030-41c5-42af-9513-6375105de6f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:00.904262 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd29030-41c5-42af-9513-6375105de6f9 None admin] PATH_INFO: `/v3/users/be354bf3692549b095099e6268f938f3` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:00.906362 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd29030-41c5-42af-9513-6375105de6f9 None admin] RBAC: Authorizing `identity:get_user(user_id=be354bf3692549b095099e6268f938f3)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:27:00.908307 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd29030-41c5-42af-9513-6375105de6f9 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:27:00.910231 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 59/117] 10.222.0.67 () {56 vars in 1177 bytes} [Wed May 25 14:27:00 2022] GET /identity/v3/users/be354bf3692549b095099e6268f938f3 => generated 247 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:27:00.914682 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd29030-41c5-42af-9513-6375105de6f9 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:27:00.944227 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19441e9-b905-43ef-8f0a-5b5cebf4e27b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:27:00.945354 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19441e9-b905-43ef-8f0a-5b5cebf4e27b None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:00.945793 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19441e9-b905-43ef-8f0a-5b5cebf4e27b None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:00.946327 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19441e9-b905-43ef-8f0a-5b5cebf4e27b None admin] PATH_INFO: `/v3/users/57a4a797d2d54ecd9eeb8857c043b617` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:00.947713 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19441e9-b905-43ef-8f0a-5b5cebf4e27b None admin] RBAC: Authorizing `identity:get_user(user_id=57a4a797d2d54ecd9eeb8857c043b617)` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:27:00.949362 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19441e9-b905-43ef-8f0a-5b5cebf4e27b None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:27:00.951531 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 59/118] 10.222.0.67 () {56 vars in 1177 bytes} [Wed May 25 14:27:00 2022] GET /identity/v3/users/57a4a797d2d54ecd9eeb8857c043b617 => generated 275 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:27:00.953475 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf72208-c527-4e19-a41b-ac765a5ba40f None None] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:00.953960 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf72208-c527-4e19-a41b-ac765a5ba40f None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:00.954414 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf72208-c527-4e19-a41b-ac765a5ba40f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:00.958608 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:27:00.972513 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.auth.core [None req-3bf72208-c527-4e19-a41b-ac765a5ba40f None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:27:00.973994 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-3bf72208-c527-4e19-a41b-ac765a5ba40f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:27:01.032853 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd29030-41c5-42af-9513-6375105de6f9 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:27:01.059090 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 60/119] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 14:27:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 14:27:01.059090 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf72208-c527-4e19-a41b-ac765a5ba40f None None] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:27:01.079579 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:27:01.085220 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0735c767-64cf-46a0-a630-b0d4e7b9df59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:27:01.086090 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0735c767-64cf-46a0-a630-b0d4e7b9df59 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:01.086374 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0735c767-64cf-46a0-a630-b0d4e7b9df59 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:01.086776 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0735c767-64cf-46a0-a630-b0d4e7b9df59 None admin] PATH_INFO: `/v3/projects/652aa39dec91415abc8e6c301800eb00` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:01.088792 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0735c767-64cf-46a0-a630-b0d4e7b9df59 None admin] RBAC: Authorizing `identity:get_project(project_id=652aa39dec91415abc8e6c301800eb00)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:27:01.090266 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0735c767-64cf-46a0-a630-b0d4e7b9df59 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:27:01.092134 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 60/120] 10.222.0.67 () {56 vars in 1186 bytes} [Wed May 25 14:27:00 2022] GET /identity/v3/projects/652aa39dec91415abc8e6c301800eb00 => generated 298 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:27:01.092727 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0735c767-64cf-46a0-a630-b0d4e7b9df59 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:27:01.160364 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf72208-c527-4e19-a41b-ac765a5ba40f None None] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:27:01.196815 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3566c297-fbf2-4a6b-ab23-157931f42469 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:27:01.197700 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3566c297-fbf2-4a6b-ab23-157931f42469 None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:01.197980 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3566c297-fbf2-4a6b-ab23-157931f42469 None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:01.198261 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3566c297-fbf2-4a6b-ab23-157931f42469 None admin] PATH_INFO: `/v3/projects/652aa39dec91415abc8e6c301800eb00` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:01.199591 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3566c297-fbf2-4a6b-ab23-157931f42469 None admin] RBAC: Authorizing `identity:get_project(project_id=652aa39dec91415abc8e6c301800eb00)` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:27:01.201069 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3566c297-fbf2-4a6b-ab23-157931f42469 None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:27:01.201629 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0735c767-64cf-46a0-a630-b0d4e7b9df59 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:27:01.203511 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 61/121] 10.222.0.67 () {56 vars in 1186 bytes} [Wed May 25 14:27:01 2022] GET /identity/v3/projects/652aa39dec91415abc8e6c301800eb00 => generated 298 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:27:01.204678 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0146b9d-bd64-4920-84d5-5ab8833579b0 None None] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:01.204975 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0146b9d-bd64-4920-84d5-5ab8833579b0 None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:01.205258 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0146b9d-bd64-4920-84d5-5ab8833579b0 None None] PATH_INFO: `/` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:01.206620 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 62/122] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 14:27:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:27:01.208714 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:27:01.211483 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0146b9d-bd64-4920-84d5-5ab8833579b0 None None] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:27:01.246126 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0eaff7-b0ac-4d54-a882-397937805883 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:27:01.247022 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0eaff7-b0ac-4d54-a882-397937805883 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:01.247325 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0eaff7-b0ac-4d54-a882-397937805883 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:01.247594 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0eaff7-b0ac-4d54-a882-397937805883 None admin] PATH_INFO: `/v3/projects/652aa39dec91415abc8e6c301800eb00` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:01.248790 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0eaff7-b0ac-4d54-a882-397937805883 None admin] RBAC: Authorizing `identity:get_project(project_id=652aa39dec91415abc8e6c301800eb00)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:27:01.250898 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0eaff7-b0ac-4d54-a882-397937805883 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:27:01.257060 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 61/123] 10.222.0.67 () {56 vars in 1186 bytes} [Wed May 25 14:27:01 2022] GET /identity/v3/projects/652aa39dec91415abc8e6c301800eb00 => generated 298 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:27:01.257060 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0eaff7-b0ac-4d54-a882-397937805883 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:27:01.320193 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:27:01.329697 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0146b9d-bd64-4920-84d5-5ab8833579b0 None None] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:27:01.365857 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19497088-0c74-42ca-81c3-bb9daef23211 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:27:01.366704 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19497088-0c74-42ca-81c3-bb9daef23211 None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:01.367024 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19497088-0c74-42ca-81c3-bb9daef23211 None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:01.367300 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19497088-0c74-42ca-81c3-bb9daef23211 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:01.367477 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0eaff7-b0ac-4d54-a882-397937805883 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:27:01.379395 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19497088-0c74-42ca-81c3-bb9daef23211 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:27:01.387445 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application [None req-19497088-0c74-42ca-81c3-bb9daef23211 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 14:27:01.387445 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:27:01.387445 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:27:01.387445 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:27:01.387445 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:27:01.387445 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:27:01.387445 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:27:01.387445 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:27:01.387445 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:27:01.387445 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:27:01.387445 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:27:01.387445 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:27:01.387445 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:27:01.387445 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:27:01.387445 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:27:01.387445 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:27:01.388306 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:27:01.388306 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:27:01.388306 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:27:01.388306 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:27:01.388306 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:27:01.388306 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:27:01.388306 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:27:01.388306 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:27:01.388306 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:27:01.388306 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:27:01.388306 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:27:01.388306 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application with Lock( May 25 14:27:01.388306 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:27:01.388306 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self._enter() May 25 14:27:01.388306 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:27:01.388306 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:27:01.389066 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:27:01.389066 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.creator() May 25 14:27:01.389066 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:27:01.389066 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application created_value = creator( May 25 14:27:01.389066 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:27:01.389066 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:27:01.389066 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:27:01.389066 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:27:01.389066 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:27:01.389066 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:27:01.389066 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 14:27:01.389066 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application May 25 14:27:01.389066 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 63/124] 10.222.0.67 () {56 vars in 1114 bytes} [Wed May 25 14:27:01 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:27:01.389733 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19497088-0c74-42ca-81c3-bb9daef23211 None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:27:01.409679 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711c376b-67c5-4f2d-b8d4-829f1f022a1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:27:01.410339 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711c376b-67c5-4f2d-b8d4-829f1f022a1c None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:01.410631 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711c376b-67c5-4f2d-b8d4-829f1f022a1c None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:01.410918 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711c376b-67c5-4f2d-b8d4-829f1f022a1c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:01.411795 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711c376b-67c5-4f2d-b8d4-829f1f022a1c None admin] RBAC: Adding query filter params (role.id=ed5296b21eba4c49b7792056991162da, scope.project.id=652aa39dec91415abc8e6c301800eb00, user.id=1c5fe246fb4b40c08d0ad5ddecdeccb4) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:27:01.412114 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711c376b-67c5-4f2d-b8d4-829f1f022a1c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:27:01.413573 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711c376b-67c5-4f2d-b8d4-829f1f022a1c None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:27:01.427035 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 62/125] 10.222.0.67 () {56 vars in 1374 bytes} [Wed May 25 14:27:01 2022] GET /identity/v3/role_assignments?user.id=1c5fe246fb4b40c08d0ad5ddecdeccb4&scope.project.id=652aa39dec91415abc8e6c301800eb00&role.id=ed5296b21eba4c49b7792056991162da => generated 259 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:27:01.427035 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9262c89-da2b-4062-a153-7b75dcee3661 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:01.427035 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9262c89-da2b-4062-a153-7b75dcee3661 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:01.427035 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9262c89-da2b-4062-a153-7b75dcee3661 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:01.438946 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-f9262c89-da2b-4062-a153-7b75dcee3661 None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:27:01.440207 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-f9262c89-da2b-4062-a153-7b75dcee3661 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:27:01.478587 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:27:01.526897 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19497088-0c74-42ca-81c3-bb9daef23211 None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:27:01.539428 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 63/126] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 14:27:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 14:27:01.547733 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9262c89-da2b-4062-a153-7b75dcee3661 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:27:01.598658 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021dee84-8f9a-4a69-bb26-0f788efc13a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:27:01.600143 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021dee84-8f9a-4a69-bb26-0f788efc13a7 None admin] REQUEST_METHOD: `PUT` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:01.600438 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021dee84-8f9a-4a69-bb26-0f788efc13a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:01.600720 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021dee84-8f9a-4a69-bb26-0f788efc13a7 None admin] PATH_INFO: `/v3/projects/652aa39dec91415abc8e6c301800eb00/users/be354bf3692549b095099e6268f938f3/roles/399893e19eac4ab5a8e596f7c07be13c` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:01.602804 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021dee84-8f9a-4a69-bb26-0f788efc13a7 None admin] RBAC: Authorizing `identity:create_grant(project_id=652aa39dec91415abc8e6c301800eb00, user_id=be354bf3692549b095099e6268f938f3, role_id=399893e19eac4ab5a8e596f7c07be13c)` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:27:01.604329 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021dee84-8f9a-4a69-bb26-0f788efc13a7 None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:27:01.621336 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 64/127] 10.222.0.67 () {58 vars in 1439 bytes} [Wed May 25 14:27:01 2022] PUT /identity/v3/projects/652aa39dec91415abc8e6c301800eb00/users/be354bf3692549b095099e6268f938f3/roles/399893e19eac4ab5a8e596f7c07be13c => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:27:01.622318 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021dee84-8f9a-4a69-bb26-0f788efc13a7 None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:27:01.647594 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:27:01.692337 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9262c89-da2b-4062-a153-7b75dcee3661 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:27:01.778956 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021dee84-8f9a-4a69-bb26-0f788efc13a7 None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:27:01.795814 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ebde72-f2a7-46c9-b092-33c927487470 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:27:01.796891 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ebde72-f2a7-46c9-b092-33c927487470 None admin] REQUEST_METHOD: `PUT` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:01.797221 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ebde72-f2a7-46c9-b092-33c927487470 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:01.797507 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ebde72-f2a7-46c9-b092-33c927487470 None admin] PATH_INFO: `/v3/projects/652aa39dec91415abc8e6c301800eb00/users/57a4a797d2d54ecd9eeb8857c043b617/roles/48808901834b4d5eab2c7e6b5b03791e` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:01.799674 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ebde72-f2a7-46c9-b092-33c927487470 None admin] RBAC: Authorizing `identity:create_grant(project_id=652aa39dec91415abc8e6c301800eb00, user_id=57a4a797d2d54ecd9eeb8857c043b617, role_id=48808901834b4d5eab2c7e6b5b03791e)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:27:01.801192 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ebde72-f2a7-46c9-b092-33c927487470 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:27:01.828949 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 64/128] 10.222.0.67 () {58 vars in 1439 bytes} [Wed May 25 14:27:01 2022] PUT /identity/v3/projects/652aa39dec91415abc8e6c301800eb00/users/57a4a797d2d54ecd9eeb8857c043b617/roles/48808901834b4d5eab2c7e6b5b03791e => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:27:01.829727 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ebde72-f2a7-46c9-b092-33c927487470 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:27:01.831751 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aba758e-c746-480f-9016-0cd3dd97c898 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:27:01.832461 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aba758e-c746-480f-9016-0cd3dd97c898 None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:01.832759 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aba758e-c746-480f-9016-0cd3dd97c898 None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:01.833046 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aba758e-c746-480f-9016-0cd3dd97c898 None admin] PATH_INFO: `/v3/roles` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:01.833918 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aba758e-c746-480f-9016-0cd3dd97c898 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:27:01.834238 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aba758e-c746-480f-9016-0cd3dd97c898 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:27:01.835789 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aba758e-c746-480f-9016-0cd3dd97c898 None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:27:01.857871 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 65/129] 10.222.0.67 () {56 vars in 1111 bytes} [Wed May 25 14:27:01 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:27:01.864237 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aba758e-c746-480f-9016-0cd3dd97c898 None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:27:01.865103 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:27:01.968757 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ebde72-f2a7-46c9-b092-33c927487470 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:27:02.010261 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148ca95f-33af-4f29-ac15-d0ca13a8df85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:27:02.011121 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148ca95f-33af-4f29-ac15-d0ca13a8df85 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:02.011410 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148ca95f-33af-4f29-ac15-d0ca13a8df85 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:02.011687 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148ca95f-33af-4f29-ac15-d0ca13a8df85 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:02.019398 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:27:02.024392 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148ca95f-33af-4f29-ac15-d0ca13a8df85 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:27:02.033418 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application [None req-148ca95f-33af-4f29-ac15-d0ca13a8df85 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 25 14:27:02.033418 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:27:02.033418 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:27:02.033418 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:27:02.033418 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:27:02.033418 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:27:02.033418 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:27:02.033418 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:27:02.033418 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:27:02.033418 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:27:02.033418 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:27:02.033418 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:27:02.033418 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:27:02.033418 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:27:02.033418 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:27:02.033418 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:27:02.034330 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:27:02.034330 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:27:02.034330 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:27:02.034330 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:27:02.034330 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:27:02.034330 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:27:02.034330 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:27:02.034330 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:27:02.034330 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:27:02.034330 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:27:02.034330 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:27:02.034330 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application with Lock( May 25 14:27:02.034330 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:27:02.034330 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._enter() May 25 14:27:02.034330 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:27:02.034330 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:27:02.035172 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:27:02.035172 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.creator() May 25 14:27:02.035172 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:27:02.035172 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application created_value = creator( May 25 14:27:02.035172 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:27:02.035172 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:27:02.035172 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:27:02.035172 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:27:02.035172 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:27:02.035172 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:27:02.035172 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 25 14:27:02.035172 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:27:02.035172 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 65/130] 10.222.0.67 () {56 vars in 1099 bytes} [Wed May 25 14:27:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:27:02.042731 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148ca95f-33af-4f29-ac15-d0ca13a8df85 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:27:02.055060 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aba758e-c746-480f-9016-0cd3dd97c898 None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:27:02.095817 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a21f063-d022-460c-8926-056616e22e7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:27:02.096715 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a21f063-d022-460c-8926-056616e22e7a None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:02.097008 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a21f063-d022-460c-8926-056616e22e7a None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:02.097340 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a21f063-d022-460c-8926-056616e22e7a None admin] PATH_INFO: `/v3/users/57a4a797d2d54ecd9eeb8857c043b617` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:02.103912 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a21f063-d022-460c-8926-056616e22e7a None admin] RBAC: Authorizing `identity:get_user(user_id=57a4a797d2d54ecd9eeb8857c043b617)` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:27:02.105408 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a21f063-d022-460c-8926-056616e22e7a None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:27:02.107416 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 66/131] 10.222.0.67 () {56 vars in 1177 bytes} [Wed May 25 14:27:01 2022] GET /identity/v3/users/57a4a797d2d54ecd9eeb8857c043b617 => generated 275 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:27:02.113198 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a21f063-d022-460c-8926-056616e22e7a None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:27:02.226417 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:27:02.260263 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148ca95f-33af-4f29-ac15-d0ca13a8df85 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:27:02.322464 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd30ada-740d-468a-b9ac-d9f2ae1ddf4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:27:02.323177 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd30ada-740d-468a-b9ac-d9f2ae1ddf4e None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:02.323474 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd30ada-740d-468a-b9ac-d9f2ae1ddf4e None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:02.323757 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd30ada-740d-468a-b9ac-d9f2ae1ddf4e None admin] PATH_INFO: `/v3/roles` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:02.325014 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd30ada-740d-468a-b9ac-d9f2ae1ddf4e None admin] RBAC: Adding query filter params (name=member) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:27:02.325337 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd30ada-740d-468a-b9ac-d9f2ae1ddf4e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:27:02.326756 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd30ada-740d-468a-b9ac-d9f2ae1ddf4e None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:27:02.341868 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 66/132] 10.222.0.67 () {56 vars in 1101 bytes} [Wed May 25 14:27:02 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:27:02.348012 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd30ada-740d-468a-b9ac-d9f2ae1ddf4e None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:27:02.421064 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a21f063-d022-460c-8926-056616e22e7a None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:27:02.470259 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd30ada-740d-468a-b9ac-d9f2ae1ddf4e None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:27:02.510466 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d6842f-9915-4717-87ae-26aaa469b236 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:27:02.511436 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe143ad-82c6-48f9-8c86-a9e7f91db989 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:27:02.512559 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d6842f-9915-4717-87ae-26aaa469b236 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:02.513605 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe143ad-82c6-48f9-8c86-a9e7f91db989 None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:02.514081 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe143ad-82c6-48f9-8c86-a9e7f91db989 None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:02.514551 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d6842f-9915-4717-87ae-26aaa469b236 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:02.515597 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d6842f-9915-4717-87ae-26aaa469b236 None admin] PATH_INFO: `/v3/users/57a4a797d2d54ecd9eeb8857c043b617` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:02.516371 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe143ad-82c6-48f9-8c86-a9e7f91db989 None admin] PATH_INFO: `/v3/projects/652aa39dec91415abc8e6c301800eb00` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:02.517312 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d6842f-9915-4717-87ae-26aaa469b236 None admin] RBAC: Authorizing `identity:get_user(user_id=57a4a797d2d54ecd9eeb8857c043b617)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:27:02.526881 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d6842f-9915-4717-87ae-26aaa469b236 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:27:02.527046 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe143ad-82c6-48f9-8c86-a9e7f91db989 None admin] RBAC: Authorizing `identity:get_project(project_id=652aa39dec91415abc8e6c301800eb00)` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:27:02.527046 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe143ad-82c6-48f9-8c86-a9e7f91db989 None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:27:02.527046 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 67/133] 10.222.0.67 () {56 vars in 1186 bytes} [Wed May 25 14:27:02 2022] GET /identity/v3/projects/652aa39dec91415abc8e6c301800eb00 => generated 298 bytes in 414 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:27:02.529677 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 67/134] 10.222.0.67 () {56 vars in 1177 bytes} [Wed May 25 14:27:02 2022] GET /identity/v3/users/57a4a797d2d54ecd9eeb8857c043b617 => generated 275 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:27:02.536813 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe143ad-82c6-48f9-8c86-a9e7f91db989 None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:27:02.539393 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d6842f-9915-4717-87ae-26aaa469b236 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:27:02.564842 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:27:02.568970 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:27:02.700783 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d6842f-9915-4717-87ae-26aaa469b236 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:27:02.748411 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe143ad-82c6-48f9-8c86-a9e7f91db989 None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:27:02.766582 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4f8785-8728-45b2-b24c-b3fa83327c34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:27:02.767489 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4f8785-8728-45b2-b24c-b3fa83327c34 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:02.767780 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4f8785-8728-45b2-b24c-b3fa83327c34 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:02.768061 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4f8785-8728-45b2-b24c-b3fa83327c34 None admin] PATH_INFO: `/v3/projects/e93e9593aa734bcb9e7dbfa9bfdc6485` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:02.769391 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4f8785-8728-45b2-b24c-b3fa83327c34 None admin] RBAC: Authorizing `identity:get_project(project_id=e93e9593aa734bcb9e7dbfa9bfdc6485)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:27:02.770870 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4f8785-8728-45b2-b24c-b3fa83327c34 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:27:02.772829 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 68/135] 10.222.0.67 () {56 vars in 1186 bytes} [Wed May 25 14:27:02 2022] GET /identity/v3/projects/e93e9593aa734bcb9e7dbfa9bfdc6485 => generated 312 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:27:02.787125 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4f8785-8728-45b2-b24c-b3fa83327c34 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:27:02.793663 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35877327-6be3-4ab9-9c2a-e30bcf02711f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:27:02.794575 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35877327-6be3-4ab9-9c2a-e30bcf02711f None admin] REQUEST_METHOD: `PUT` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:02.794866 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35877327-6be3-4ab9-9c2a-e30bcf02711f None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:02.795192 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35877327-6be3-4ab9-9c2a-e30bcf02711f None admin] PATH_INFO: `/v3/projects/652aa39dec91415abc8e6c301800eb00/users/57a4a797d2d54ecd9eeb8857c043b617/roles/3e87d9311f1d411395a3fcd41ac81431` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:02.800736 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35877327-6be3-4ab9-9c2a-e30bcf02711f None admin] RBAC: Authorizing `identity:create_grant(project_id=652aa39dec91415abc8e6c301800eb00, user_id=57a4a797d2d54ecd9eeb8857c043b617, role_id=3e87d9311f1d411395a3fcd41ac81431)` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:27:02.802304 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35877327-6be3-4ab9-9c2a-e30bcf02711f None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:27:02.836265 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 68/136] 10.222.0.67 () {58 vars in 1439 bytes} [Wed May 25 14:27:02 2022] PUT /identity/v3/projects/652aa39dec91415abc8e6c301800eb00/users/57a4a797d2d54ecd9eeb8857c043b617/roles/3e87d9311f1d411395a3fcd41ac81431 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:27:02.946888 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:27:02.972544 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4f8785-8728-45b2-b24c-b3fa83327c34 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:27:03.010298 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627029aa-3a2a-4e22-8cd4-666c82736b26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:27:03.011566 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627029aa-3a2a-4e22-8cd4-666c82736b26 None admin] REQUEST_METHOD: `PUT` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:03.012059 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627029aa-3a2a-4e22-8cd4-666c82736b26 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:03.012534 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627029aa-3a2a-4e22-8cd4-666c82736b26 None admin] PATH_INFO: `/v3/projects/e93e9593aa734bcb9e7dbfa9bfdc6485/users/57a4a797d2d54ecd9eeb8857c043b617/roles/48808901834b4d5eab2c7e6b5b03791e` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:03.014751 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627029aa-3a2a-4e22-8cd4-666c82736b26 None admin] RBAC: Authorizing `identity:create_grant(project_id=e93e9593aa734bcb9e7dbfa9bfdc6485, user_id=57a4a797d2d54ecd9eeb8857c043b617, role_id=48808901834b4d5eab2c7e6b5b03791e)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:27:03.017173 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627029aa-3a2a-4e22-8cd4-666c82736b26 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:27:03.042358 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 69/137] 10.222.0.67 () {58 vars in 1439 bytes} [Wed May 25 14:27:02 2022] PUT /identity/v3/projects/e93e9593aa734bcb9e7dbfa9bfdc6485/users/57a4a797d2d54ecd9eeb8857c043b617/roles/48808901834b4d5eab2c7e6b5b03791e => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 14:27:03.273699 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a098a110-0dad-4ad2-ad2a-61c78465334f None None] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:03.274096 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a098a110-0dad-4ad2-ad2a-61c78465334f None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:03.274293 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a098a110-0dad-4ad2-ad2a-61c78465334f None None] PATH_INFO: `/` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:03.276140 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 69/138] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 14:27:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:27:03.283890 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ca31e4-9a3b-48e7-8225-eda66b88fa3a None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:03.284866 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ca31e4-9a3b-48e7-8225-eda66b88fa3a None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:03.285352 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ca31e4-9a3b-48e7-8225-eda66b88fa3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:03.306531 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-a1ca31e4-9a3b-48e7-8225-eda66b88fa3a None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:27:03.308148 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-a1ca31e4-9a3b-48e7-8225-eda66b88fa3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:27:03.383193 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 70/139] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 14:27:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 14:27:03.408876 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a098a110-0dad-4ad2-ad2a-61c78465334f None None] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:27:03.514670 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:27:03.549609 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a098a110-0dad-4ad2-ad2a-61c78465334f None None] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:27:03.584854 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d7a0f9-a69f-4433-9d48-029f1194a661 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:27:03.585655 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d7a0f9-a69f-4433-9d48-029f1194a661 None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:03.585938 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d7a0f9-a69f-4433-9d48-029f1194a661 None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:03.586212 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d7a0f9-a69f-4433-9d48-029f1194a661 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:03.587399 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d7a0f9-a69f-4433-9d48-029f1194a661 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:27:03.588844 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d7a0f9-a69f-4433-9d48-029f1194a661 None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:27:03.590742 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 70/140] 10.222.0.67 () {56 vars in 1108 bytes} [Wed May 25 14:27:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:27:03.596576 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ca31e4-9a3b-48e7-8225-eda66b88fa3a None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:27:03.668042 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:27:03.705024 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ca31e4-9a3b-48e7-8225-eda66b88fa3a None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:27:03.751852 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b20e8ca-a4b8-4f4e-b6b4-1e5ceba64da4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:27:03.752547 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b20e8ca-a4b8-4f4e-b6b4-1e5ceba64da4 None admin] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:03.752832 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b20e8ca-a4b8-4f4e-b6b4-1e5ceba64da4 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:03.753100 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b20e8ca-a4b8-4f4e-b6b4-1e5ceba64da4 None admin] PATH_INFO: `/v3/users` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:03.753819 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b20e8ca-a4b8-4f4e-b6b4-1e5ceba64da4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:27:03.755306 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b20e8ca-a4b8-4f4e-b6b4-1e5ceba64da4 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:27:03.781675 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 71/141] 10.222.0.67 () {60 vars in 1132 bytes} [Wed May 25 14:27:03 2022] POST /identity/v3/users => generated 283 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:27:05.038403 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa386282-6a6a-4340-8a79-1346a78569ef None None] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:05.038908 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa386282-6a6a-4340-8a79-1346a78569ef None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:05.039232 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa386282-6a6a-4340-8a79-1346a78569ef None None] PATH_INFO: `/` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:05.040827 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 71/142] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 14:27:05 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:27:05.046460 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c50dbf-e6a6-44c3-a9df-441da8101a5e None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:05.046982 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c50dbf-e6a6-44c3-a9df-441da8101a5e None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:05.047306 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c50dbf-e6a6-44c3-a9df-441da8101a5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:05.069154 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-c9c50dbf-e6a6-44c3-a9df-441da8101a5e None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:27:05.070357 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-c9c50dbf-e6a6-44c3-a9df-441da8101a5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:27:05.090268 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d703c92-915f-4172-a130-8f1c25c84e04 None None] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:05.090552 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d703c92-915f-4172-a130-8f1c25c84e04 None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:05.090757 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d703c92-915f-4172-a130-8f1c25c84e04 None None] PATH_INFO: `/` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:05.092188 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 72/143] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 14:27:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:27:05.098115 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4913faf-9e66-40ed-a7b1-9179d649d86d None None] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:05.098411 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4913faf-9e66-40ed-a7b1-9179d649d86d None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:05.098695 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4913faf-9e66-40ed-a7b1-9179d649d86d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:05.122233 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.auth.core [None req-d4913faf-9e66-40ed-a7b1-9179d649d86d None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:27:05.123494 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-d4913faf-9e66-40ed-a7b1-9179d649d86d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:27:05.167945 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 72/144] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 14:27:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 14:27:05.200928 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c50dbf-e6a6-44c3-a9df-441da8101a5e None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:27:05.220668 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 73/145] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 14:27:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 14:27:05.286431 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4913faf-9e66-40ed-a7b1-9179d649d86d None None] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:27:05.291035 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:27:05.351213 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c50dbf-e6a6-44c3-a9df-441da8101a5e None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:27:05.411494 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9b7009-8ac0-4b61-b002-56d4946ff149 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:27:05.412314 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9b7009-8ac0-4b61-b002-56d4946ff149 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:05.412602 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9b7009-8ac0-4b61-b002-56d4946ff149 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:05.412883 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9b7009-8ac0-4b61-b002-56d4946ff149 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:05.437596 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:27:05.442441 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9b7009-8ac0-4b61-b002-56d4946ff149 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:27:05.455387 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application [None req-9a9b7009-8ac0-4b61-b002-56d4946ff149 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 14:27:05.455387 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:27:05.455387 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:27:05.455387 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:27:05.455387 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:27:05.455387 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:27:05.455387 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:27:05.455387 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:27:05.455387 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:27:05.455387 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:27:05.455387 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:27:05.455387 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:27:05.455387 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:27:05.455387 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:27:05.455387 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:27:05.455387 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:27:05.456326 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:27:05.456326 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:27:05.456326 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:27:05.456326 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:27:05.456326 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:27:05.456326 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:27:05.456326 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:27:05.456326 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:27:05.456326 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:27:05.456326 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:27:05.456326 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:27:05.456326 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application with Lock( May 25 14:27:05.456326 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:27:05.456326 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._enter() May 25 14:27:05.456326 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:27:05.456326 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:27:05.457098 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:27:05.457098 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.creator() May 25 14:27:05.457098 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:27:05.457098 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application created_value = creator( May 25 14:27:05.457098 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:27:05.457098 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:27:05.457098 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:27:05.457098 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:27:05.457098 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:27:05.457098 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:27:05.457098 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 14:27:05.457098 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:27:05.457098 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 73/146] 10.222.0.67 () {56 vars in 1096 bytes} [Wed May 25 14:27:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 14:27:05.464156 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9b7009-8ac0-4b61-b002-56d4946ff149 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:27:05.481493 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4913faf-9e66-40ed-a7b1-9179d649d86d None None] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:27:05.522645 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09745f73-76d7-40ab-8318-ff63254d01f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:27:05.523478 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09745f73-76d7-40ab-8318-ff63254d01f1 None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:05.523767 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09745f73-76d7-40ab-8318-ff63254d01f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:05.524192 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09745f73-76d7-40ab-8318-ff63254d01f1 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:05.539379 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09745f73-76d7-40ab-8318-ff63254d01f1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:27:05.550500 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application [None req-09745f73-76d7-40ab-8318-ff63254d01f1 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 25 14:27:05.550500 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:27:05.550500 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:27:05.550500 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:27:05.550500 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:27:05.550500 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:27:05.550500 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:27:05.550500 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:27:05.550500 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:27:05.550500 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:27:05.550500 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:27:05.550500 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:27:05.550500 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:27:05.550500 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:27:05.550500 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:27:05.550500 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:27:05.551472 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:27:05.551472 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:27:05.551472 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:27:05.551472 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:27:05.551472 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:27:05.551472 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:27:05.551472 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:27:05.551472 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:27:05.551472 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:27:05.551472 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:27:05.551472 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:27:05.551472 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application with Lock( May 25 14:27:05.551472 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:27:05.551472 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self._enter() May 25 14:27:05.551472 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:27:05.551472 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:27:05.552578 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:27:05.552578 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.creator() May 25 14:27:05.552578 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:27:05.552578 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application created_value = creator( May 25 14:27:05.552578 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:27:05.552578 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:27:05.552578 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:27:05.552578 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:27:05.552578 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:27:05.552578 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:27:05.552578 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 25 14:27:05.552578 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application May 25 14:27:05.552578 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 74/147] 10.222.0.67 () {56 vars in 1099 bytes} [Wed May 25 14:27:05 2022] GET /identity/v3/roles/reader => generated 84 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:27:05.560730 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38710fcd-b362-46ca-a21a-149ad2ee4be1 None None] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:05.561467 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38710fcd-b362-46ca-a21a-149ad2ee4be1 None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:05.561683 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38710fcd-b362-46ca-a21a-149ad2ee4be1 None None] PATH_INFO: `/` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:05.564199 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 75/148] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 14:27:05 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:27:05.565931 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38710fcd-b362-46ca-a21a-149ad2ee4be1 None None] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:27:05.727132 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9b7009-8ac0-4b61-b002-56d4946ff149 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:27:05.757154 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:27:05.786834 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6262eeb8-8ca1-40ff-a204-a7fd0398ae48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:27:05.787551 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6262eeb8-8ca1-40ff-a204-a7fd0398ae48 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:05.787839 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6262eeb8-8ca1-40ff-a204-a7fd0398ae48 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:05.788122 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6262eeb8-8ca1-40ff-a204-a7fd0398ae48 None admin] PATH_INFO: `/v3/roles` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:05.788890 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6262eeb8-8ca1-40ff-a204-a7fd0398ae48 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:27:05.789202 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6262eeb8-8ca1-40ff-a204-a7fd0398ae48 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:27:05.790601 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6262eeb8-8ca1-40ff-a204-a7fd0398ae48 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:27:05.806016 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 74/149] 10.222.0.67 () {56 vars in 1099 bytes} [Wed May 25 14:27:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 342 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:27:05.807515 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f685b8-259e-4ebe-8ab8-bf93502c2824 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:05.807929 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f685b8-259e-4ebe-8ab8-bf93502c2824 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:05.808230 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f685b8-259e-4ebe-8ab8-bf93502c2824 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:05.838075 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-42f685b8-259e-4ebe-8ab8-bf93502c2824 None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:27:05.838075 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-42f685b8-259e-4ebe-8ab8-bf93502c2824 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:27:05.863719 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38710fcd-b362-46ca-a21a-149ad2ee4be1 None None] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:27:05.942687 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:27:05.956551 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d46498-c819-4c4b-8667-b4f31d0beb17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:27:05.958631 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d46498-c819-4c4b-8667-b4f31d0beb17 None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:05.959272 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d46498-c819-4c4b-8667-b4f31d0beb17 None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:05.960869 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d46498-c819-4c4b-8667-b4f31d0beb17 None admin] PATH_INFO: `/v3/roles` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:05.961803 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d46498-c819-4c4b-8667-b4f31d0beb17 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:27:05.962604 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d46498-c819-4c4b-8667-b4f31d0beb17 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:27:05.964710 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d46498-c819-4c4b-8667-b4f31d0beb17 None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:27:05.966099 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 75/150] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 14:27:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 14:27:05.969005 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f685b8-259e-4ebe-8ab8-bf93502c2824 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:27:05.986846 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 76/151] 10.222.0.67 () {56 vars in 1101 bytes} [Wed May 25 14:27:05 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 422 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:27:05.996632 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d46498-c819-4c4b-8667-b4f31d0beb17 None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:27:06.153385 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d46498-c819-4c4b-8667-b4f31d0beb17 None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:27:06.191478 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f685b8-259e-4ebe-8ab8-bf93502c2824 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:27:06.206423 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6167db91-9d18-4a8e-a7f1-78ed50892362 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:27:06.207564 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6167db91-9d18-4a8e-a7f1-78ed50892362 None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:06.208018 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6167db91-9d18-4a8e-a7f1-78ed50892362 None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:06.208432 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6167db91-9d18-4a8e-a7f1-78ed50892362 None admin] PATH_INFO: `/v3/users/1c5fe246fb4b40c08d0ad5ddecdeccb4` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:06.211308 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6167db91-9d18-4a8e-a7f1-78ed50892362 None admin] RBAC: Authorizing `identity:get_user(user_id=1c5fe246fb4b40c08d0ad5ddecdeccb4)` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:27:06.211458 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:27:06.213213 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6167db91-9d18-4a8e-a7f1-78ed50892362 None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:27:06.216655 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 77/152] 10.222.0.67 () {56 vars in 1177 bytes} [Wed May 25 14:27:05 2022] GET /identity/v3/users/1c5fe246fb4b40c08d0ad5ddecdeccb4 => generated 289 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:27:06.224114 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6167db91-9d18-4a8e-a7f1-78ed50892362 None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:27:06.278951 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce19729b-2b52-4d18-be50-817ed5598ebe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:27:06.280333 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce19729b-2b52-4d18-be50-817ed5598ebe None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:06.282044 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce19729b-2b52-4d18-be50-817ed5598ebe None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:06.282498 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce19729b-2b52-4d18-be50-817ed5598ebe None admin] PATH_INFO: `/v3/users/be354bf3692549b095099e6268f938f3` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:06.291023 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce19729b-2b52-4d18-be50-817ed5598ebe None admin] RBAC: Authorizing `identity:get_user(user_id=be354bf3692549b095099e6268f938f3)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:27:06.293276 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce19729b-2b52-4d18-be50-817ed5598ebe None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:27:06.298418 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 76/153] 10.222.0.67 () {56 vars in 1177 bytes} [Wed May 25 14:27:05 2022] GET /identity/v3/users/be354bf3692549b095099e6268f938f3 => generated 247 bytes in 330 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:27:06.300214 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce19729b-2b52-4d18-be50-817ed5598ebe None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:27:06.367657 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:27:06.437417 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6167db91-9d18-4a8e-a7f1-78ed50892362 None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:27:06.482873 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b0b668-e4a3-47d6-a30a-95fc0aa2ea84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:27:06.483788 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b0b668-e4a3-47d6-a30a-95fc0aa2ea84 None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:06.484173 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b0b668-e4a3-47d6-a30a-95fc0aa2ea84 None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:06.484458 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b0b668-e4a3-47d6-a30a-95fc0aa2ea84 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:06.501351 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b0b668-e4a3-47d6-a30a-95fc0aa2ea84 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:27:06.519499 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application [None req-72b0b668-e4a3-47d6-a30a-95fc0aa2ea84 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 25 14:27:06.519499 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:27:06.519499 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:27:06.519499 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:27:06.519499 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:27:06.519499 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:27:06.519499 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:27:06.519499 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:27:06.519499 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:27:06.519499 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:27:06.519499 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:27:06.519499 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:27:06.519499 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:27:06.519499 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:27:06.519499 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:27:06.519499 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:27:06.520566 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:27:06.520566 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:27:06.520566 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:27:06.520566 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:27:06.520566 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:27:06.520566 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:27:06.520566 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:27:06.520566 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:27:06.520566 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:27:06.520566 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:27:06.520566 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:27:06.520566 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application with Lock( May 25 14:27:06.520566 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:27:06.520566 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self._enter() May 25 14:27:06.520566 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:27:06.520566 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:27:06.521685 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:27:06.521685 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.creator() May 25 14:27:06.521685 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:27:06.521685 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application created_value = creator( May 25 14:27:06.521685 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:27:06.521685 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:27:06.521685 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:27:06.521685 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:27:06.521685 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:27:06.521685 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:27:06.521685 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 25 14:27:06.521685 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application May 25 14:27:06.521685 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 78/154] 10.222.0.67 () {56 vars in 1099 bytes} [Wed May 25 14:27:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:27:06.521685 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b0b668-e4a3-47d6-a30a-95fc0aa2ea84 None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:27:06.573879 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce19729b-2b52-4d18-be50-817ed5598ebe None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:27:06.646719 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14923f56-08be-4d92-b136-55981c5c66bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:27:06.647878 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14923f56-08be-4d92-b136-55981c5c66bc None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:06.648318 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14923f56-08be-4d92-b136-55981c5c66bc None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:06.648730 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14923f56-08be-4d92-b136-55981c5c66bc None admin] PATH_INFO: `/v3/projects/652aa39dec91415abc8e6c301800eb00` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:06.648838 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b0b668-e4a3-47d6-a30a-95fc0aa2ea84 None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:27:06.650259 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14923f56-08be-4d92-b136-55981c5c66bc None admin] RBAC: Authorizing `identity:get_project(project_id=652aa39dec91415abc8e6c301800eb00)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:27:06.652015 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14923f56-08be-4d92-b136-55981c5c66bc None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:27:06.659016 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 77/155] 10.222.0.67 () {56 vars in 1186 bytes} [Wed May 25 14:27:06 2022] GET /identity/v3/projects/652aa39dec91415abc8e6c301800eb00 => generated 298 bytes in 354 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:27:06.660798 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4623a235-f982-4ffa-b532-883ef0f722b6 None None] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:06.661226 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4623a235-f982-4ffa-b532-883ef0f722b6 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:06.661642 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4623a235-f982-4ffa-b532-883ef0f722b6 None None] PATH_INFO: `/` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:06.663138 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 78/156] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 14:27:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:27:06.664074 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4623a235-f982-4ffa-b532-883ef0f722b6 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:27:06.680427 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:27:06.714021 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c866c98f-b15d-44ad-8a89-7e8faa446480 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:27:06.714963 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c866c98f-b15d-44ad-8a89-7e8faa446480 None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:06.715397 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c866c98f-b15d-44ad-8a89-7e8faa446480 None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:06.715895 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c866c98f-b15d-44ad-8a89-7e8faa446480 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:06.774547 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:27:06.803738 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c866c98f-b15d-44ad-8a89-7e8faa446480 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:27:06.805780 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c866c98f-b15d-44ad-8a89-7e8faa446480 None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:27:06.899056 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4623a235-f982-4ffa-b532-883ef0f722b6 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:27:06.954361 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 79/157] 10.222.0.67 () {58 vars in 1282 bytes} [Wed May 25 14:27:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 431 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 14:27:06.956043 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb1259f-8533-487e-a7c6-e43dd89b4aab None None] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:06.959367 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb1259f-8533-487e-a7c6-e43dd89b4aab None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:06.959898 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb1259f-8533-487e-a7c6-e43dd89b4aab None None] PATH_INFO: `/` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:06.961891 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 80/158] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 14:27:06 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:27:06.964086 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb1259f-8533-487e-a7c6-e43dd89b4aab None None] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:27:06.964879 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627c7439-0507-4be1-ae58-47287ae797f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:27:06.966119 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627c7439-0507-4be1-ae58-47287ae797f9 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:06.967033 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627c7439-0507-4be1-ae58-47287ae797f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:06.970243 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627c7439-0507-4be1-ae58-47287ae797f9 None admin] PATH_INFO: `/v3/roles` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:06.971275 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627c7439-0507-4be1-ae58-47287ae797f9 None admin] RBAC: Adding query filter params (name=member) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:27:06.971789 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627c7439-0507-4be1-ae58-47287ae797f9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:27:06.973369 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627c7439-0507-4be1-ae58-47287ae797f9 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:27:06.991232 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 79/159] 10.222.0.67 () {56 vars in 1101 bytes} [Wed May 25 14:27:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:27:06.993451 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb88fd5b-b178-48bd-b598-e9c52893dc28 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:06.994126 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb88fd5b-b178-48bd-b598-e9c52893dc28 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:06.996259 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb88fd5b-b178-48bd-b598-e9c52893dc28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:07.019372 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:27:07.026906 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-fb88fd5b-b178-48bd-b598-e9c52893dc28 None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:27:07.029066 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-fb88fd5b-b178-48bd-b598-e9c52893dc28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:27:07.122172 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 80/160] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 14:27:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 14:27:07.123460 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb88fd5b-b178-48bd-b598-e9c52893dc28 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:27:07.167458 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:27:07.189382 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb1259f-8533-487e-a7c6-e43dd89b4aab None None] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:27:07.235556 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb88fd5b-b178-48bd-b598-e9c52893dc28 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:27:07.273425 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84eacfa1-8445-4470-b9ba-f425f21242e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:27:07.274677 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84eacfa1-8445-4470-b9ba-f425f21242e4 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:07.275196 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84eacfa1-8445-4470-b9ba-f425f21242e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:07.275735 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84eacfa1-8445-4470-b9ba-f425f21242e4 None admin] PATH_INFO: `/v3/projects/652aa39dec91415abc8e6c301800eb00` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:07.277340 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84eacfa1-8445-4470-b9ba-f425f21242e4 None admin] RBAC: Authorizing `identity:get_project(project_id=652aa39dec91415abc8e6c301800eb00)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:27:07.279039 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84eacfa1-8445-4470-b9ba-f425f21242e4 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:27:07.281835 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 81/161] 10.222.0.67 () {56 vars in 1186 bytes} [Wed May 25 14:27:07 2022] GET /identity/v3/projects/652aa39dec91415abc8e6c301800eb00 => generated 298 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:27:07.283396 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb09faf-11fc-4cb4-bd83-85566d0109c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:27:07.283751 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a488b40-f1dd-4cbb-aa82-97da1b9aa71e None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:07.284274 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a488b40-f1dd-4cbb-aa82-97da1b9aa71e None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:07.284374 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb09faf-11fc-4cb4-bd83-85566d0109c4 None admin] REQUEST_METHOD: `PUT` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:07.284624 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb09faf-11fc-4cb4-bd83-85566d0109c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:07.284841 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb09faf-11fc-4cb4-bd83-85566d0109c4 None admin] PATH_INFO: `/v3/projects/652aa39dec91415abc8e6c301800eb00/users/1c5fe246fb4b40c08d0ad5ddecdeccb4/roles/ed5296b21eba4c49b7792056991162da` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:07.285310 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a488b40-f1dd-4cbb-aa82-97da1b9aa71e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:07.292454 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb09faf-11fc-4cb4-bd83-85566d0109c4 None admin] RBAC: Authorizing `identity:create_grant(project_id=652aa39dec91415abc8e6c301800eb00, user_id=1c5fe246fb4b40c08d0ad5ddecdeccb4, role_id=ed5296b21eba4c49b7792056991162da)` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:27:07.293374 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb09faf-11fc-4cb4-bd83-85566d0109c4 None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:27:07.304512 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-0a488b40-f1dd-4cbb-aa82-97da1b9aa71e None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:27:07.306042 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-0a488b40-f1dd-4cbb-aa82-97da1b9aa71e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:27:07.329160 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 81/162] 10.222.0.67 () {58 vars in 1439 bytes} [Wed May 25 14:27:06 2022] PUT /identity/v3/projects/652aa39dec91415abc8e6c301800eb00/users/1c5fe246fb4b40c08d0ad5ddecdeccb4/roles/ed5296b21eba4c49b7792056991162da => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:27:07.330190 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb09faf-11fc-4cb4-bd83-85566d0109c4 None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:27:07.384228 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 82/163] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 14:27:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 14:27:07.385366 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a488b40-f1dd-4cbb-aa82-97da1b9aa71e None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:27:07.425198 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:27:07.443936 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:27:07.467717 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb09faf-11fc-4cb4-bd83-85566d0109c4 None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:27:07.499958 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a488b40-f1dd-4cbb-aa82-97da1b9aa71e None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:27:07.508417 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5add41-b53e-450e-8b7f-330ce1f7d8aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:27:07.509639 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5add41-b53e-450e-8b7f-330ce1f7d8aa None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:07.510175 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5add41-b53e-450e-8b7f-330ce1f7d8aa None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:07.510652 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5add41-b53e-450e-8b7f-330ce1f7d8aa None admin] PATH_INFO: `/v3/users/57a4a797d2d54ecd9eeb8857c043b617` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:07.512214 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5add41-b53e-450e-8b7f-330ce1f7d8aa None admin] RBAC: Authorizing `identity:get_user(user_id=57a4a797d2d54ecd9eeb8857c043b617)` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:27:07.513875 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5add41-b53e-450e-8b7f-330ce1f7d8aa None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:27:07.516457 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 82/164] 10.222.0.67 () {56 vars in 1177 bytes} [Wed May 25 14:27:07 2022] GET /identity/v3/users/57a4a797d2d54ecd9eeb8857c043b617 => generated 275 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:27:07.517647 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5add41-b53e-450e-8b7f-330ce1f7d8aa None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:27:07.540897 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad588cc-d39c-43a2-9054-b892538c7314 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:27:07.541784 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad588cc-d39c-43a2-9054-b892538c7314 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:07.542118 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad588cc-d39c-43a2-9054-b892538c7314 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:07.542400 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad588cc-d39c-43a2-9054-b892538c7314 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:07.555526 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad588cc-d39c-43a2-9054-b892538c7314 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:27:07.565034 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application [None req-bad588cc-d39c-43a2-9054-b892538c7314 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 14:27:07.565034 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:27:07.565034 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:27:07.565034 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:27:07.565034 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:27:07.565034 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:27:07.565034 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:27:07.565034 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:27:07.565034 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:27:07.565034 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:27:07.565034 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:27:07.565034 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:27:07.565034 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:27:07.565034 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:27:07.565034 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:27:07.565034 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:27:07.565975 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:27:07.565975 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:27:07.565975 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:27:07.565975 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:27:07.565975 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:27:07.565975 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:27:07.565975 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:27:07.565975 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:27:07.565975 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:27:07.565975 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:27:07.565975 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:27:07.565975 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application with Lock( May 25 14:27:07.565975 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:27:07.565975 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._enter() May 25 14:27:07.565975 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:27:07.565975 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:27:07.567227 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:27:07.567227 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.creator() May 25 14:27:07.567227 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:27:07.567227 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application created_value = creator( May 25 14:27:07.567227 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:27:07.567227 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:27:07.567227 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:27:07.567227 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:27:07.567227 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:27:07.567227 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:27:07.567227 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 14:27:07.567227 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:27:07.567227 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 83/165] 10.222.0.67 () {56 vars in 1114 bytes} [Wed May 25 14:27:07 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:27:07.567227 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad588cc-d39c-43a2-9054-b892538c7314 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:27:07.638719 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5add41-b53e-450e-8b7f-330ce1f7d8aa None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:27:07.675704 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:27:07.679189 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71851c10-0e38-4caf-856f-d744cdcef252 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:27:07.680107 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71851c10-0e38-4caf-856f-d744cdcef252 None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:07.680596 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71851c10-0e38-4caf-856f-d744cdcef252 None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:07.681104 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71851c10-0e38-4caf-856f-d744cdcef252 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:07.682254 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71851c10-0e38-4caf-856f-d744cdcef252 None admin] RBAC: Adding query filter params (role.id=399893e19eac4ab5a8e596f7c07be13c, scope.project.id=652aa39dec91415abc8e6c301800eb00, user.id=be354bf3692549b095099e6268f938f3) {{(pid=80474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:27:07.682764 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad588cc-d39c-43a2-9054-b892538c7314 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:27:07.683024 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71851c10-0e38-4caf-856f-d744cdcef252 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:27:07.684783 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71851c10-0e38-4caf-856f-d744cdcef252 None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:27:07.693657 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 83/166] 10.222.0.67 () {56 vars in 1374 bytes} [Wed May 25 14:27:07 2022] GET /identity/v3/role_assignments?user.id=be354bf3692549b095099e6268f938f3&scope.project.id=652aa39dec91415abc8e6c301800eb00&role.id=399893e19eac4ab5a8e596f7c07be13c => generated 608 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:27:07.695069 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71851c10-0e38-4caf-856f-d744cdcef252 None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:27:07.719255 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:27:07.722810 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2eec80-d6a5-4fa7-a55b-6d78a13daf4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:27:07.723764 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2eec80-d6a5-4fa7-a55b-6d78a13daf4f None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:07.724352 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2eec80-d6a5-4fa7-a55b-6d78a13daf4f None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:07.724446 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2eec80-d6a5-4fa7-a55b-6d78a13daf4f None admin] PATH_INFO: `/v3/roles/member` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:07.736995 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2eec80-d6a5-4fa7-a55b-6d78a13daf4f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:27:07.745847 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application [None req-fb2eec80-d6a5-4fa7-a55b-6d78a13daf4f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 25 14:27:07.745847 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:27:07.745847 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:27:07.745847 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:27:07.745847 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:27:07.745847 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:27:07.745847 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:27:07.745847 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:27:07.745847 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:27:07.745847 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:27:07.745847 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:27:07.745847 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:27:07.745847 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:27:07.745847 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:27:07.745847 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:27:07.745847 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:27:07.746833 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:27:07.746833 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:27:07.746833 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:27:07.746833 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:27:07.746833 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:27:07.746833 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:27:07.746833 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:27:07.746833 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:27:07.746833 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:27:07.746833 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:27:07.746833 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:27:07.746833 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application with Lock( May 25 14:27:07.746833 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:27:07.746833 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._enter() May 25 14:27:07.746833 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:27:07.746833 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:27:07.748319 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:27:07.748319 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.creator() May 25 14:27:07.748319 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:27:07.748319 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application created_value = creator( May 25 14:27:07.748319 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:27:07.748319 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:27:07.748319 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:27:07.748319 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:27:07.748319 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:27:07.748319 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:27:07.748319 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 25 14:27:07.748319 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:27:07.748319 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 84/167] 10.222.0.67 () {56 vars in 1099 bytes} [Wed May 25 14:27:07 2022] GET /identity/v3/roles/member => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:27:07.748319 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2eec80-d6a5-4fa7-a55b-6d78a13daf4f None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:27:07.829940 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71851c10-0e38-4caf-856f-d744cdcef252 None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:27:07.872163 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091e151e-9003-4456-92ee-f0174839b2e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:27:07.873341 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091e151e-9003-4456-92ee-f0174839b2e4 None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:07.873839 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091e151e-9003-4456-92ee-f0174839b2e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:07.874447 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091e151e-9003-4456-92ee-f0174839b2e4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:07.884315 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2eec80-d6a5-4fa7-a55b-6d78a13daf4f None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:27:07.923524 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807dcda6-93fa-46d4-9b3f-ca48a0d40349 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:27:07.924146 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807dcda6-93fa-46d4-9b3f-ca48a0d40349 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:07.924430 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807dcda6-93fa-46d4-9b3f-ca48a0d40349 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:07.924707 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807dcda6-93fa-46d4-9b3f-ca48a0d40349 None admin] PATH_INFO: `/v3/roles` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:07.925481 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807dcda6-93fa-46d4-9b3f-ca48a0d40349 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:27:07.925793 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807dcda6-93fa-46d4-9b3f-ca48a0d40349 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:27:07.927273 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807dcda6-93fa-46d4-9b3f-ca48a0d40349 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:27:07.936320 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 85/168] 10.222.0.67 () {56 vars in 1111 bytes} [Wed May 25 14:27:07 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:27:07.937301 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807dcda6-93fa-46d4-9b3f-ca48a0d40349 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:27:07.957925 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:27:07.959904 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091e151e-9003-4456-92ee-f0174839b2e4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:27:07.962013 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091e151e-9003-4456-92ee-f0174839b2e4 None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:27:07.979819 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:27:08.049305 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807dcda6-93fa-46d4-9b3f-ca48a0d40349 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:27:08.084663 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 84/169] 10.222.0.67 () {58 vars in 1282 bytes} [Wed May 25 14:27:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 14:27:08.086005 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091e151e-9003-4456-92ee-f0174839b2e4 None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:27:08.087483 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd963eb-d878-4415-90ec-68e8ab902c96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:27:08.088207 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd963eb-d878-4415-90ec-68e8ab902c96 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:08.088496 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd963eb-d878-4415-90ec-68e8ab902c96 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:08.088771 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd963eb-d878-4415-90ec-68e8ab902c96 None admin] PATH_INFO: `/v3/roles` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:08.089520 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd963eb-d878-4415-90ec-68e8ab902c96 None admin] RBAC: Adding query filter params (name=member) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:27:08.089987 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd963eb-d878-4415-90ec-68e8ab902c96 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:27:08.091828 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd963eb-d878-4415-90ec-68e8ab902c96 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:27:08.100867 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 86/170] 10.222.0.67 () {56 vars in 1101 bytes} [Wed May 25 14:27:07 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:27:08.101769 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd963eb-d878-4415-90ec-68e8ab902c96 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:27:08.190319 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:27:08.205585 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091e151e-9003-4456-92ee-f0174839b2e4 None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:27:08.213701 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd963eb-d878-4415-90ec-68e8ab902c96 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:27:08.221518 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:27:08.247200 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd8792c-b70f-459e-879c-5153911d4585 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:27:08.248581 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd8792c-b70f-459e-879c-5153911d4585 None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:08.249167 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd8792c-b70f-459e-879c-5153911d4585 None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:08.250289 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd8792c-b70f-459e-879c-5153911d4585 None admin] PATH_INFO: `/v3/users/57a4a797d2d54ecd9eeb8857c043b617` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:08.251744 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd8792c-b70f-459e-879c-5153911d4585 None admin] RBAC: Authorizing `identity:get_user(user_id=57a4a797d2d54ecd9eeb8857c043b617)` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:27:08.253417 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd8792c-b70f-459e-879c-5153911d4585 None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:27:08.253676 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ca4bc7-1969-4670-abf6-e175e8cf3277 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:27:08.254555 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ca4bc7-1969-4670-abf6-e175e8cf3277 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:08.254837 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ca4bc7-1969-4670-abf6-e175e8cf3277 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:08.255174 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ca4bc7-1969-4670-abf6-e175e8cf3277 None admin] PATH_INFO: `/v3/projects/652aa39dec91415abc8e6c301800eb00` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:08.256369 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ca4bc7-1969-4670-abf6-e175e8cf3277 None admin] RBAC: Authorizing `identity:get_project(project_id=652aa39dec91415abc8e6c301800eb00)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:27:08.256760 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 85/171] 10.222.0.67 () {56 vars in 1177 bytes} [Wed May 25 14:27:08 2022] GET /identity/v3/users/57a4a797d2d54ecd9eeb8857c043b617 => generated 275 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:27:08.257869 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd8792c-b70f-459e-879c-5153911d4585 None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:27:08.258174 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ca4bc7-1969-4670-abf6-e175e8cf3277 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:27:08.260147 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 87/172] 10.222.0.67 () {56 vars in 1186 bytes} [Wed May 25 14:27:08 2022] GET /identity/v3/projects/652aa39dec91415abc8e6c301800eb00 => generated 298 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:27:08.264601 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ca4bc7-1969-4670-abf6-e175e8cf3277 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:27:08.379020 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ca4bc7-1969-4670-abf6-e175e8cf3277 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:27:08.380179 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd8792c-b70f-459e-879c-5153911d4585 None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:27:08.414930 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d9cb29-ea11-4239-bc4e-df9f022deef0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:27:08.415621 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d9cb29-ea11-4239-bc4e-df9f022deef0 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:08.415908 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d9cb29-ea11-4239-bc4e-df9f022deef0 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:08.416263 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d9cb29-ea11-4239-bc4e-df9f022deef0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:08.420450 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1639a1b-467a-43ff-9775-4739af62ef3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:27:08.422158 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1639a1b-467a-43ff-9775-4739af62ef3d None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:08.422651 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1639a1b-467a-43ff-9775-4739af62ef3d None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:08.423164 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1639a1b-467a-43ff-9775-4739af62ef3d None admin] PATH_INFO: `/v3/users/57a4a797d2d54ecd9eeb8857c043b617` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:08.424645 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1639a1b-467a-43ff-9775-4739af62ef3d None admin] RBAC: Authorizing `identity:get_user(user_id=57a4a797d2d54ecd9eeb8857c043b617)` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:27:08.426316 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1639a1b-467a-43ff-9775-4739af62ef3d None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:27:08.428789 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 86/173] 10.222.0.67 () {56 vars in 1177 bytes} [Wed May 25 14:27:08 2022] GET /identity/v3/users/57a4a797d2d54ecd9eeb8857c043b617 => generated 275 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:27:08.430406 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be8bf11-1dbb-4553-9532-68b4f8666640 None None] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:08.430898 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be8bf11-1dbb-4553-9532-68b4f8666640 None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:08.431419 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be8bf11-1dbb-4553-9532-68b4f8666640 None None] PATH_INFO: `/` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:08.433318 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 87/174] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 14:27:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:27:08.434347 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be8bf11-1dbb-4553-9532-68b4f8666640 None None] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:27:08.436568 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:27:08.492791 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d9cb29-ea11-4239-bc4e-df9f022deef0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:27:08.494196 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d9cb29-ea11-4239-bc4e-df9f022deef0 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:27:08.498951 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:27:08.564520 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be8bf11-1dbb-4553-9532-68b4f8666640 None None] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:27:08.603016 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 88/175] 10.222.0.67 () {58 vars in 1282 bytes} [Wed May 25 14:27:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 14:27:08.603745 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d9cb29-ea11-4239-bc4e-df9f022deef0 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:27:08.605521 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb38e97b-4798-4744-b36d-3638cda07f06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:27:08.606577 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb38e97b-4798-4744-b36d-3638cda07f06 None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:08.607212 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb38e97b-4798-4744-b36d-3638cda07f06 None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:08.607696 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb38e97b-4798-4744-b36d-3638cda07f06 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:08.609389 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb38e97b-4798-4744-b36d-3638cda07f06 None admin] RBAC: Adding query filter params (role.id=48808901834b4d5eab2c7e6b5b03791e, scope.project.id=652aa39dec91415abc8e6c301800eb00, user.id=57a4a797d2d54ecd9eeb8857c043b617) {{(pid=80474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:27:08.609949 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb38e97b-4798-4744-b36d-3638cda07f06 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:27:08.611822 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb38e97b-4798-4744-b36d-3638cda07f06 None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:27:08.619095 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 88/176] 10.222.0.67 () {56 vars in 1374 bytes} [Wed May 25 14:27:08 2022] GET /identity/v3/role_assignments?user.id=57a4a797d2d54ecd9eeb8857c043b617&scope.project.id=652aa39dec91415abc8e6c301800eb00&role.id=48808901834b4d5eab2c7e6b5b03791e => generated 608 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:27:08.621148 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96becc4-5ab9-4371-bb7d-4b87524ce24d None None] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:08.621643 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96becc4-5ab9-4371-bb7d-4b87524ce24d None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:08.622173 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96becc4-5ab9-4371-bb7d-4b87524ce24d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:08.643822 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.auth.core [None req-e96becc4-5ab9-4371-bb7d-4b87524ce24d None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:27:08.645460 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-e96becc4-5ab9-4371-bb7d-4b87524ce24d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:27:08.677398 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:27:08.733467 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 89/177] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 14:27:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 14:27:08.735070 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96becc4-5ab9-4371-bb7d-4b87524ce24d None None] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:27:08.784027 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d9cb29-ea11-4239-bc4e-df9f022deef0 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:27:08.792698 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:27:08.863692 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96becc4-5ab9-4371-bb7d-4b87524ce24d None None] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:27:08.904126 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27e34ff-2af0-4971-8abc-013b522e6888 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:27:08.905391 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27e34ff-2af0-4971-8abc-013b522e6888 None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:08.906730 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27e34ff-2af0-4971-8abc-013b522e6888 None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:08.907298 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27e34ff-2af0-4971-8abc-013b522e6888 None admin] PATH_INFO: `/v3/projects/652aa39dec91415abc8e6c301800eb00` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:08.908819 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27e34ff-2af0-4971-8abc-013b522e6888 None admin] RBAC: Authorizing `identity:get_project(project_id=652aa39dec91415abc8e6c301800eb00)` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:27:08.910539 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27e34ff-2af0-4971-8abc-013b522e6888 None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:27:08.912565 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 90/178] 10.222.0.67 () {56 vars in 1186 bytes} [Wed May 25 14:27:08 2022] GET /identity/v3/projects/652aa39dec91415abc8e6c301800eb00 => generated 298 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:27:08.913782 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27e34ff-2af0-4971-8abc-013b522e6888 None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:27:08.951723 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954a0e55-0bab-4eb4-9b20-3480de55225f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:27:08.952445 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954a0e55-0bab-4eb4-9b20-3480de55225f None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:08.953280 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954a0e55-0bab-4eb4-9b20-3480de55225f None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:08.953541 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954a0e55-0bab-4eb4-9b20-3480de55225f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:09.033691 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27e34ff-2af0-4971-8abc-013b522e6888 None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:27:09.051727 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:27:09.090576 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b319d4ca-6a4a-4315-9168-dea4e8ccd941 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:27:09.091480 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b319d4ca-6a4a-4315-9168-dea4e8ccd941 None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:09.091768 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b319d4ca-6a4a-4315-9168-dea4e8ccd941 None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:09.092045 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b319d4ca-6a4a-4315-9168-dea4e8ccd941 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:09.103708 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954a0e55-0bab-4eb4-9b20-3480de55225f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:27:09.104032 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b319d4ca-6a4a-4315-9168-dea4e8ccd941 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:27:09.105697 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954a0e55-0bab-4eb4-9b20-3480de55225f None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:27:09.112666 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application [None req-b319d4ca-6a4a-4315-9168-dea4e8ccd941 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 14:27:09.112666 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:27:09.112666 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:27:09.112666 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:27:09.112666 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:27:09.112666 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:27:09.112666 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:27:09.112666 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:27:09.112666 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:27:09.112666 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:27:09.112666 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:27:09.112666 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:27:09.112666 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:27:09.112666 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:27:09.112666 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:27:09.112666 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:27:09.113614 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:27:09.113614 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:27:09.113614 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:27:09.113614 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:27:09.113614 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:27:09.113614 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:27:09.113614 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:27:09.113614 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:27:09.113614 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:27:09.113614 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:27:09.113614 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:27:09.113614 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application with Lock( May 25 14:27:09.113614 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:27:09.113614 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self._enter() May 25 14:27:09.113614 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:27:09.113614 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:27:09.114442 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:27:09.114442 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.creator() May 25 14:27:09.114442 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:27:09.114442 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application created_value = creator( May 25 14:27:09.114442 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:27:09.114442 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:27:09.114442 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:27:09.114442 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:27:09.114442 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:27:09.114442 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:27:09.114442 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 14:27:09.114442 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application May 25 14:27:09.114442 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 91/179] 10.222.0.67 () {56 vars in 1096 bytes} [Wed May 25 14:27:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:27:09.115133 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b319d4ca-6a4a-4315-9168-dea4e8ccd941 None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:27:09.180530 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:27:09.231097 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b319d4ca-6a4a-4315-9168-dea4e8ccd941 None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:27:09.249036 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 89/180] 10.222.0.67 () {58 vars in 1282 bytes} [Wed May 25 14:27:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 645 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 14:27:09.251039 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495ebec6-bfef-4083-afa4-7882057429ef None None] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:09.251150 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495ebec6-bfef-4083-afa4-7882057429ef None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:09.251520 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495ebec6-bfef-4083-afa4-7882057429ef None None] PATH_INFO: `/` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:09.253026 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 90/181] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 14:27:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:27:09.253954 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495ebec6-bfef-4083-afa4-7882057429ef None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:27:09.276402 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c28acd-bf5f-4e3c-a662-90999891a432 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:27:09.277140 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c28acd-bf5f-4e3c-a662-90999891a432 None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:09.277698 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c28acd-bf5f-4e3c-a662-90999891a432 None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:09.277698 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c28acd-bf5f-4e3c-a662-90999891a432 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:09.280248 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c28acd-bf5f-4e3c-a662-90999891a432 None admin] RBAC: Adding query filter params (role.id=3e87d9311f1d411395a3fcd41ac81431, scope.project.id=652aa39dec91415abc8e6c301800eb00, user.id=57a4a797d2d54ecd9eeb8857c043b617) {{(pid=80474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:27:09.281211 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c28acd-bf5f-4e3c-a662-90999891a432 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:27:09.282682 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c28acd-bf5f-4e3c-a662-90999891a432 None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:27:09.291267 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 92/182] 10.222.0.67 () {56 vars in 1374 bytes} [Wed May 25 14:27:09 2022] GET /identity/v3/role_assignments?user.id=57a4a797d2d54ecd9eeb8857c043b617&scope.project.id=652aa39dec91415abc8e6c301800eb00&role.id=3e87d9311f1d411395a3fcd41ac81431 => generated 608 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:27:09.295029 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c28acd-bf5f-4e3c-a662-90999891a432 None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:27:09.356335 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:27:09.400056 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495ebec6-bfef-4083-afa4-7882057429ef None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:27:09.438854 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c28acd-bf5f-4e3c-a662-90999891a432 None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:27:09.458361 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671fad93-e7e8-48b8-af5f-3629faed9171 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:27:09.459907 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671fad93-e7e8-48b8-af5f-3629faed9171 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:09.460438 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671fad93-e7e8-48b8-af5f-3629faed9171 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:09.460935 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671fad93-e7e8-48b8-af5f-3629faed9171 None admin] PATH_INFO: `/v3/roles` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:09.461916 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671fad93-e7e8-48b8-af5f-3629faed9171 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:27:09.463091 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671fad93-e7e8-48b8-af5f-3629faed9171 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:27:09.465062 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671fad93-e7e8-48b8-af5f-3629faed9171 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:27:09.480757 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 91/183] 10.222.0.67 () {56 vars in 1099 bytes} [Wed May 25 14:27:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:27:09.483622 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234a2aea-d0c5-4d32-b108-5207a6cdc992 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:09.484610 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99ca47c-412c-4051-a4e4-d217f790cd3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:27:09.485758 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99ca47c-412c-4051-a4e4-d217f790cd3e None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:09.486054 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99ca47c-412c-4051-a4e4-d217f790cd3e None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:09.486339 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99ca47c-412c-4051-a4e4-d217f790cd3e None admin] PATH_INFO: `/v3/projects/e93e9593aa734bcb9e7dbfa9bfdc6485` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:09.486441 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234a2aea-d0c5-4d32-b108-5207a6cdc992 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:09.487041 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234a2aea-d0c5-4d32-b108-5207a6cdc992 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:09.487742 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99ca47c-412c-4051-a4e4-d217f790cd3e None admin] RBAC: Authorizing `identity:get_project(project_id=e93e9593aa734bcb9e7dbfa9bfdc6485)` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:27:09.489373 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99ca47c-412c-4051-a4e4-d217f790cd3e None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:27:09.491773 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 93/184] 10.222.0.67 () {56 vars in 1186 bytes} [Wed May 25 14:27:09 2022] GET /identity/v3/projects/e93e9593aa734bcb9e7dbfa9bfdc6485 => generated 312 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:27:09.493467 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc832c51-7b4e-4e44-b2dc-337a64c4b4e4 None None] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:09.493796 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc832c51-7b4e-4e44-b2dc-337a64c4b4e4 None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:09.494094 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc832c51-7b4e-4e44-b2dc-337a64c4b4e4 None None] PATH_INFO: `/` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:09.496008 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 94/185] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 14:27:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:27:09.496888 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc832c51-7b4e-4e44-b2dc-337a64c4b4e4 None None] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:27:09.511348 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-234a2aea-d0c5-4d32-b108-5207a6cdc992 None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:27:09.513651 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-234a2aea-d0c5-4d32-b108-5207a6cdc992 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:27:09.518634 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:27:09.602736 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 92/186] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 14:27:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 14:27:09.603614 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234a2aea-d0c5-4d32-b108-5207a6cdc992 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:27:09.629624 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc832c51-7b4e-4e44-b2dc-337a64c4b4e4 None None] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:27:09.631350 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:27:09.674644 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05097e0-1887-4fbc-8d9f-901598dd8657 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:27:09.675560 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05097e0-1887-4fbc-8d9f-901598dd8657 None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:09.675847 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05097e0-1887-4fbc-8d9f-901598dd8657 None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:09.676184 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05097e0-1887-4fbc-8d9f-901598dd8657 None admin] PATH_INFO: `/v3/users/6b9da0b8d0bc4102afc327021c50d55e` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:09.691104 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05097e0-1887-4fbc-8d9f-901598dd8657 None admin] RBAC: Authorizing `identity:get_user(user_id=6b9da0b8d0bc4102afc327021c50d55e)` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:27:09.692882 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05097e0-1887-4fbc-8d9f-901598dd8657 None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:27:09.694635 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 95/187] 10.222.0.67 () {56 vars in 1177 bytes} [Wed May 25 14:27:09 2022] GET /identity/v3/users/6b9da0b8d0bc4102afc327021c50d55e => generated 283 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:27:09.695995 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352be69a-8cd8-4370-891c-7081b4182685 None None] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:09.696283 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352be69a-8cd8-4370-891c-7081b4182685 None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:09.696560 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352be69a-8cd8-4370-891c-7081b4182685 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:09.713393 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.auth.core [None req-352be69a-8cd8-4370-891c-7081b4182685 None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:27:09.714677 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-352be69a-8cd8-4370-891c-7081b4182685 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:27:09.718523 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234a2aea-d0c5-4d32-b108-5207a6cdc992 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:27:09.755364 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d871c2a-7cc8-48d8-a214-070cecbd5dcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:27:09.756026 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d871c2a-7cc8-48d8-a214-070cecbd5dcf None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:09.756318 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d871c2a-7cc8-48d8-a214-070cecbd5dcf None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:09.756596 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d871c2a-7cc8-48d8-a214-070cecbd5dcf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:09.757432 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d871c2a-7cc8-48d8-a214-070cecbd5dcf None admin] RBAC: Adding query filter params (role.id=48808901834b4d5eab2c7e6b5b03791e, scope.project.id=e93e9593aa734bcb9e7dbfa9bfdc6485, user.id=57a4a797d2d54ecd9eeb8857c043b617) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:27:09.757758 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d871c2a-7cc8-48d8-a214-070cecbd5dcf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:27:09.759221 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d871c2a-7cc8-48d8-a214-070cecbd5dcf None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:27:09.765734 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 93/188] 10.222.0.67 () {56 vars in 1374 bytes} [Wed May 25 14:27:09 2022] GET /identity/v3/role_assignments?user.id=57a4a797d2d54ecd9eeb8857c043b617&scope.project.id=e93e9593aa734bcb9e7dbfa9bfdc6485&role.id=48808901834b4d5eab2c7e6b5b03791e => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:27:09.766310 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d871c2a-7cc8-48d8-a214-070cecbd5dcf None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:27:09.770524 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:27:09.804420 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 96/189] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 14:27:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 14:27:09.805649 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352be69a-8cd8-4370-891c-7081b4182685 None None] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:27:09.906037 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d871c2a-7cc8-48d8-a214-070cecbd5dcf None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:27:09.945332 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:27:09.951964 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebeff02-4ae4-4f69-84c9-10d05a0ebab5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:27:09.953461 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebeff02-4ae4-4f69-84c9-10d05a0ebab5 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:09.954214 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebeff02-4ae4-4f69-84c9-10d05a0ebab5 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:09.954930 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebeff02-4ae4-4f69-84c9-10d05a0ebab5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:09.956335 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebeff02-4ae4-4f69-84c9-10d05a0ebab5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:27:09.957566 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352be69a-8cd8-4370-891c-7081b4182685 None None] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:27:09.958638 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebeff02-4ae4-4f69-84c9-10d05a0ebab5 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:27:09.961593 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 94/190] 10.222.0.67 () {56 vars in 1108 bytes} [Wed May 25 14:27:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:27:09.962571 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebeff02-4ae4-4f69-84c9-10d05a0ebab5 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:27:10.010683 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ce3f2d-1627-44a1-8bd1-24540768fbb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:27:10.011397 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ce3f2d-1627-44a1-8bd1-24540768fbb2 None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:10.011684 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ce3f2d-1627-44a1-8bd1-24540768fbb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:10.011962 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ce3f2d-1627-44a1-8bd1-24540768fbb2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:10.063954 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:27:10.098046 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebeff02-4ae4-4f69-84c9-10d05a0ebab5 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:27:10.101172 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ce3f2d-1627-44a1-8bd1-24540768fbb2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:27:10.102656 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ce3f2d-1627-44a1-8bd1-24540768fbb2 None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:27:10.136891 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394bb9be-8c4d-446c-be4c-a52024f9e575 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:27:10.137704 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394bb9be-8c4d-446c-be4c-a52024f9e575 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:10.138076 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394bb9be-8c4d-446c-be4c-a52024f9e575 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:10.138266 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394bb9be-8c4d-446c-be4c-a52024f9e575 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:10.149400 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394bb9be-8c4d-446c-be4c-a52024f9e575 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:27:10.157488 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application [None req-394bb9be-8c4d-446c-be4c-a52024f9e575 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 14:27:10.157488 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:27:10.157488 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:27:10.157488 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:27:10.157488 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:27:10.157488 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:27:10.157488 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:27:10.157488 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:27:10.157488 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:27:10.157488 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:27:10.157488 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:27:10.157488 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:27:10.157488 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:27:10.157488 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:27:10.157488 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:27:10.157488 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:27:10.158377 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:27:10.158377 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:27:10.158377 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:27:10.158377 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:27:10.158377 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:27:10.158377 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:27:10.158377 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:27:10.158377 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:27:10.158377 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:27:10.158377 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:27:10.158377 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:27:10.158377 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application with Lock( May 25 14:27:10.158377 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:27:10.158377 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._enter() May 25 14:27:10.158377 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:27:10.158377 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:27:10.159229 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:27:10.159229 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.creator() May 25 14:27:10.159229 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:27:10.159229 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application created_value = creator( May 25 14:27:10.159229 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:27:10.159229 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:27:10.159229 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:27:10.159229 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:27:10.159229 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:27:10.159229 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:27:10.159229 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 14:27:10.159229 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:27:10.159229 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 95/191] 10.222.0.67 () {56 vars in 1114 bytes} [Wed May 25 14:27:09 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:27:10.159932 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394bb9be-8c4d-446c-be4c-a52024f9e575 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:27:10.204965 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:27:10.216642 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 97/192] 10.222.0.67 () {58 vars in 1282 bytes} [Wed May 25 14:27:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 14:27:10.217456 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ce3f2d-1627-44a1-8bd1-24540768fbb2 None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:27:10.268592 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394bb9be-8c4d-446c-be4c-a52024f9e575 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:27:10.301287 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:27:10.307513 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e282261c-6246-46a4-b562-5211c519c24a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:27:10.308180 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e282261c-6246-46a4-b562-5211c519c24a None admin] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:10.308464 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e282261c-6246-46a4-b562-5211c519c24a None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:10.308741 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e282261c-6246-46a4-b562-5211c519c24a None admin] PATH_INFO: `/v3/users` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:10.309474 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e282261c-6246-46a4-b562-5211c519c24a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:27:10.311148 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e282261c-6246-46a4-b562-5211c519c24a None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:27:10.326694 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ce3f2d-1627-44a1-8bd1-24540768fbb2 None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:27:10.331610 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 96/193] 10.222.0.67 () {60 vars in 1132 bytes} [Wed May 25 14:27:10 2022] POST /identity/v3/users => generated 297 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:27:10.332588 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e282261c-6246-46a4-b562-5211c519c24a None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:27:10.373845 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400935df-836f-41f6-81b2-220ced55e9d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:27:10.374976 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400935df-836f-41f6-81b2-220ced55e9d5 None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:10.375577 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400935df-836f-41f6-81b2-220ced55e9d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:10.375871 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400935df-836f-41f6-81b2-220ced55e9d5 None admin] PATH_INFO: `/v3/roles` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:10.376724 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400935df-836f-41f6-81b2-220ced55e9d5 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:27:10.377048 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400935df-836f-41f6-81b2-220ced55e9d5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:27:10.378638 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400935df-836f-41f6-81b2-220ced55e9d5 None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:27:10.389317 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 98/194] 10.222.0.67 () {56 vars in 1111 bytes} [Wed May 25 14:27:10 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:27:10.395231 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400935df-836f-41f6-81b2-220ced55e9d5 None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:27:10.464694 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:27:10.479792 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e282261c-6246-46a4-b562-5211c519c24a None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:27:10.519135 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a01f41-7d59-40ff-a550-206d94cb61f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:27:10.520142 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a01f41-7d59-40ff-a550-206d94cb61f8 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:10.520499 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a01f41-7d59-40ff-a550-206d94cb61f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:10.520871 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a01f41-7d59-40ff-a550-206d94cb61f8 None admin] PATH_INFO: `/v3/projects/24460f2e7a5e44f19737eed3c6799a16` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:10.523053 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a01f41-7d59-40ff-a550-206d94cb61f8 None admin] RBAC: Authorizing `identity:get_project(project_id=24460f2e7a5e44f19737eed3c6799a16)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:27:10.524629 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a01f41-7d59-40ff-a550-206d94cb61f8 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:27:10.525285 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400935df-836f-41f6-81b2-220ced55e9d5 None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:27:10.526534 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 97/195] 10.222.0.67 () {56 vars in 1186 bytes} [Wed May 25 14:27:10 2022] GET /identity/v3/projects/24460f2e7a5e44f19737eed3c6799a16 => generated 302 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:27:10.533318 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a01f41-7d59-40ff-a550-206d94cb61f8 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:27:10.570423 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67a4005-cf2a-4c01-9f7a-8e7e000480dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:27:10.571359 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67a4005-cf2a-4c01-9f7a-8e7e000480dd None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:10.571626 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67a4005-cf2a-4c01-9f7a-8e7e000480dd None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:10.571901 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67a4005-cf2a-4c01-9f7a-8e7e000480dd None admin] PATH_INFO: `/v3/users/6b9da0b8d0bc4102afc327021c50d55e` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:10.573351 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67a4005-cf2a-4c01-9f7a-8e7e000480dd None admin] RBAC: Authorizing `identity:get_user(user_id=6b9da0b8d0bc4102afc327021c50d55e)` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:27:10.574553 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67a4005-cf2a-4c01-9f7a-8e7e000480dd None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:27:10.576493 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 99/196] 10.222.0.67 () {56 vars in 1177 bytes} [Wed May 25 14:27:10 2022] GET /identity/v3/users/6b9da0b8d0bc4102afc327021c50d55e => generated 283 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:27:10.582755 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67a4005-cf2a-4c01-9f7a-8e7e000480dd None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:27:10.598510 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:27:10.656939 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a01f41-7d59-40ff-a550-206d94cb61f8 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:27:10.700286 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4763f5bd-5a65-457a-892b-992623a3b201 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:27:10.700955 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4763f5bd-5a65-457a-892b-992623a3b201 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:10.701388 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4763f5bd-5a65-457a-892b-992623a3b201 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:10.701674 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4763f5bd-5a65-457a-892b-992623a3b201 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:10.703443 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4763f5bd-5a65-457a-892b-992623a3b201 None admin] RBAC: Adding query filter params (role.id=399893e19eac4ab5a8e596f7c07be13c, scope.project.id=24460f2e7a5e44f19737eed3c6799a16, user.id=6b9da0b8d0bc4102afc327021c50d55e) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:27:10.703730 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4763f5bd-5a65-457a-892b-992623a3b201 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:27:10.705677 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4763f5bd-5a65-457a-892b-992623a3b201 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:27:10.708352 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67a4005-cf2a-4c01-9f7a-8e7e000480dd None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:27:10.714849 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 98/197] 10.222.0.67 () {56 vars in 1374 bytes} [Wed May 25 14:27:10 2022] GET /identity/v3/role_assignments?user.id=6b9da0b8d0bc4102afc327021c50d55e&scope.project.id=24460f2e7a5e44f19737eed3c6799a16&role.id=399893e19eac4ab5a8e596f7c07be13c => generated 259 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:27:10.716195 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca2b14a-2d71-4fb7-b83d-1d9ccdabbbb7 None None] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:10.716484 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca2b14a-2d71-4fb7-b83d-1d9ccdabbbb7 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:10.716767 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca2b14a-2d71-4fb7-b83d-1d9ccdabbbb7 None None] PATH_INFO: `/` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:10.718116 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 99/198] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 14:27:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:27:10.724445 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3152437-f8be-4224-96a7-038845988be2 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:10.724756 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3152437-f8be-4224-96a7-038845988be2 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:10.725195 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3152437-f8be-4224-96a7-038845988be2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:10.745662 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-d3152437-f8be-4224-96a7-038845988be2 None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:27:10.746901 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-d3152437-f8be-4224-96a7-038845988be2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:27:10.749434 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:27:10.759808 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793b30c2-fb48-4115-94ea-aaed9f5bf4c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:27:10.761718 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793b30c2-fb48-4115-94ea-aaed9f5bf4c7 None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:10.761837 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793b30c2-fb48-4115-94ea-aaed9f5bf4c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:10.762047 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793b30c2-fb48-4115-94ea-aaed9f5bf4c7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:10.848648 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 100/199] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 14:27:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 14:27:10.857583 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793b30c2-fb48-4115-94ea-aaed9f5bf4c7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:27:10.860145 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793b30c2-fb48-4115-94ea-aaed9f5bf4c7 None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:27:10.875055 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3152437-f8be-4224-96a7-038845988be2 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:27:10.947409 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:27:10.992666 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 100/200] 10.222.0.67 () {58 vars in 1282 bytes} [Wed May 25 14:27:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 14:27:11.003407 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793b30c2-fb48-4115-94ea-aaed9f5bf4c7 None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:27:11.034030 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:27:11.041130 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3152437-f8be-4224-96a7-038845988be2 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:27:11.123684 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793b30c2-fb48-4115-94ea-aaed9f5bf4c7 None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:27:11.147920 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144453cb-b04a-44bb-b696-4599d8921bf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:27:11.148750 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144453cb-b04a-44bb-b696-4599d8921bf0 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:11.149040 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144453cb-b04a-44bb-b696-4599d8921bf0 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:11.149320 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144453cb-b04a-44bb-b696-4599d8921bf0 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:11.162425 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f35d8f7-6606-4ef6-9aab-2efe562c0e6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:27:11.163544 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f35d8f7-6606-4ef6-9aab-2efe562c0e6f None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:11.163841 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f35d8f7-6606-4ef6-9aab-2efe562c0e6f None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:11.164227 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f35d8f7-6606-4ef6-9aab-2efe562c0e6f None admin] PATH_INFO: `/v3/projects/24460f2e7a5e44f19737eed3c6799a16` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:11.165510 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f35d8f7-6606-4ef6-9aab-2efe562c0e6f None admin] RBAC: Authorizing `identity:get_project(project_id=24460f2e7a5e44f19737eed3c6799a16)` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:27:11.166974 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f35d8f7-6606-4ef6-9aab-2efe562c0e6f None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:27:11.169594 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 101/201] 10.222.0.67 () {56 vars in 1186 bytes} [Wed May 25 14:27:11 2022] GET /identity/v3/projects/24460f2e7a5e44f19737eed3c6799a16 => generated 302 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:27:11.175111 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144453cb-b04a-44bb-b696-4599d8921bf0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:27:11.180246 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f35d8f7-6606-4ef6-9aab-2efe562c0e6f None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:27:11.183201 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application [None req-144453cb-b04a-44bb-b696-4599d8921bf0 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 25 14:27:11.183201 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:27:11.183201 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:27:11.183201 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:27:11.183201 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:27:11.183201 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:27:11.183201 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:27:11.183201 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:27:11.183201 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:27:11.183201 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:27:11.183201 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:27:11.183201 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:27:11.183201 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:27:11.183201 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:27:11.183201 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:27:11.183201 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:27:11.184168 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:27:11.184168 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:27:11.184168 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:27:11.184168 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:27:11.184168 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:27:11.184168 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:27:11.184168 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:27:11.184168 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:27:11.184168 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:27:11.184168 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:27:11.184168 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:27:11.184168 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application with Lock( May 25 14:27:11.184168 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:27:11.184168 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._enter() May 25 14:27:11.184168 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:27:11.184168 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:27:11.184968 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:27:11.184968 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.creator() May 25 14:27:11.184968 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:27:11.184968 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application created_value = creator( May 25 14:27:11.184968 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:27:11.184968 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:27:11.184968 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:27:11.184968 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:27:11.184968 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:27:11.184968 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:27:11.184968 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 25 14:27:11.184968 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:27:11.184968 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 101/202] 10.222.0.67 () {56 vars in 1099 bytes} [Wed May 25 14:27:10 2022] GET /identity/v3/roles/reader => generated 84 bytes in 311 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:27:11.196209 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144453cb-b04a-44bb-b696-4599d8921bf0 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:27:11.334280 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144453cb-b04a-44bb-b696-4599d8921bf0 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:27:11.349399 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:27:11.374142 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13a26a0-746c-4c27-9620-e48584ef467b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:27:11.374849 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13a26a0-746c-4c27-9620-e48584ef467b None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:11.375169 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13a26a0-746c-4c27-9620-e48584ef467b None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:11.375451 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13a26a0-746c-4c27-9620-e48584ef467b None admin] PATH_INFO: `/v3/roles` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:11.376211 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13a26a0-746c-4c27-9620-e48584ef467b None admin] RBAC: Adding query filter params (name=reader) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:27:11.376530 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13a26a0-746c-4c27-9620-e48584ef467b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:27:11.378328 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13a26a0-746c-4c27-9620-e48584ef467b None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:27:11.388028 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 102/203] 10.222.0.67 () {56 vars in 1101 bytes} [Wed May 25 14:27:11 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:27:11.394464 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13a26a0-746c-4c27-9620-e48584ef467b None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:27:11.418975 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:27:11.488916 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f35d8f7-6606-4ef6-9aab-2efe562c0e6f None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:27:11.504970 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13a26a0-746c-4c27-9620-e48584ef467b None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:27:11.543446 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078867ca-ed28-41bb-a0cc-51a794eb6245 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:27:11.544698 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078867ca-ed28-41bb-a0cc-51a794eb6245 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:11.544987 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078867ca-ed28-41bb-a0cc-51a794eb6245 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:11.545360 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078867ca-ed28-41bb-a0cc-51a794eb6245 None admin] PATH_INFO: `/v3/users/1c5fe246fb4b40c08d0ad5ddecdeccb4` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:11.547511 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078867ca-ed28-41bb-a0cc-51a794eb6245 None admin] RBAC: Authorizing `identity:get_user(user_id=1c5fe246fb4b40c08d0ad5ddecdeccb4)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:27:11.549279 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078867ca-ed28-41bb-a0cc-51a794eb6245 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:27:11.551227 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 103/204] 10.222.0.67 () {56 vars in 1177 bytes} [Wed May 25 14:27:11 2022] GET /identity/v3/users/1c5fe246fb4b40c08d0ad5ddecdeccb4 => generated 289 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:27:11.556869 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078867ca-ed28-41bb-a0cc-51a794eb6245 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:27:11.589406 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68536b79-dd6e-49cc-a992-cb24aee31b08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:27:11.589986 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68536b79-dd6e-49cc-a992-cb24aee31b08 None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:11.590271 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68536b79-dd6e-49cc-a992-cb24aee31b08 None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:11.590547 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68536b79-dd6e-49cc-a992-cb24aee31b08 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:11.591420 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68536b79-dd6e-49cc-a992-cb24aee31b08 None admin] RBAC: Adding query filter params (role.id=3e87d9311f1d411395a3fcd41ac81431, scope.project.id=24460f2e7a5e44f19737eed3c6799a16, user.id=6b9da0b8d0bc4102afc327021c50d55e) {{(pid=80474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:27:11.591733 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68536b79-dd6e-49cc-a992-cb24aee31b08 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:27:11.593463 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68536b79-dd6e-49cc-a992-cb24aee31b08 None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:27:11.599386 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 102/205] 10.222.0.67 () {56 vars in 1374 bytes} [Wed May 25 14:27:11 2022] GET /identity/v3/role_assignments?user.id=6b9da0b8d0bc4102afc327021c50d55e&scope.project.id=24460f2e7a5e44f19737eed3c6799a16&role.id=3e87d9311f1d411395a3fcd41ac81431 => generated 259 bytes in 420 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:27:11.610021 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:27:11.717085 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078867ca-ed28-41bb-a0cc-51a794eb6245 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:27:11.760483 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7275938-598b-4dfb-92a0-76480dcc1931 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:27:11.761166 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7275938-598b-4dfb-92a0-76480dcc1931 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:11.761452 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7275938-598b-4dfb-92a0-76480dcc1931 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:11.761733 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7275938-598b-4dfb-92a0-76480dcc1931 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:11.858489 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7275938-598b-4dfb-92a0-76480dcc1931 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:27:11.861660 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7275938-598b-4dfb-92a0-76480dcc1931 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:27:11.926428 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:27:12.000906 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 104/206] 10.222.0.67 () {58 vars in 1282 bytes} [Wed May 25 14:27:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 445 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 14:27:12.006687 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68536b79-dd6e-49cc-a992-cb24aee31b08 None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:27:12.135107 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68536b79-dd6e-49cc-a992-cb24aee31b08 None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:27:12.184472 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d15791d-8c32-4dbf-b130-78eb99c18e77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:27:12.185350 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d15791d-8c32-4dbf-b130-78eb99c18e77 None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:12.185628 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d15791d-8c32-4dbf-b130-78eb99c18e77 None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:12.185901 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d15791d-8c32-4dbf-b130-78eb99c18e77 None admin] PATH_INFO: `/v3/projects/652aa39dec91415abc8e6c301800eb00` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:12.187251 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d15791d-8c32-4dbf-b130-78eb99c18e77 None admin] RBAC: Authorizing `identity:get_project(project_id=652aa39dec91415abc8e6c301800eb00)` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:27:12.188728 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d15791d-8c32-4dbf-b130-78eb99c18e77 None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:27:12.190491 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 103/207] 10.222.0.67 () {56 vars in 1186 bytes} [Wed May 25 14:27:12 2022] GET /identity/v3/projects/652aa39dec91415abc8e6c301800eb00 => generated 298 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:27:12.196465 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7275938-598b-4dfb-92a0-76480dcc1931 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:27:12.350661 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7275938-598b-4dfb-92a0-76480dcc1931 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:27:12.406213 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c09dd4-18a3-48ed-9cbd-8bf29f907ecf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:27:12.407397 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c09dd4-18a3-48ed-9cbd-8bf29f907ecf None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:12.407906 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c09dd4-18a3-48ed-9cbd-8bf29f907ecf None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:12.408380 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c09dd4-18a3-48ed-9cbd-8bf29f907ecf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:12.409418 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c09dd4-18a3-48ed-9cbd-8bf29f907ecf None admin] RBAC: Adding query filter params (role.id=ed5296b21eba4c49b7792056991162da, scope.project.id=652aa39dec91415abc8e6c301800eb00, user.id=1c5fe246fb4b40c08d0ad5ddecdeccb4) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:27:12.409945 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c09dd4-18a3-48ed-9cbd-8bf29f907ecf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:27:12.411640 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c09dd4-18a3-48ed-9cbd-8bf29f907ecf None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:27:12.424334 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 105/208] 10.222.0.67 () {56 vars in 1374 bytes} [Wed May 25 14:27:12 2022] GET /identity/v3/role_assignments?user.id=1c5fe246fb4b40c08d0ad5ddecdeccb4&scope.project.id=652aa39dec91415abc8e6c301800eb00&role.id=ed5296b21eba4c49b7792056991162da => generated 608 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:27:13.346098 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0151a3a-d6b4-409b-bc7c-45edb08b57a4 None None] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:13.346623 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0151a3a-d6b4-409b-bc7c-45edb08b57a4 None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:13.346714 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0151a3a-d6b4-409b-bc7c-45edb08b57a4 None None] PATH_INFO: `/` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:13.348030 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2637b016-d5c6-4a68-81a8-c246b2e26f0f None None] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:13.348326 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 104/209] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 14:27:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:27:13.348503 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2637b016-d5c6-4a68-81a8-c246b2e26f0f None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:13.348900 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2637b016-d5c6-4a68-81a8-c246b2e26f0f None None] PATH_INFO: `/` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:13.350598 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 106/210] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 14:27:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:27:13.353728 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823352fc-9a3f-46e0-9ff4-8458a7045c92 None None] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:13.354015 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823352fc-9a3f-46e0-9ff4-8458a7045c92 None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:13.354293 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823352fc-9a3f-46e0-9ff4-8458a7045c92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:13.356237 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5f9a10-b3b0-4bea-b4c8-345bfba73d66 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:13.356674 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5f9a10-b3b0-4bea-b4c8-345bfba73d66 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:13.356794 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5f9a10-b3b0-4bea-b4c8-345bfba73d66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:13.363117 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:27:13.376800 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.auth.core [None req-823352fc-9a3f-46e0-9ff4-8458a7045c92 None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:27:13.378278 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-823352fc-9a3f-46e0-9ff4-8458a7045c92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:27:13.378861 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-be5f9a10-b3b0-4bea-b4c8-345bfba73d66 None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:27:13.380058 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-be5f9a10-b3b0-4bea-b4c8-345bfba73d66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:27:13.396450 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:27:13.453488 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 107/211] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 14:27:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 14:27:13.470699 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 105/212] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 14:27:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 14:27:13.477576 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5f9a10-b3b0-4bea-b4c8-345bfba73d66 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:27:13.498740 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823352fc-9a3f-46e0-9ff4-8458a7045c92 None None] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:27:13.586831 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5f9a10-b3b0-4bea-b4c8-345bfba73d66 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:27:13.612379 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823352fc-9a3f-46e0-9ff4-8458a7045c92 None None] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:27:13.623981 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9d24a2-8862-4ba9-8ed3-594ee97916f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:27:13.625023 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9d24a2-8862-4ba9-8ed3-594ee97916f1 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:13.625308 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9d24a2-8862-4ba9-8ed3-594ee97916f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:13.625580 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9d24a2-8862-4ba9-8ed3-594ee97916f1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:13.627596 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:27:13.638364 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9d24a2-8862-4ba9-8ed3-594ee97916f1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:27:13.646926 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application [None req-ff9d24a2-8862-4ba9-8ed3-594ee97916f1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 25 14:27:13.646926 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:27:13.646926 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:27:13.646926 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:27:13.646926 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:27:13.646926 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:27:13.646926 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:27:13.646926 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:27:13.646926 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:27:13.646926 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:27:13.646926 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:27:13.646926 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:27:13.646926 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:27:13.646926 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:27:13.646926 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:27:13.646926 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:27:13.648114 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:27:13.648114 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:27:13.648114 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:27:13.648114 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:27:13.648114 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:27:13.648114 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:27:13.648114 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:27:13.648114 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:27:13.648114 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:27:13.648114 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:27:13.648114 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:27:13.648114 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application with Lock( May 25 14:27:13.648114 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:27:13.648114 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._enter() May 25 14:27:13.648114 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:27:13.648114 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:27:13.649674 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:27:13.649674 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.creator() May 25 14:27:13.649674 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:27:13.649674 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application created_value = creator( May 25 14:27:13.649674 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:27:13.649674 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:27:13.649674 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:27:13.649674 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:27:13.649674 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:27:13.649674 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:27:13.649674 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 25 14:27:13.649674 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:27:13.649674 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 108/213] 10.222.0.67 () {56 vars in 1099 bytes} [Wed May 25 14:27:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:27:13.650348 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7180bce8-213d-44d3-af94-2104ee996195 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:27:13.651055 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7180bce8-213d-44d3-af94-2104ee996195 None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:13.651342 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7180bce8-213d-44d3-af94-2104ee996195 None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:13.651614 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7180bce8-213d-44d3-af94-2104ee996195 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:13.653185 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dd6003-3636-4c2d-9e83-c90e285022f1 None None] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:13.653755 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dd6003-3636-4c2d-9e83-c90e285022f1 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:13.654041 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dd6003-3636-4c2d-9e83-c90e285022f1 None None] PATH_INFO: `/` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:13.656087 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 109/214] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 14:27:13 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:27:13.656783 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dd6003-3636-4c2d-9e83-c90e285022f1 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:27:13.673343 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7180bce8-213d-44d3-af94-2104ee996195 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:27:13.681351 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application [None req-7180bce8-213d-44d3-af94-2104ee996195 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 14:27:13.681351 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:27:13.681351 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:27:13.681351 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:27:13.681351 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:27:13.681351 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:27:13.681351 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:27:13.681351 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:27:13.681351 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:27:13.681351 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:27:13.681351 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:27:13.681351 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:27:13.681351 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:27:13.681351 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:27:13.681351 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:27:13.681351 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:27:13.682242 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:27:13.682242 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:27:13.682242 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:27:13.682242 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:27:13.682242 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:27:13.682242 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:27:13.682242 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:27:13.682242 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:27:13.682242 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:27:13.682242 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:27:13.682242 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:27:13.682242 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application with Lock( May 25 14:27:13.682242 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:27:13.682242 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self._enter() May 25 14:27:13.682242 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:27:13.682242 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:27:13.683580 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:27:13.683580 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.creator() May 25 14:27:13.683580 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:27:13.683580 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application created_value = creator( May 25 14:27:13.683580 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:27:13.683580 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:27:13.683580 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:27:13.683580 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:27:13.683580 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:27:13.683580 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:27:13.683580 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 14:27:13.683580 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application May 25 14:27:13.683580 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 106/215] 10.222.0.67 () {56 vars in 1096 bytes} [Wed May 25 14:27:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 14:27:13.684345 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea14d4f-f5f4-4fbf-82cb-1a4282d0bb28 None None] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:13.684345 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea14d4f-f5f4-4fbf-82cb-1a4282d0bb28 None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:13.684463 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea14d4f-f5f4-4fbf-82cb-1a4282d0bb28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:13.701596 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.auth.core [None req-2ea14d4f-f5f4-4fbf-82cb-1a4282d0bb28 None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:27:13.703375 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-2ea14d4f-f5f4-4fbf-82cb-1a4282d0bb28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:27:13.707064 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:27:13.775540 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dd6003-3636-4c2d-9e83-c90e285022f1 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:27:13.781495 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 107/216] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 14:27:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 14:27:13.782848 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea14d4f-f5f4-4fbf-82cb-1a4282d0bb28 None None] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:27:13.819442 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690ca26a-faaa-44ae-860d-f83d772d3cb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:27:13.820118 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690ca26a-faaa-44ae-860d-f83d772d3cb2 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:13.820402 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690ca26a-faaa-44ae-860d-f83d772d3cb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:13.820703 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690ca26a-faaa-44ae-860d-f83d772d3cb2 None admin] PATH_INFO: `/v3/roles` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:13.821453 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690ca26a-faaa-44ae-860d-f83d772d3cb2 None admin] RBAC: Adding query filter params (name=member) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:27:13.821763 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690ca26a-faaa-44ae-860d-f83d772d3cb2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:27:13.823181 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690ca26a-faaa-44ae-860d-f83d772d3cb2 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:27:13.833004 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 110/217] 10.222.0.67 () {56 vars in 1101 bytes} [Wed May 25 14:27:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:27:13.838047 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690ca26a-faaa-44ae-860d-f83d772d3cb2 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:27:13.902137 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:27:13.909200 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea14d4f-f5f4-4fbf-82cb-1a4282d0bb28 None None] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:27:13.949825 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe30ddc-562a-4162-b70c-06ac0ff344f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:27:13.950767 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe30ddc-562a-4162-b70c-06ac0ff344f0 None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:13.951082 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe30ddc-562a-4162-b70c-06ac0ff344f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:13.951353 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe30ddc-562a-4162-b70c-06ac0ff344f0 None admin] PATH_INFO: `/v3/roles` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:13.952101 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe30ddc-562a-4162-b70c-06ac0ff344f0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:27:13.953031 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe30ddc-562a-4162-b70c-06ac0ff344f0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:27:13.953924 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690ca26a-faaa-44ae-860d-f83d772d3cb2 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:27:13.954433 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe30ddc-562a-4162-b70c-06ac0ff344f0 None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:27:13.967048 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 108/218] 10.222.0.67 () {56 vars in 1099 bytes} [Wed May 25 14:27:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:27:13.967048 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe30ddc-562a-4162-b70c-06ac0ff344f0 None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:27:13.967048 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:27:13.994615 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e739c1-34dc-4ec6-85d0-0ea7c36be55d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:27:13.995708 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e739c1-34dc-4ec6-85d0-0ea7c36be55d None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:13.995993 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e739c1-34dc-4ec6-85d0-0ea7c36be55d None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:13.996274 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e739c1-34dc-4ec6-85d0-0ea7c36be55d None admin] PATH_INFO: `/v3/domains/default` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:13.997447 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e739c1-34dc-4ec6-85d0-0ea7c36be55d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:27:13.998906 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e739c1-34dc-4ec6-85d0-0ea7c36be55d None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:27:14.001089 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 111/219] 10.222.0.67 () {56 vars in 1108 bytes} [Wed May 25 14:27:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:27:14.005335 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e739c1-34dc-4ec6-85d0-0ea7c36be55d None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:27:14.070692 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe30ddc-562a-4162-b70c-06ac0ff344f0 None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:27:14.104291 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f94a77-0b8c-40b0-8195-4d0c78dbd15a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:27:14.104604 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e739c1-34dc-4ec6-85d0-0ea7c36be55d None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:27:14.105169 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f94a77-0b8c-40b0-8195-4d0c78dbd15a None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:14.105457 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f94a77-0b8c-40b0-8195-4d0c78dbd15a None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:14.105738 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f94a77-0b8c-40b0-8195-4d0c78dbd15a None admin] PATH_INFO: `/v3/users/e118c68b35e948c7aca512c77744428d` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:14.118701 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f94a77-0b8c-40b0-8195-4d0c78dbd15a None admin] RBAC: Authorizing `identity:get_user(user_id=e118c68b35e948c7aca512c77744428d)` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:27:14.120456 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f94a77-0b8c-40b0-8195-4d0c78dbd15a None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:27:14.122124 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 109/220] 10.222.0.67 () {56 vars in 1177 bytes} [Wed May 25 14:27:13 2022] GET /identity/v3/users/e118c68b35e948c7aca512c77744428d => generated 297 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:27:14.123353 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431241d4-a094-4c45-a0fe-328d3e23ee78 None None] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:14.123645 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431241d4-a094-4c45-a0fe-328d3e23ee78 None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:14.123926 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431241d4-a094-4c45-a0fe-328d3e23ee78 None None] PATH_INFO: `/` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:14.125841 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 110/221] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 14:27:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:27:14.126381 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431241d4-a094-4c45-a0fe-328d3e23ee78 None None] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:27:14.131621 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:27:14.143242 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5729cf29-cb0e-4edf-982a-c8326545ccf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:27:14.144121 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5729cf29-cb0e-4edf-982a-c8326545ccf0 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:14.144407 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5729cf29-cb0e-4edf-982a-c8326545ccf0 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:14.144682 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5729cf29-cb0e-4edf-982a-c8326545ccf0 None admin] PATH_INFO: `/v3/users/6b9da0b8d0bc4102afc327021c50d55e` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:14.145880 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5729cf29-cb0e-4edf-982a-c8326545ccf0 None admin] RBAC: Authorizing `identity:get_user(user_id=6b9da0b8d0bc4102afc327021c50d55e)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:27:14.147378 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5729cf29-cb0e-4edf-982a-c8326545ccf0 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:27:14.149013 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 112/222] 10.222.0.67 () {56 vars in 1177 bytes} [Wed May 25 14:27:14 2022] GET /identity/v3/users/6b9da0b8d0bc4102afc327021c50d55e => generated 283 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:27:14.151715 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5729cf29-cb0e-4edf-982a-c8326545ccf0 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:27:14.188430 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:27:14.230042 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431241d4-a094-4c45-a0fe-328d3e23ee78 None None] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:27:14.253435 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5729cf29-cb0e-4edf-982a-c8326545ccf0 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:27:14.264176 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897b2c31-dc25-4644-b100-a3a95cefafb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:27:14.265420 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897b2c31-dc25-4644-b100-a3a95cefafb9 None admin] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:14.265723 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897b2c31-dc25-4644-b100-a3a95cefafb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:14.266008 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897b2c31-dc25-4644-b100-a3a95cefafb9 None admin] PATH_INFO: `/v3/users` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:14.266720 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897b2c31-dc25-4644-b100-a3a95cefafb9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:27:14.268202 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897b2c31-dc25-4644-b100-a3a95cefafb9 None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:27:14.289608 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b40e68-ff13-446d-b8c1-20079726fe3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:27:14.290072 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 111/223] 10.222.0.67 () {60 vars in 1132 bytes} [Wed May 25 14:27:14 2022] POST /identity/v3/users => generated 297 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:27:14.290282 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b40e68-ff13-446d-b8c1-20079726fe3f None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:14.290542 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b40e68-ff13-446d-b8c1-20079726fe3f None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:14.290820 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b40e68-ff13-446d-b8c1-20079726fe3f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:14.291341 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9b7dcc-7163-47ee-883c-4d91ac6ec605 None None] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:14.291636 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9b7dcc-7163-47ee-883c-4d91ac6ec605 None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:14.291920 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9b7dcc-7163-47ee-883c-4d91ac6ec605 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:14.311397 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.auth.core [None req-bd9b7dcc-7163-47ee-883c-4d91ac6ec605 None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:27:14.313183 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-bd9b7dcc-7163-47ee-883c-4d91ac6ec605 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:27:14.376296 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:27:14.388537 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b40e68-ff13-446d-b8c1-20079726fe3f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:27:14.391524 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b40e68-ff13-446d-b8c1-20079726fe3f None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:27:14.401517 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 112/224] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 14:27:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 14:27:14.408310 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9b7dcc-7163-47ee-883c-4d91ac6ec605 None None] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:27:14.466387 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:27:14.517179 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 113/225] 10.222.0.67 () {58 vars in 1282 bytes} [Wed May 25 14:27:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 14:27:14.518282 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b40e68-ff13-446d-b8c1-20079726fe3f None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:27:14.539518 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9b7dcc-7163-47ee-883c-4d91ac6ec605 None None] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:27:14.589134 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba4c3b3-302e-47c7-bb61-f2fa757185e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:27:14.590173 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba4c3b3-302e-47c7-bb61-f2fa757185e8 None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:14.590820 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba4c3b3-302e-47c7-bb61-f2fa757185e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:14.591147 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba4c3b3-302e-47c7-bb61-f2fa757185e8 None admin] PATH_INFO: `/v3/projects/24460f2e7a5e44f19737eed3c6799a16` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:14.592497 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba4c3b3-302e-47c7-bb61-f2fa757185e8 None admin] RBAC: Authorizing `identity:get_project(project_id=24460f2e7a5e44f19737eed3c6799a16)` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:27:14.594422 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba4c3b3-302e-47c7-bb61-f2fa757185e8 None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:27:14.596991 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 113/226] 10.222.0.67 () {56 vars in 1186 bytes} [Wed May 25 14:27:14 2022] GET /identity/v3/projects/24460f2e7a5e44f19737eed3c6799a16 => generated 302 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:27:14.597772 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba4c3b3-302e-47c7-bb61-f2fa757185e8 None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:27:14.638863 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:27:14.652213 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b40e68-ff13-446d-b8c1-20079726fe3f None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:27:14.697823 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcf607f-e5bd-4ef4-95c4-fa439e936a23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:27:14.698896 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcf607f-e5bd-4ef4-95c4-fa439e936a23 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:14.699206 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcf607f-e5bd-4ef4-95c4-fa439e936a23 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:14.699730 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcf607f-e5bd-4ef4-95c4-fa439e936a23 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:14.713340 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcf607f-e5bd-4ef4-95c4-fa439e936a23 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:27:14.716900 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba4c3b3-302e-47c7-bb61-f2fa757185e8 None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:27:14.722305 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application [None req-edcf607f-e5bd-4ef4-95c4-fa439e936a23 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 14:27:14.722305 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:27:14.722305 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:27:14.722305 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:27:14.722305 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:27:14.722305 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:27:14.722305 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:27:14.722305 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:27:14.722305 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:27:14.722305 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:27:14.722305 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:27:14.722305 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:27:14.722305 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:27:14.722305 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:27:14.722305 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:27:14.722305 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:27:14.723232 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:27:14.723232 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:27:14.723232 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:27:14.723232 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:27:14.723232 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:27:14.723232 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:27:14.723232 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:27:14.723232 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:27:14.723232 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:27:14.723232 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:27:14.723232 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:27:14.723232 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application with Lock( May 25 14:27:14.723232 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:27:14.723232 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._enter() May 25 14:27:14.723232 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:27:14.723232 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:27:14.724067 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:27:14.724067 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.creator() May 25 14:27:14.724067 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:27:14.724067 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application created_value = creator( May 25 14:27:14.724067 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:27:14.724067 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:27:14.724067 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:27:14.724067 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:27:14.724067 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:27:14.724067 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:27:14.724067 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 14:27:14.724067 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:27:14.724067 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 114/227] 10.222.0.67 () {56 vars in 1114 bytes} [Wed May 25 14:27:14 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:27:14.724744 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcf607f-e5bd-4ef4-95c4-fa439e936a23 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:27:14.737688 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:27:14.761138 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead72751-24fe-412e-93ec-ff2a0274b795 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:27:14.762202 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead72751-24fe-412e-93ec-ff2a0274b795 None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:14.762569 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead72751-24fe-412e-93ec-ff2a0274b795 None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:14.763009 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead72751-24fe-412e-93ec-ff2a0274b795 None admin] PATH_INFO: `/v3/projects/24460f2e7a5e44f19737eed3c6799a16` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:14.764295 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead72751-24fe-412e-93ec-ff2a0274b795 None admin] RBAC: Authorizing `identity:get_project(project_id=24460f2e7a5e44f19737eed3c6799a16)` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:27:14.766493 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead72751-24fe-412e-93ec-ff2a0274b795 None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:27:14.768827 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 114/228] 10.222.0.67 () {56 vars in 1186 bytes} [Wed May 25 14:27:14 2022] GET /identity/v3/projects/24460f2e7a5e44f19737eed3c6799a16 => generated 302 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:27:14.769722 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead72751-24fe-412e-93ec-ff2a0274b795 None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:27:14.845301 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcf607f-e5bd-4ef4-95c4-fa439e936a23 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:27:14.877469 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead72751-24fe-412e-93ec-ff2a0274b795 None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:27:14.883698 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d0a569-e28c-4db8-8ea9-b2866618dde0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:27:14.884670 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d0a569-e28c-4db8-8ea9-b2866618dde0 None admin] REQUEST_METHOD: `PUT` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:14.885024 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d0a569-e28c-4db8-8ea9-b2866618dde0 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:14.885372 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d0a569-e28c-4db8-8ea9-b2866618dde0 None admin] PATH_INFO: `/v3/projects/24460f2e7a5e44f19737eed3c6799a16/users/6b9da0b8d0bc4102afc327021c50d55e/roles/399893e19eac4ab5a8e596f7c07be13c` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:14.887494 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d0a569-e28c-4db8-8ea9-b2866618dde0 None admin] RBAC: Authorizing `identity:create_grant(project_id=24460f2e7a5e44f19737eed3c6799a16, user_id=6b9da0b8d0bc4102afc327021c50d55e, role_id=399893e19eac4ab5a8e596f7c07be13c)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:27:14.889600 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d0a569-e28c-4db8-8ea9-b2866618dde0 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:27:14.915023 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 115/229] 10.222.0.67 () {58 vars in 1439 bytes} [Wed May 25 14:27:14 2022] PUT /identity/v3/projects/24460f2e7a5e44f19737eed3c6799a16/users/6b9da0b8d0bc4102afc327021c50d55e/roles/399893e19eac4ab5a8e596f7c07be13c => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:27:14.915023 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d0a569-e28c-4db8-8ea9-b2866618dde0 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:27:14.928364 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:27:14.932118 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77845915-9f08-40d9-8189-5887a566b79a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:27:14.933052 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77845915-9f08-40d9-8189-5887a566b79a None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:14.933548 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77845915-9f08-40d9-8189-5887a566b79a None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:14.933989 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77845915-9f08-40d9-8189-5887a566b79a None admin] PATH_INFO: `/v3/roles` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:14.935021 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77845915-9f08-40d9-8189-5887a566b79a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:27:14.935515 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77845915-9f08-40d9-8189-5887a566b79a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:27:14.938674 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77845915-9f08-40d9-8189-5887a566b79a None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:27:14.949883 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 115/230] 10.222.0.67 () {56 vars in 1111 bytes} [Wed May 25 14:27:14 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:27:14.956941 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77845915-9f08-40d9-8189-5887a566b79a None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:27:15.037805 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d0a569-e28c-4db8-8ea9-b2866618dde0 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:27:15.066487 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:27:15.080868 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1e82ce-ee72-4674-a22c-cc6d51d46e74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:27:15.081649 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1e82ce-ee72-4674-a22c-cc6d51d46e74 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:15.082010 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1e82ce-ee72-4674-a22c-cc6d51d46e74 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:15.082382 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1e82ce-ee72-4674-a22c-cc6d51d46e74 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:15.083339 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1e82ce-ee72-4674-a22c-cc6d51d46e74 None admin] RBAC: Adding query filter params (role.id=48808901834b4d5eab2c7e6b5b03791e, scope.project.id=24460f2e7a5e44f19737eed3c6799a16, user.id=e118c68b35e948c7aca512c77744428d) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:27:15.083721 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1e82ce-ee72-4674-a22c-cc6d51d46e74 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:27:15.085464 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1e82ce-ee72-4674-a22c-cc6d51d46e74 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:27:15.092510 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 116/231] 10.222.0.67 () {56 vars in 1374 bytes} [Wed May 25 14:27:14 2022] GET /identity/v3/role_assignments?user.id=e118c68b35e948c7aca512c77744428d&scope.project.id=24460f2e7a5e44f19737eed3c6799a16&role.id=48808901834b4d5eab2c7e6b5b03791e => generated 259 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:27:15.147587 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77845915-9f08-40d9-8189-5887a566b79a None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:27:15.185803 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7a7b2f-f3e5-47d8-8f2d-9d4fe5586fe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:27:15.186770 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7a7b2f-f3e5-47d8-8f2d-9d4fe5586fe6 None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:15.187583 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7a7b2f-f3e5-47d8-8f2d-9d4fe5586fe6 None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:15.188242 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7a7b2f-f3e5-47d8-8f2d-9d4fe5586fe6 None admin] PATH_INFO: `/v3/users/6b9da0b8d0bc4102afc327021c50d55e` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:15.189127 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7a7b2f-f3e5-47d8-8f2d-9d4fe5586fe6 None admin] RBAC: Authorizing `identity:get_user(user_id=6b9da0b8d0bc4102afc327021c50d55e)` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:27:15.190593 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7a7b2f-f3e5-47d8-8f2d-9d4fe5586fe6 None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:27:15.192318 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 116/232] 10.222.0.67 () {56 vars in 1177 bytes} [Wed May 25 14:27:14 2022] GET /identity/v3/users/6b9da0b8d0bc4102afc327021c50d55e => generated 283 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:27:15.198021 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1e82ce-ee72-4674-a22c-cc6d51d46e74 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:27:15.291479 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:27:15.310815 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1e82ce-ee72-4674-a22c-cc6d51d46e74 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:27:15.349156 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8ce68b-0785-45a0-b11a-ef9bf8c186a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:27:15.350029 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8ce68b-0785-45a0-b11a-ef9bf8c186a9 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:15.350314 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8ce68b-0785-45a0-b11a-ef9bf8c186a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:15.350592 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8ce68b-0785-45a0-b11a-ef9bf8c186a9 None admin] PATH_INFO: `/v3/projects/24460f2e7a5e44f19737eed3c6799a16` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:15.351820 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8ce68b-0785-45a0-b11a-ef9bf8c186a9 None admin] RBAC: Authorizing `identity:get_project(project_id=24460f2e7a5e44f19737eed3c6799a16)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:27:15.353312 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8ce68b-0785-45a0-b11a-ef9bf8c186a9 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:27:15.355074 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 117/233] 10.222.0.67 () {56 vars in 1186 bytes} [Wed May 25 14:27:15 2022] GET /identity/v3/projects/24460f2e7a5e44f19737eed3c6799a16 => generated 302 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:27:15.361040 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7a7b2f-f3e5-47d8-8f2d-9d4fe5586fe6 None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:27:15.479229 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7a7b2f-f3e5-47d8-8f2d-9d4fe5586fe6 None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:27:15.496021 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:27:15.527641 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b98dc2-16ff-4343-9fd3-ffa3a36dcaca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:27:15.528540 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b98dc2-16ff-4343-9fd3-ffa3a36dcaca None admin] REQUEST_METHOD: `PUT` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:15.528826 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b98dc2-16ff-4343-9fd3-ffa3a36dcaca None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:15.529101 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b98dc2-16ff-4343-9fd3-ffa3a36dcaca None admin] PATH_INFO: `/v3/projects/24460f2e7a5e44f19737eed3c6799a16/users/6b9da0b8d0bc4102afc327021c50d55e/roles/3e87d9311f1d411395a3fcd41ac81431` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:15.531604 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b98dc2-16ff-4343-9fd3-ffa3a36dcaca None admin] RBAC: Authorizing `identity:create_grant(project_id=24460f2e7a5e44f19737eed3c6799a16, user_id=6b9da0b8d0bc4102afc327021c50d55e, role_id=3e87d9311f1d411395a3fcd41ac81431)` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:27:15.533048 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b98dc2-16ff-4343-9fd3-ffa3a36dcaca None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:27:15.557421 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 117/234] 10.222.0.67 () {58 vars in 1439 bytes} [Wed May 25 14:27:15 2022] PUT /identity/v3/projects/24460f2e7a5e44f19737eed3c6799a16/users/6b9da0b8d0bc4102afc327021c50d55e/roles/3e87d9311f1d411395a3fcd41ac81431 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:27:17.006962 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a974b4c-ad7b-48d7-a21b-55c9c79c7cc5 None None] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:17.007516 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a974b4c-ad7b-48d7-a21b-55c9c79c7cc5 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:17.007516 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a974b4c-ad7b-48d7-a21b-55c9c79c7cc5 None None] PATH_INFO: `/` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:17.009173 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 118/235] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 14:27:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:27:17.014183 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a0cb24-ae4d-4220-981e-d8b4aba64fea None None] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:17.014586 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a0cb24-ae4d-4220-981e-d8b4aba64fea None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:17.014797 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a0cb24-ae4d-4220-981e-d8b4aba64fea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:17.035767 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.auth.core [None req-87a0cb24-ae4d-4220-981e-d8b4aba64fea None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:27:17.036946 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-87a0cb24-ae4d-4220-981e-d8b4aba64fea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:27:17.050812 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0755ac33-bc8b-4342-afa3-2023f1b79cc2 None None] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:17.051124 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0755ac33-bc8b-4342-afa3-2023f1b79cc2 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:17.051404 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0755ac33-bc8b-4342-afa3-2023f1b79cc2 None None] PATH_INFO: `/` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:17.053025 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 119/236] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 14:27:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:27:17.059377 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a1a8bb-1ab2-497e-b932-5e5c78f11b57 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:17.059664 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a1a8bb-1ab2-497e-b932-5e5c78f11b57 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:17.059943 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a1a8bb-1ab2-497e-b932-5e5c78f11b57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:17.081572 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-f5a1a8bb-1ab2-497e-b932-5e5c78f11b57 None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:27:17.082744 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-f5a1a8bb-1ab2-497e-b932-5e5c78f11b57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:27:17.179041 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 118/237] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 14:27:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 14:27:17.199999 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 120/238] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 14:27:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 14:27:17.218153 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a0cb24-ae4d-4220-981e-d8b4aba64fea None None] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:27:17.254911 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a1a8bb-1ab2-497e-b932-5e5c78f11b57 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:27:17.340067 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:27:17.365939 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a1a8bb-1ab2-497e-b932-5e5c78f11b57 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:27:17.402066 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7f64c5-6602-4b49-a4a6-fbeac6206c4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:27:17.402961 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7f64c5-6602-4b49-a4a6-fbeac6206c4a None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:17.403339 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7f64c5-6602-4b49-a4a6-fbeac6206c4a None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:17.403679 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7f64c5-6602-4b49-a4a6-fbeac6206c4a None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:17.414444 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7f64c5-6602-4b49-a4a6-fbeac6206c4a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:27:17.423559 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application [None req-3f7f64c5-6602-4b49-a4a6-fbeac6206c4a None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 25 14:27:17.423559 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:27:17.423559 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:27:17.423559 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:27:17.423559 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:27:17.423559 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:27:17.423559 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:27:17.423559 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:27:17.423559 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:27:17.423559 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:27:17.423559 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:27:17.423559 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:27:17.423559 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:27:17.423559 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:27:17.423559 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:27:17.423559 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:27:17.424482 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:27:17.424482 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:27:17.424482 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:27:17.424482 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:27:17.424482 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:27:17.424482 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:27:17.424482 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:27:17.424482 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:27:17.424482 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:27:17.424482 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:27:17.424482 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:27:17.424482 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application with Lock( May 25 14:27:17.424482 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:27:17.424482 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._enter() May 25 14:27:17.424482 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:27:17.424482 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:27:17.425281 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:27:17.425281 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.creator() May 25 14:27:17.425281 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:27:17.425281 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application created_value = creator( May 25 14:27:17.425281 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:27:17.425281 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:27:17.425281 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:27:17.425281 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:27:17.425281 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:27:17.425281 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:27:17.425281 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 25 14:27:17.425281 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:27:17.425281 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 121/239] 10.222.0.67 () {56 vars in 1099 bytes} [Wed May 25 14:27:17 2022] GET /identity/v3/roles/reader => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 14:27:17.434232 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7f64c5-6602-4b49-a4a6-fbeac6206c4a None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:27:17.456463 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a0cb24-ae4d-4220-981e-d8b4aba64fea None None] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:27:17.458701 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:27:17.537055 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1b00d6-d03c-4c14-9def-16912a6a12f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:27:17.538016 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1b00d6-d03c-4c14-9def-16912a6a12f3 None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:17.539424 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1b00d6-d03c-4c14-9def-16912a6a12f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:17.539724 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1b00d6-d03c-4c14-9def-16912a6a12f3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:17.542098 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1b00d6-d03c-4c14-9def-16912a6a12f3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:27:17.543601 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1b00d6-d03c-4c14-9def-16912a6a12f3 None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:27:17.547034 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 119/240] 10.222.0.67 () {56 vars in 1108 bytes} [Wed May 25 14:27:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 331 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:27:17.551909 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1b00d6-d03c-4c14-9def-16912a6a12f3 None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:27:17.604695 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7f64c5-6602-4b49-a4a6-fbeac6206c4a None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:27:17.644369 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62012077-731b-40c2-8f0e-a2da77db812a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:27:17.645040 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62012077-731b-40c2-8f0e-a2da77db812a None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:17.645326 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62012077-731b-40c2-8f0e-a2da77db812a None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:17.645610 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62012077-731b-40c2-8f0e-a2da77db812a None admin] PATH_INFO: `/v3/roles` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:17.646364 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62012077-731b-40c2-8f0e-a2da77db812a None admin] RBAC: Adding query filter params (name=reader) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:27:17.646675 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62012077-731b-40c2-8f0e-a2da77db812a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:27:17.649121 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62012077-731b-40c2-8f0e-a2da77db812a None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:27:17.651257 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:27:17.670771 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 122/241] 10.222.0.67 () {56 vars in 1101 bytes} [Wed May 25 14:27:17 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:27:17.678156 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62012077-731b-40c2-8f0e-a2da77db812a None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:27:17.702906 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1b00d6-d03c-4c14-9def-16912a6a12f3 None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:27:17.743941 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f0234b-93dc-40ea-890d-2d429c327c21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:27:17.746563 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f0234b-93dc-40ea-890d-2d429c327c21 None admin] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:17.747246 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f0234b-93dc-40ea-890d-2d429c327c21 None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:17.749005 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f0234b-93dc-40ea-890d-2d429c327c21 None admin] PATH_INFO: `/v3/users` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:17.751191 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f0234b-93dc-40ea-890d-2d429c327c21 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:27:17.752875 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f0234b-93dc-40ea-890d-2d429c327c21 None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:27:17.789188 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 120/242] 10.222.0.67 () {60 vars in 1132 bytes} [Wed May 25 14:27:17 2022] POST /identity/v3/users => generated 293 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:27:17.855159 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62012077-731b-40c2-8f0e-a2da77db812a None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:27:17.895651 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3fe401-a1c7-48e4-afd8-af3c6479d315 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:27:17.896614 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3fe401-a1c7-48e4-afd8-af3c6479d315 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:17.896897 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3fe401-a1c7-48e4-afd8-af3c6479d315 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:17.897178 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3fe401-a1c7-48e4-afd8-af3c6479d315 None admin] PATH_INFO: `/v3/users/a4354e46c9ab453d8bd2030fd9ad051c` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:17.914230 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3fe401-a1c7-48e4-afd8-af3c6479d315 None admin] RBAC: Authorizing `identity:get_user(user_id=a4354e46c9ab453d8bd2030fd9ad051c)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:27:17.915806 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3fe401-a1c7-48e4-afd8-af3c6479d315 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:27:17.917547 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 123/243] 10.222.0.67 () {56 vars in 1177 bytes} [Wed May 25 14:27:17 2022] GET /identity/v3/users/a4354e46c9ab453d8bd2030fd9ad051c => generated 297 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:27:17.924134 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f0234b-93dc-40ea-890d-2d429c327c21 None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:27:17.951862 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b6fd5a-6182-4241-b9a5-51eee5b30bf7 None None] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:17.953119 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b6fd5a-6182-4241-b9a5-51eee5b30bf7 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:17.953605 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b6fd5a-6182-4241-b9a5-51eee5b30bf7 None None] PATH_INFO: `/` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:17.955525 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 124/244] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 14:27:17 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:27:17.957586 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:27:17.962682 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce76a8f-9c1b-46b9-ad77-ec070c827c4e None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:17.963343 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce76a8f-9c1b-46b9-ad77-ec070c827c4e None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:17.963852 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce76a8f-9c1b-46b9-ad77-ec070c827c4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:17.984449 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-1ce76a8f-9c1b-46b9-ad77-ec070c827c4e None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:27:17.986069 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-1ce76a8f-9c1b-46b9-ad77-ec070c827c4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:27:18.048238 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:27:18.054292 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f0234b-93dc-40ea-890d-2d429c327c21 None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:27:18.071867 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 125/245] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 14:27:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 14:27:18.079666 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69778e68-33f6-49f2-a5e8-5eaf2c340c96 None None] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:18.080411 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69778e68-33f6-49f2-a5e8-5eaf2c340c96 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:18.080912 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69778e68-33f6-49f2-a5e8-5eaf2c340c96 None None] PATH_INFO: `/` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:18.082677 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 126/246] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 14:27:18 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:27:18.088232 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9968cc72-9ac1-4cc1-8851-50799f943672 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:18.088643 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9968cc72-9ac1-4cc1-8851-50799f943672 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:18.089158 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9968cc72-9ac1-4cc1-8851-50799f943672 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:18.096207 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3251bd-1591-4f78-b763-6c47a1a918cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:27:18.097111 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3251bd-1591-4f78-b763-6c47a1a918cd None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:18.097543 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3251bd-1591-4f78-b763-6c47a1a918cd None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:18.097992 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3251bd-1591-4f78-b763-6c47a1a918cd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:18.120051 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-9968cc72-9ac1-4cc1-8851-50799f943672 None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:27:18.121629 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-9968cc72-9ac1-4cc1-8851-50799f943672 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:27:18.186401 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3251bd-1591-4f78-b763-6c47a1a918cd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:27:18.189118 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3251bd-1591-4f78-b763-6c47a1a918cd None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:27:18.209540 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 127/247] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 14:27:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 14:27:18.210327 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9968cc72-9ac1-4cc1-8851-50799f943672 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:27:18.218465 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:27:18.325689 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 121/248] 10.222.0.67 () {58 vars in 1282 bytes} [Wed May 25 14:27:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 14:27:18.326384 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3251bd-1591-4f78-b763-6c47a1a918cd None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:27:18.350855 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9968cc72-9ac1-4cc1-8851-50799f943672 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:27:18.372830 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:27:18.394751 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a131d4ea-e685-4068-b9d4-606f1d129dc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:27:18.396120 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a131d4ea-e685-4068-b9d4-606f1d129dc2 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:18.396553 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a131d4ea-e685-4068-b9d4-606f1d129dc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:18.396973 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a131d4ea-e685-4068-b9d4-606f1d129dc2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:18.415286 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a131d4ea-e685-4068-b9d4-606f1d129dc2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:27:18.425643 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application [None req-a131d4ea-e685-4068-b9d4-606f1d129dc2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 14:27:18.425643 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:27:18.425643 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:27:18.425643 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:27:18.425643 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:27:18.425643 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:27:18.425643 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:27:18.425643 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:27:18.425643 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:27:18.425643 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:27:18.425643 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:27:18.425643 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:27:18.425643 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:27:18.425643 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:27:18.425643 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:27:18.425643 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:27:18.426764 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:27:18.426764 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:27:18.426764 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:27:18.426764 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:27:18.426764 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:27:18.426764 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:27:18.426764 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:27:18.426764 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:27:18.426764 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:27:18.426764 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:27:18.426764 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:27:18.426764 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application with Lock( May 25 14:27:18.426764 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:27:18.426764 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._enter() May 25 14:27:18.426764 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:27:18.426764 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:27:18.427820 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:27:18.427820 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.creator() May 25 14:27:18.427820 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:27:18.427820 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application created_value = creator( May 25 14:27:18.427820 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:27:18.427820 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:27:18.427820 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:27:18.427820 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:27:18.427820 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:27:18.427820 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:27:18.427820 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 14:27:18.427820 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:27:18.430886 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 128/249] 10.222.0.67 () {56 vars in 1096 bytes} [Wed May 25 14:27:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:27:18.436889 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a131d4ea-e685-4068-b9d4-606f1d129dc2 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:27:18.459053 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3251bd-1591-4f78-b763-6c47a1a918cd None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:27:18.487866 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:27:18.500054 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b25df91-f614-45f3-ad2d-f272751ea547 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:27:18.500820 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b25df91-f614-45f3-ad2d-f272751ea547 None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:18.501110 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b25df91-f614-45f3-ad2d-f272751ea547 None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:18.501385 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b25df91-f614-45f3-ad2d-f272751ea547 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:18.514592 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b25df91-f614-45f3-ad2d-f272751ea547 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:27:18.524842 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application [None req-0b25df91-f614-45f3-ad2d-f272751ea547 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 25 14:27:18.524842 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:27:18.524842 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:27:18.524842 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:27:18.524842 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:27:18.524842 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:27:18.524842 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:27:18.524842 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:27:18.524842 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:27:18.524842 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:27:18.524842 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:27:18.524842 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:27:18.524842 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:27:18.524842 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:27:18.524842 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:27:18.524842 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:27:18.525778 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:27:18.525778 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:27:18.525778 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:27:18.525778 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:27:18.525778 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:27:18.525778 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:27:18.525778 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:27:18.525778 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:27:18.525778 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:27:18.525778 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:27:18.525778 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:27:18.525778 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application with Lock( May 25 14:27:18.525778 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:27:18.525778 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self._enter() May 25 14:27:18.525778 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:27:18.525778 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:27:18.526577 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:27:18.526577 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.creator() May 25 14:27:18.526577 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:27:18.526577 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application created_value = creator( May 25 14:27:18.526577 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:27:18.526577 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:27:18.526577 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:27:18.526577 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:27:18.526577 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:27:18.526577 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:27:18.526577 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 25 14:27:18.526577 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application May 25 14:27:18.526577 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 122/250] 10.222.0.67 () {56 vars in 1099 bytes} [Wed May 25 14:27:18 2022] GET /identity/v3/roles/member => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:27:18.527291 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b25df91-f614-45f3-ad2d-f272751ea547 None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:27:18.581400 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a131d4ea-e685-4068-b9d4-606f1d129dc2 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:27:18.616131 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4333211-fcd0-4730-b22c-e5d16e5dc0b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:27:18.616998 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4333211-fcd0-4730-b22c-e5d16e5dc0b4 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:18.617284 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4333211-fcd0-4730-b22c-e5d16e5dc0b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:18.617549 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4333211-fcd0-4730-b22c-e5d16e5dc0b4 None admin] PATH_INFO: `/v3/projects/24460f2e7a5e44f19737eed3c6799a16` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:18.618740 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4333211-fcd0-4730-b22c-e5d16e5dc0b4 None admin] RBAC: Authorizing `identity:get_project(project_id=24460f2e7a5e44f19737eed3c6799a16)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:27:18.620517 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4333211-fcd0-4730-b22c-e5d16e5dc0b4 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:27:18.622528 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 129/251] 10.222.0.67 () {56 vars in 1186 bytes} [Wed May 25 14:27:18 2022] GET /identity/v3/projects/24460f2e7a5e44f19737eed3c6799a16 => generated 302 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:27:18.627015 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4333211-fcd0-4730-b22c-e5d16e5dc0b4 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:27:18.666117 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b25df91-f614-45f3-ad2d-f272751ea547 None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:27:18.688108 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:27:18.709896 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8637f6-470e-4589-bcdf-72d9df10f40f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:27:18.710674 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8637f6-470e-4589-bcdf-72d9df10f40f None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:18.710968 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8637f6-470e-4589-bcdf-72d9df10f40f None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:18.711289 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8637f6-470e-4589-bcdf-72d9df10f40f None admin] PATH_INFO: `/v3/roles` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:18.712217 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8637f6-470e-4589-bcdf-72d9df10f40f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:27:18.712554 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8637f6-470e-4589-bcdf-72d9df10f40f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:27:18.713959 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8637f6-470e-4589-bcdf-72d9df10f40f None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:27:18.728587 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 123/252] 10.222.0.67 () {56 vars in 1099 bytes} [Wed May 25 14:27:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:27:18.728587 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765501c7-91e2-40f0-a9c7-db5cde3b8254 None None] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:18.728587 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765501c7-91e2-40f0-a9c7-db5cde3b8254 None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:18.728587 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765501c7-91e2-40f0-a9c7-db5cde3b8254 None None] PATH_INFO: `/` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:18.728587 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 124/253] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 14:27:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:27:18.728587 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765501c7-91e2-40f0-a9c7-db5cde3b8254 None None] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:27:18.762768 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4333211-fcd0-4730-b22c-e5d16e5dc0b4 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:27:18.792377 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:27:18.799749 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26663c57-27ae-4ffa-b2f2-0287c08574e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:27:18.800717 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26663c57-27ae-4ffa-b2f2-0287c08574e9 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:18.801229 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26663c57-27ae-4ffa-b2f2-0287c08574e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:18.801735 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26663c57-27ae-4ffa-b2f2-0287c08574e9 None admin] PATH_INFO: `/v3/roles` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:18.802700 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26663c57-27ae-4ffa-b2f2-0287c08574e9 None admin] RBAC: Adding query filter params (name=member) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:27:18.803231 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26663c57-27ae-4ffa-b2f2-0287c08574e9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:27:18.804831 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26663c57-27ae-4ffa-b2f2-0287c08574e9 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:27:18.813749 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 130/254] 10.222.0.67 () {56 vars in 1101 bytes} [Wed May 25 14:27:18 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:27:18.814938 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26663c57-27ae-4ffa-b2f2-0287c08574e9 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:27:18.851381 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765501c7-91e2-40f0-a9c7-db5cde3b8254 None None] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:27:18.889538 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383dc576-9c01-421c-a5f9-e905921cfdfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:27:18.890740 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383dc576-9c01-421c-a5f9-e905921cfdfd None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:18.891140 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383dc576-9c01-421c-a5f9-e905921cfdfd None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:18.891431 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383dc576-9c01-421c-a5f9-e905921cfdfd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:18.892280 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383dc576-9c01-421c-a5f9-e905921cfdfd None admin] RBAC: Adding query filter params (role.id=ed5296b21eba4c49b7792056991162da, scope.project.id=24460f2e7a5e44f19737eed3c6799a16, user.id=a4354e46c9ab453d8bd2030fd9ad051c) {{(pid=80474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:27:18.892598 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383dc576-9c01-421c-a5f9-e905921cfdfd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:27:18.894187 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383dc576-9c01-421c-a5f9-e905921cfdfd None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:27:18.907020 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 125/255] 10.222.0.67 () {56 vars in 1374 bytes} [Wed May 25 14:27:18 2022] GET /identity/v3/role_assignments?user.id=a4354e46c9ab453d8bd2030fd9ad051c&scope.project.id=24460f2e7a5e44f19737eed3c6799a16&role.id=ed5296b21eba4c49b7792056991162da => generated 259 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:27:18.907020 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dbd52c-6bdb-42b0-a541-35feadb47646 None None] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:18.907020 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dbd52c-6bdb-42b0-a541-35feadb47646 None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:18.907020 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dbd52c-6bdb-42b0-a541-35feadb47646 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:18.938965 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.auth.core [None req-62dbd52c-6bdb-42b0-a541-35feadb47646 None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:27:18.941199 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-62dbd52c-6bdb-42b0-a541-35feadb47646 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:27:18.985401 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26663c57-27ae-4ffa-b2f2-0287c08574e9 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:27:18.992883 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:27:19.074920 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98dc67eb-5cb7-486c-9982-96b7794ccbcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:27:19.076949 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dc67eb-5cb7-486c-9982-96b7794ccbcb None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:19.077696 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dc67eb-5cb7-486c-9982-96b7794ccbcb None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:19.078214 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dc67eb-5cb7-486c-9982-96b7794ccbcb None admin] PATH_INFO: `/v3/users/6b9da0b8d0bc4102afc327021c50d55e` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:19.083352 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98dc67eb-5cb7-486c-9982-96b7794ccbcb None admin] RBAC: Authorizing `identity:get_user(user_id=6b9da0b8d0bc4102afc327021c50d55e)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:27:19.084881 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98dc67eb-5cb7-486c-9982-96b7794ccbcb None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:27:19.092520 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 131/256] 10.222.0.67 () {56 vars in 1177 bytes} [Wed May 25 14:27:18 2022] GET /identity/v3/users/6b9da0b8d0bc4102afc327021c50d55e => generated 283 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:27:19.092520 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98dc67eb-5cb7-486c-9982-96b7794ccbcb None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:27:19.112082 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 126/257] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 14:27:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 14:27:19.113090 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62dbd52c-6bdb-42b0-a541-35feadb47646 None None] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:27:19.165200 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:27:19.208655 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98dc67eb-5cb7-486c-9982-96b7794ccbcb None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:27:19.232229 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62dbd52c-6bdb-42b0-a541-35feadb47646 None None] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:27:19.244640 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3e6944-265c-46bb-a480-68cb355eab1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:27:19.245951 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3e6944-265c-46bb-a480-68cb355eab1a None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:19.246316 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3e6944-265c-46bb-a480-68cb355eab1a None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:19.246696 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3e6944-265c-46bb-a480-68cb355eab1a None admin] PATH_INFO: `/v3/users/e118c68b35e948c7aca512c77744428d` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:19.248115 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3e6944-265c-46bb-a480-68cb355eab1a None admin] RBAC: Authorizing `identity:get_user(user_id=e118c68b35e948c7aca512c77744428d)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:27:19.250244 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3e6944-265c-46bb-a480-68cb355eab1a None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:27:19.252325 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 132/258] 10.222.0.67 () {56 vars in 1177 bytes} [Wed May 25 14:27:19 2022] GET /identity/v3/users/e118c68b35e948c7aca512c77744428d => generated 297 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:27:19.253198 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3e6944-265c-46bb-a480-68cb355eab1a None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:27:19.274549 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4000a4f9-3ea5-472b-8ee7-d58789ac09c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:27:19.275573 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4000a4f9-3ea5-472b-8ee7-d58789ac09c4 None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:19.276048 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4000a4f9-3ea5-472b-8ee7-d58789ac09c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:19.276539 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4000a4f9-3ea5-472b-8ee7-d58789ac09c4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:19.298768 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:27:19.355409 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4000a4f9-3ea5-472b-8ee7-d58789ac09c4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:27:19.357247 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4000a4f9-3ea5-472b-8ee7-d58789ac09c4 None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:27:19.368533 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3e6944-265c-46bb-a480-68cb355eab1a None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:27:19.410721 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:27:19.442371 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f7b158-294e-4511-836e-4271f0d138ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:27:19.443235 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f7b158-294e-4511-836e-4271f0d138ab None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:19.443524 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f7b158-294e-4511-836e-4271f0d138ab None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:19.443804 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f7b158-294e-4511-836e-4271f0d138ab None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:19.463106 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f7b158-294e-4511-836e-4271f0d138ab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:27:19.479514 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application [None req-29f7b158-294e-4511-836e-4271f0d138ab None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 14:27:19.479514 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:27:19.479514 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:27:19.479514 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:27:19.479514 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:27:19.479514 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:27:19.479514 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:27:19.479514 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:27:19.479514 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:27:19.479514 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:27:19.479514 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:27:19.479514 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:27:19.479514 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:27:19.479514 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:27:19.479514 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:27:19.479514 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:27:19.480464 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:27:19.480464 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:27:19.480464 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:27:19.480464 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:27:19.480464 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:27:19.480464 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:27:19.480464 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:27:19.480464 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:27:19.480464 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:27:19.480464 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:27:19.480464 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:27:19.480464 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application with Lock( May 25 14:27:19.480464 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:27:19.480464 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._enter() May 25 14:27:19.480464 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:27:19.480464 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:27:19.481766 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:27:19.481766 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.creator() May 25 14:27:19.481766 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:27:19.481766 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application created_value = creator( May 25 14:27:19.481766 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:27:19.481766 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:27:19.481766 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:27:19.481766 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:27:19.481766 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:27:19.481766 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:27:19.481766 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 14:27:19.481766 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:27:19.481766 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 133/259] 10.222.0.67 () {56 vars in 1114 bytes} [Wed May 25 14:27:19 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:27:19.481766 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f7b158-294e-4511-836e-4271f0d138ab None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:27:19.487431 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 127/260] 10.222.0.67 () {58 vars in 1282 bytes} [Wed May 25 14:27:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 14:27:19.488659 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4000a4f9-3ea5-472b-8ee7-d58789ac09c4 None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:27:19.605616 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4000a4f9-3ea5-472b-8ee7-d58789ac09c4 None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:27:19.654106 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445715cf-d81e-49ea-8e6c-063d0003e2a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:27:19.655296 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445715cf-d81e-49ea-8e6c-063d0003e2a8 None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:19.656523 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445715cf-d81e-49ea-8e6c-063d0003e2a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:19.657004 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445715cf-d81e-49ea-8e6c-063d0003e2a8 None admin] PATH_INFO: `/v3/roles` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:19.658073 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445715cf-d81e-49ea-8e6c-063d0003e2a8 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:27:19.658535 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:27:19.659078 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445715cf-d81e-49ea-8e6c-063d0003e2a8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:27:19.661322 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445715cf-d81e-49ea-8e6c-063d0003e2a8 None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:27:19.666399 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f7b158-294e-4511-836e-4271f0d138ab None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:27:19.684495 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 128/261] 10.222.0.67 () {56 vars in 1111 bytes} [Wed May 25 14:27:19 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:27:19.685815 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445715cf-d81e-49ea-8e6c-063d0003e2a8 None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:27:19.690056 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:27:19.703624 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe8429c-a6e7-4251-9f61-23161b0df70a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:27:19.704561 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe8429c-a6e7-4251-9f61-23161b0df70a None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:19.704780 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe8429c-a6e7-4251-9f61-23161b0df70a None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:19.705060 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe8429c-a6e7-4251-9f61-23161b0df70a None admin] PATH_INFO: `/v3/projects/24460f2e7a5e44f19737eed3c6799a16` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:19.707074 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe8429c-a6e7-4251-9f61-23161b0df70a None admin] RBAC: Authorizing `identity:get_project(project_id=24460f2e7a5e44f19737eed3c6799a16)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:27:19.707862 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe8429c-a6e7-4251-9f61-23161b0df70a None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:27:19.709571 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 134/262] 10.222.0.67 () {56 vars in 1186 bytes} [Wed May 25 14:27:19 2022] GET /identity/v3/projects/24460f2e7a5e44f19737eed3c6799a16 => generated 302 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:27:19.710336 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe8429c-a6e7-4251-9f61-23161b0df70a None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:27:19.852082 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe8429c-a6e7-4251-9f61-23161b0df70a None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:27:19.861980 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445715cf-d81e-49ea-8e6c-063d0003e2a8 None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:27:19.889451 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9304e0-bcef-4baf-8b5f-fbca150fb723 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:27:19.890682 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9304e0-bcef-4baf-8b5f-fbca150fb723 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:19.891144 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9304e0-bcef-4baf-8b5f-fbca150fb723 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:19.891566 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9304e0-bcef-4baf-8b5f-fbca150fb723 None admin] PATH_INFO: `/v3/users/6b9da0b8d0bc4102afc327021c50d55e` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:19.892981 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9304e0-bcef-4baf-8b5f-fbca150fb723 None admin] RBAC: Authorizing `identity:get_user(user_id=6b9da0b8d0bc4102afc327021c50d55e)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:27:19.894645 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9304e0-bcef-4baf-8b5f-fbca150fb723 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:27:19.896814 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 135/263] 10.222.0.67 () {56 vars in 1177 bytes} [Wed May 25 14:27:19 2022] GET /identity/v3/users/6b9da0b8d0bc4102afc327021c50d55e => generated 283 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:27:19.897746 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9304e0-bcef-4baf-8b5f-fbca150fb723 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:27:19.903550 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d518150-4db8-4ecb-a05e-f359cc50e7ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:27:19.904511 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d518150-4db8-4ecb-a05e-f359cc50e7ba None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:19.904866 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d518150-4db8-4ecb-a05e-f359cc50e7ba None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:19.905283 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d518150-4db8-4ecb-a05e-f359cc50e7ba None admin] PATH_INFO: `/v3/projects/24460f2e7a5e44f19737eed3c6799a16` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:19.906621 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d518150-4db8-4ecb-a05e-f359cc50e7ba None admin] RBAC: Authorizing `identity:get_project(project_id=24460f2e7a5e44f19737eed3c6799a16)` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:27:19.908184 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d518150-4db8-4ecb-a05e-f359cc50e7ba None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:27:19.910093 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 129/264] 10.222.0.67 () {56 vars in 1186 bytes} [Wed May 25 14:27:19 2022] GET /identity/v3/projects/24460f2e7a5e44f19737eed3c6799a16 => generated 302 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:27:19.911003 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d518150-4db8-4ecb-a05e-f359cc50e7ba None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:27:19.939019 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:27:19.989907 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:27:20.026482 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d518150-4db8-4ecb-a05e-f359cc50e7ba None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:27:20.063286 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581721ec-e89a-4b43-969f-f5df223ec5ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:27:20.064086 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581721ec-e89a-4b43-969f-f5df223ec5ae None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:20.064359 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581721ec-e89a-4b43-969f-f5df223ec5ae None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:20.064640 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581721ec-e89a-4b43-969f-f5df223ec5ae None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:20.097451 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9304e0-bcef-4baf-8b5f-fbca150fb723 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:27:20.139175 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581721ec-e89a-4b43-969f-f5df223ec5ae None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:27:20.140867 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581721ec-e89a-4b43-969f-f5df223ec5ae None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:27:20.187894 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6892583-ebe7-4093-b5f3-6812bc8c726b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:27:20.188800 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6892583-ebe7-4093-b5f3-6812bc8c726b None admin] REQUEST_METHOD: `PUT` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:20.189080 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6892583-ebe7-4093-b5f3-6812bc8c726b None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:20.189353 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6892583-ebe7-4093-b5f3-6812bc8c726b None admin] PATH_INFO: `/v3/projects/24460f2e7a5e44f19737eed3c6799a16/users/e118c68b35e948c7aca512c77744428d/roles/48808901834b4d5eab2c7e6b5b03791e` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:20.191462 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6892583-ebe7-4093-b5f3-6812bc8c726b None admin] RBAC: Authorizing `identity:create_grant(project_id=24460f2e7a5e44f19737eed3c6799a16, user_id=e118c68b35e948c7aca512c77744428d, role_id=48808901834b4d5eab2c7e6b5b03791e)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:27:20.192911 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6892583-ebe7-4093-b5f3-6812bc8c726b None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:27:20.217364 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:27:20.237526 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 136/265] 10.222.0.67 () {58 vars in 1439 bytes} [Wed May 25 14:27:19 2022] PUT /identity/v3/projects/24460f2e7a5e44f19737eed3c6799a16/users/e118c68b35e948c7aca512c77744428d/roles/48808901834b4d5eab2c7e6b5b03791e => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:27:20.238379 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6892583-ebe7-4093-b5f3-6812bc8c726b None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:27:20.254759 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 130/266] 10.222.0.67 () {58 vars in 1282 bytes} [Wed May 25 14:27:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 14:27:20.260386 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581721ec-e89a-4b43-969f-f5df223ec5ae None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:27:20.373730 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581721ec-e89a-4b43-969f-f5df223ec5ae None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:27:20.412504 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f50d82-1b18-4fbb-81c3-899bb39096f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:27:20.413311 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f50d82-1b18-4fbb-81c3-899bb39096f7 None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:20.413600 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f50d82-1b18-4fbb-81c3-899bb39096f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:20.413883 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f50d82-1b18-4fbb-81c3-899bb39096f7 None admin] PATH_INFO: `/v3/projects/24460f2e7a5e44f19737eed3c6799a16` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:20.415138 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f50d82-1b18-4fbb-81c3-899bb39096f7 None admin] RBAC: Authorizing `identity:get_project(project_id=24460f2e7a5e44f19737eed3c6799a16)` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:27:20.416664 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f50d82-1b18-4fbb-81c3-899bb39096f7 None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:27:20.418689 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 131/267] 10.222.0.67 () {56 vars in 1186 bytes} [Wed May 25 14:27:20 2022] GET /identity/v3/projects/24460f2e7a5e44f19737eed3c6799a16 => generated 302 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:27:20.425262 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f50d82-1b18-4fbb-81c3-899bb39096f7 None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:27:20.480407 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:27:20.497546 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6892583-ebe7-4093-b5f3-6812bc8c726b None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:27:20.510305 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:27:20.615831 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6101aaa-89bb-4b66-889f-25c85af76378 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:27:20.616520 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6101aaa-89bb-4b66-889f-25c85af76378 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:20.616782 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f50d82-1b18-4fbb-81c3-899bb39096f7 None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:27:20.616912 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6101aaa-89bb-4b66-889f-25c85af76378 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:20.617071 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6101aaa-89bb-4b66-889f-25c85af76378 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:20.617923 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6101aaa-89bb-4b66-889f-25c85af76378 None admin] RBAC: Adding query filter params (role.id=399893e19eac4ab5a8e596f7c07be13c, scope.project.id=24460f2e7a5e44f19737eed3c6799a16, user.id=6b9da0b8d0bc4102afc327021c50d55e) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:27:20.618247 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6101aaa-89bb-4b66-889f-25c85af76378 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:27:20.619823 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6101aaa-89bb-4b66-889f-25c85af76378 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:27:20.638565 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 137/268] 10.222.0.67 () {56 vars in 1374 bytes} [Wed May 25 14:27:20 2022] GET /identity/v3/role_assignments?user.id=6b9da0b8d0bc4102afc327021c50d55e&scope.project.id=24460f2e7a5e44f19737eed3c6799a16&role.id=399893e19eac4ab5a8e596f7c07be13c => generated 608 bytes in 400 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:27:20.669033 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecea9f7e-4650-43c5-982c-3e39a8e9777c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:27:20.670145 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecea9f7e-4650-43c5-982c-3e39a8e9777c None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:20.670729 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecea9f7e-4650-43c5-982c-3e39a8e9777c None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:20.671845 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecea9f7e-4650-43c5-982c-3e39a8e9777c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:20.672944 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecea9f7e-4650-43c5-982c-3e39a8e9777c None admin] RBAC: Adding query filter params (role.id=3e87d9311f1d411395a3fcd41ac81431, scope.project.id=24460f2e7a5e44f19737eed3c6799a16, user.id=6b9da0b8d0bc4102afc327021c50d55e) {{(pid=80474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:27:20.673502 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecea9f7e-4650-43c5-982c-3e39a8e9777c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:27:20.678351 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecea9f7e-4650-43c5-982c-3e39a8e9777c None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:27:20.686201 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 132/269] 10.222.0.67 () {56 vars in 1374 bytes} [Wed May 25 14:27:20 2022] GET /identity/v3/role_assignments?user.id=6b9da0b8d0bc4102afc327021c50d55e&scope.project.id=24460f2e7a5e44f19737eed3c6799a16&role.id=3e87d9311f1d411395a3fcd41ac81431 => generated 608 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:27:20.865768 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae56ba1a-79a7-4d13-b668-43cb994855d4 None None] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:20.866441 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae56ba1a-79a7-4d13-b668-43cb994855d4 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:20.866928 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae56ba1a-79a7-4d13-b668-43cb994855d4 None None] PATH_INFO: `/` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:20.868658 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 138/270] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 14:27:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:27:20.875481 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00feb617-41d1-4e7a-859c-3b9f08b2804d None None] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:20.876100 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00feb617-41d1-4e7a-859c-3b9f08b2804d None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:20.876594 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00feb617-41d1-4e7a-859c-3b9f08b2804d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:20.901056 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.auth.core [None req-00feb617-41d1-4e7a-859c-3b9f08b2804d None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:27:20.902608 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-00feb617-41d1-4e7a-859c-3b9f08b2804d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:27:20.945652 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64414356-f75d-4013-8dec-9ee421fcf3b7 None None] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:20.946378 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64414356-f75d-4013-8dec-9ee421fcf3b7 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:20.946861 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64414356-f75d-4013-8dec-9ee421fcf3b7 None None] PATH_INFO: `/` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:20.948996 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 139/271] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 14:27:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 14:27:20.954462 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e0416f-326e-4420-929e-9d7844f70c4a None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:20.954755 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e0416f-326e-4420-929e-9d7844f70c4a None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:20.955053 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e0416f-326e-4420-929e-9d7844f70c4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:20.988216 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-56e0416f-326e-4420-929e-9d7844f70c4a None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:27:20.988931 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 133/272] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 14:27:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 14:27:20.991754 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-56e0416f-326e-4420-929e-9d7844f70c4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:27:21.022752 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00feb617-41d1-4e7a-859c-3b9f08b2804d None None] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:27:21.082421 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:27:21.100391 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 140/273] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 14:27:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 14:27:21.132147 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e0416f-326e-4420-929e-9d7844f70c4a None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:27:21.169409 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00feb617-41d1-4e7a-859c-3b9f08b2804d None None] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:27:21.207901 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fae813-3f5b-448a-954d-a44754f0df95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:27:21.208620 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fae813-3f5b-448a-954d-a44754f0df95 None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:21.208906 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fae813-3f5b-448a-954d-a44754f0df95 None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:21.209182 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fae813-3f5b-448a-954d-a44754f0df95 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:21.210473 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fae813-3f5b-448a-954d-a44754f0df95 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:27:21.212085 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fae813-3f5b-448a-954d-a44754f0df95 None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:27:21.214127 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 134/274] 10.222.0.67 () {56 vars in 1108 bytes} [Wed May 25 14:27:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:27:21.220710 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fae813-3f5b-448a-954d-a44754f0df95 None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:27:21.260191 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:27:21.274433 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e0416f-326e-4420-929e-9d7844f70c4a None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:27:21.334626 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3259d99d-0deb-4dbc-9a51-b1a2d0f29c28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:27:21.335581 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3259d99d-0deb-4dbc-9a51-b1a2d0f29c28 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:21.335867 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3259d99d-0deb-4dbc-9a51-b1a2d0f29c28 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:21.336142 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3259d99d-0deb-4dbc-9a51-b1a2d0f29c28 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:21.353636 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3259d99d-0deb-4dbc-9a51-b1a2d0f29c28 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:27:21.360462 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fae813-3f5b-448a-954d-a44754f0df95 None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:27:21.362160 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:27:21.371294 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application [None req-3259d99d-0deb-4dbc-9a51-b1a2d0f29c28 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 25 14:27:21.371294 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:27:21.371294 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:27:21.371294 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:27:21.371294 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:27:21.371294 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:27:21.371294 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:27:21.371294 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:27:21.371294 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:27:21.371294 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:27:21.371294 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:27:21.371294 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:27:21.371294 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:27:21.371294 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:27:21.371294 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:27:21.371294 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:27:21.372245 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:27:21.372245 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:27:21.372245 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:27:21.372245 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:27:21.372245 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:27:21.372245 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:27:21.372245 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:27:21.372245 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:27:21.372245 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:27:21.372245 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:27:21.372245 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:27:21.372245 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application with Lock( May 25 14:27:21.372245 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:27:21.372245 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._enter() May 25 14:27:21.372245 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:27:21.372245 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:27:21.373545 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:27:21.373545 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.creator() May 25 14:27:21.373545 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:27:21.373545 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application created_value = creator( May 25 14:27:21.373545 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:27:21.373545 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:27:21.373545 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:27:21.373545 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:27:21.373545 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:27:21.373545 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:27:21.373545 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 25 14:27:21.373545 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:27:21.373545 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 141/275] 10.222.0.67 () {56 vars in 1099 bytes} [Wed May 25 14:27:21 2022] GET /identity/v3/roles/member => generated 84 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:27:21.380752 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3259d99d-0deb-4dbc-9a51-b1a2d0f29c28 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:27:21.401669 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99130c1d-ceda-41fe-9d08-e360cd416a12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:27:21.402363 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99130c1d-ceda-41fe-9d08-e360cd416a12 None admin] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:21.402638 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99130c1d-ceda-41fe-9d08-e360cd416a12 None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:21.402920 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99130c1d-ceda-41fe-9d08-e360cd416a12 None admin] PATH_INFO: `/v3/users` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:21.406539 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99130c1d-ceda-41fe-9d08-e360cd416a12 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:27:21.408157 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99130c1d-ceda-41fe-9d08-e360cd416a12 None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:27:21.447032 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 135/276] 10.222.0.67 () {60 vars in 1132 bytes} [Wed May 25 14:27:21 2022] POST /identity/v3/users => generated 293 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 14:27:21.553140 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3259d99d-0deb-4dbc-9a51-b1a2d0f29c28 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:27:21.599446 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94766a4-3435-4989-9d4b-be2c8a5b727e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:27:21.600135 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94766a4-3435-4989-9d4b-be2c8a5b727e None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:21.600423 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94766a4-3435-4989-9d4b-be2c8a5b727e None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:21.600704 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94766a4-3435-4989-9d4b-be2c8a5b727e None admin] PATH_INFO: `/v3/roles` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:21.601467 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94766a4-3435-4989-9d4b-be2c8a5b727e None admin] RBAC: Adding query filter params (name=member) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:27:21.601780 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94766a4-3435-4989-9d4b-be2c8a5b727e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:27:21.603309 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94766a4-3435-4989-9d4b-be2c8a5b727e None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:27:21.613998 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 142/277] 10.222.0.67 () {56 vars in 1101 bytes} [Wed May 25 14:27:21 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:27:21.619916 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99130c1d-ceda-41fe-9d08-e360cd416a12 None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:27:21.760794 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99130c1d-ceda-41fe-9d08-e360cd416a12 None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:27:21.801931 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84c1a37-900c-476e-82af-87694b44766f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:27:21.803321 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84c1a37-900c-476e-82af-87694b44766f None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:21.803614 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84c1a37-900c-476e-82af-87694b44766f None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:21.803903 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84c1a37-900c-476e-82af-87694b44766f None admin] PATH_INFO: `/v3/users/d5b773c36b6248b7aa53fd993bbaf8d4` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:21.819325 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84c1a37-900c-476e-82af-87694b44766f None admin] RBAC: Authorizing `identity:get_user(user_id=d5b773c36b6248b7aa53fd993bbaf8d4)` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:27:21.820861 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84c1a37-900c-476e-82af-87694b44766f None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:27:21.823254 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 136/278] 10.222.0.67 () {56 vars in 1177 bytes} [Wed May 25 14:27:21 2022] GET /identity/v3/users/d5b773c36b6248b7aa53fd993bbaf8d4 => generated 293 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:27:21.831516 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94766a4-3435-4989-9d4b-be2c8a5b727e None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:27:21.869015 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:27:22.010056 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94766a4-3435-4989-9d4b-be2c8a5b727e None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:27:22.065139 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9c2ad5-d10a-4173-bec5-726dcba042e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:27:22.065968 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9c2ad5-d10a-4173-bec5-726dcba042e2 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:22.066481 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9c2ad5-d10a-4173-bec5-726dcba042e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:22.066980 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9c2ad5-d10a-4173-bec5-726dcba042e2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:22.067878 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9c2ad5-d10a-4173-bec5-726dcba042e2 None admin] RBAC: Adding query filter params (role.id=48808901834b4d5eab2c7e6b5b03791e, user.id=d5b773c36b6248b7aa53fd993bbaf8d4, scope.system=all) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:27:22.068284 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9c2ad5-d10a-4173-bec5-726dcba042e2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:27:22.070131 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9c2ad5-d10a-4173-bec5-726dcba042e2 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:27:22.076460 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 143/279] 10.222.0.67 () {56 vars in 1308 bytes} [Wed May 25 14:27:21 2022] GET /identity/v3/role_assignments?user.id=d5b773c36b6248b7aa53fd993bbaf8d4&scope.system=all&role.id=48808901834b4d5eab2c7e6b5b03791e => generated 226 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:27:22.242173 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4be949-6573-4e0f-87e2-831095e3d17f None None] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:22.242688 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4be949-6573-4e0f-87e2-831095e3d17f None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:22.242762 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4be949-6573-4e0f-87e2-831095e3d17f None None] PATH_INFO: `/` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:22.244151 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 137/280] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 14:27:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:27:22.250146 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234d290b-98eb-48a8-baca-a85713335624 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:22.250679 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234d290b-98eb-48a8-baca-a85713335624 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:22.250757 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234d290b-98eb-48a8-baca-a85713335624 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:22.272230 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-234d290b-98eb-48a8-baca-a85713335624 None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:27:22.273451 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-234d290b-98eb-48a8-baca-a85713335624 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:27:22.358503 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 144/281] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 14:27:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 14:27:22.381770 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4be949-6573-4e0f-87e2-831095e3d17f None None] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:27:22.408505 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:27:22.519793 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4be949-6573-4e0f-87e2-831095e3d17f None None] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:27:22.563014 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d816135-f488-4e1d-a6e8-15ea5b07fd96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:27:22.563916 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d816135-f488-4e1d-a6e8-15ea5b07fd96 None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:22.564204 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d816135-f488-4e1d-a6e8-15ea5b07fd96 None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:22.564479 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d816135-f488-4e1d-a6e8-15ea5b07fd96 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:22.585339 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d816135-f488-4e1d-a6e8-15ea5b07fd96 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:27:22.593748 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application [None req-0d816135-f488-4e1d-a6e8-15ea5b07fd96 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 25 14:27:22.593748 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:27:22.593748 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:27:22.593748 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:27:22.593748 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:27:22.593748 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:27:22.593748 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:27:22.593748 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:27:22.593748 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:27:22.593748 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:27:22.593748 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:27:22.593748 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:27:22.593748 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:27:22.593748 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:27:22.593748 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:27:22.593748 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:27:22.594670 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:27:22.594670 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:27:22.594670 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:27:22.594670 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:27:22.594670 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:27:22.594670 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:27:22.594670 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:27:22.594670 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:27:22.594670 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:27:22.594670 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:27:22.594670 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:27:22.594670 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application with Lock( May 25 14:27:22.594670 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:27:22.594670 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self._enter() May 25 14:27:22.594670 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:27:22.594670 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:27:22.595524 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:27:22.595524 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.creator() May 25 14:27:22.595524 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:27:22.595524 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application created_value = creator( May 25 14:27:22.595524 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:27:22.595524 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:27:22.595524 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:27:22.595524 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:27:22.595524 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:27:22.595524 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:27:22.595524 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 25 14:27:22.595524 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application May 25 14:27:22.595524 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 138/282] 10.222.0.67 () {56 vars in 1099 bytes} [Wed May 25 14:27:22 2022] GET /identity/v3/roles/reader => generated 84 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:27:22.600854 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234d290b-98eb-48a8-baca-a85713335624 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:27:22.612082 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:27:22.795844 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234d290b-98eb-48a8-baca-a85713335624 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:27:22.858345 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115c1df2-b5cf-4c6f-93a9-88034367fc1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:27:22.859329 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115c1df2-b5cf-4c6f-93a9-88034367fc1d None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:22.859540 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115c1df2-b5cf-4c6f-93a9-88034367fc1d None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:22.859817 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115c1df2-b5cf-4c6f-93a9-88034367fc1d None admin] PATH_INFO: `/v3/roles` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:22.860619 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115c1df2-b5cf-4c6f-93a9-88034367fc1d None admin] RBAC: Adding query filter params (name=reader) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:27:22.860936 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115c1df2-b5cf-4c6f-93a9-88034367fc1d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:27:22.862415 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115c1df2-b5cf-4c6f-93a9-88034367fc1d None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:27:22.872039 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 145/283] 10.222.0.67 () {56 vars in 1101 bytes} [Wed May 25 14:27:22 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:27:22.884147 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d816135-f488-4e1d-a6e8-15ea5b07fd96 None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:27:23.013063 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:27:23.044548 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d816135-f488-4e1d-a6e8-15ea5b07fd96 None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:27:23.101215 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc173a1d-08e5-42d8-ae2e-04842311274d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:27:23.102097 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc173a1d-08e5-42d8-ae2e-04842311274d None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:23.102379 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc173a1d-08e5-42d8-ae2e-04842311274d None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:23.102651 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc173a1d-08e5-42d8-ae2e-04842311274d None admin] PATH_INFO: `/v3/users/a4354e46c9ab453d8bd2030fd9ad051c` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:23.103900 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc173a1d-08e5-42d8-ae2e-04842311274d None admin] RBAC: Authorizing `identity:get_user(user_id=a4354e46c9ab453d8bd2030fd9ad051c)` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:27:23.105353 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc173a1d-08e5-42d8-ae2e-04842311274d None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:27:23.107007 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 139/284] 10.222.0.67 () {56 vars in 1177 bytes} [Wed May 25 14:27:22 2022] GET /identity/v3/users/a4354e46c9ab453d8bd2030fd9ad051c => generated 297 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:27:23.112838 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115c1df2-b5cf-4c6f-93a9-88034367fc1d None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:27:23.301101 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:27:23.368684 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115c1df2-b5cf-4c6f-93a9-88034367fc1d None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:27:23.445424 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7120d156-6652-420a-a9e8-328ceaf1f32d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:27:23.446317 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7120d156-6652-420a-a9e8-328ceaf1f32d None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:23.446606 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7120d156-6652-420a-a9e8-328ceaf1f32d None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:23.446886 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7120d156-6652-420a-a9e8-328ceaf1f32d None admin] PATH_INFO: `/v3/projects/24460f2e7a5e44f19737eed3c6799a16` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:23.451025 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7120d156-6652-420a-a9e8-328ceaf1f32d None admin] RBAC: Authorizing `identity:get_project(project_id=24460f2e7a5e44f19737eed3c6799a16)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:27:23.453330 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb921153-f085-4f56-8e74-b3fcede203b7 None None] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:23.453798 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7120d156-6652-420a-a9e8-328ceaf1f32d None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:27:23.454255 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb921153-f085-4f56-8e74-b3fcede203b7 None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:23.454707 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb921153-f085-4f56-8e74-b3fcede203b7 None None] PATH_INFO: `/` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:23.455565 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 146/285] 10.222.0.67 () {56 vars in 1186 bytes} [Wed May 25 14:27:23 2022] GET /identity/v3/projects/24460f2e7a5e44f19737eed3c6799a16 => generated 302 bytes in 343 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:27:23.456485 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 140/286] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 14:27:23 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:27:23.462108 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7120d156-6652-420a-a9e8-328ceaf1f32d None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:27:23.466936 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345a884d-b37b-4a15-a95d-9ec56ea8d930 None None] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:23.467498 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345a884d-b37b-4a15-a95d-9ec56ea8d930 None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:23.468619 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345a884d-b37b-4a15-a95d-9ec56ea8d930 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:23.511502 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.auth.core [None req-345a884d-b37b-4a15-a95d-9ec56ea8d930 None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:27:23.514093 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-345a884d-b37b-4a15-a95d-9ec56ea8d930 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:27:23.611010 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7120d156-6652-420a-a9e8-328ceaf1f32d None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:27:23.669745 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5ddaf3-9688-43fa-b82e-3559bd17dedf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:27:23.671069 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5ddaf3-9688-43fa-b82e-3559bd17dedf None admin] REQUEST_METHOD: `PUT` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:23.671574 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5ddaf3-9688-43fa-b82e-3559bd17dedf None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:23.672066 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5ddaf3-9688-43fa-b82e-3559bd17dedf None admin] PATH_INFO: `/v3/projects/24460f2e7a5e44f19737eed3c6799a16/users/a4354e46c9ab453d8bd2030fd9ad051c/roles/ed5296b21eba4c49b7792056991162da` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:23.675759 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5ddaf3-9688-43fa-b82e-3559bd17dedf None admin] RBAC: Authorizing `identity:create_grant(project_id=24460f2e7a5e44f19737eed3c6799a16, user_id=a4354e46c9ab453d8bd2030fd9ad051c, role_id=ed5296b21eba4c49b7792056991162da)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:27:23.675980 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 141/287] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 14:27:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 14:27:23.677620 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5ddaf3-9688-43fa-b82e-3559bd17dedf None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:27:23.687730 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:27:23.698338 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 147/288] 10.222.0.67 () {58 vars in 1439 bytes} [Wed May 25 14:27:23 2022] PUT /identity/v3/projects/24460f2e7a5e44f19737eed3c6799a16/users/a4354e46c9ab453d8bd2030fd9ad051c/roles/ed5296b21eba4c49b7792056991162da => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:27:23.730448 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345a884d-b37b-4a15-a95d-9ec56ea8d930 None None] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:27:23.841524 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:27:23.886099 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345a884d-b37b-4a15-a95d-9ec56ea8d930 None None] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:27:23.985762 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b215d9-8c39-4e3e-90b4-7eedd0988568 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:27:23.987187 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b215d9-8c39-4e3e-90b4-7eedd0988568 None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:23.987731 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b215d9-8c39-4e3e-90b4-7eedd0988568 None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:23.988264 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b215d9-8c39-4e3e-90b4-7eedd0988568 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:24.007635 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b215d9-8c39-4e3e-90b4-7eedd0988568 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:27:24.016500 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application [None req-62b215d9-8c39-4e3e-90b4-7eedd0988568 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 25 14:27:24.016500 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:27:24.016500 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:27:24.016500 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:27:24.016500 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:27:24.016500 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:27:24.016500 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:27:24.016500 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:27:24.016500 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:27:24.016500 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:27:24.016500 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:27:24.016500 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:27:24.016500 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:27:24.016500 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:27:24.016500 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:27:24.016500 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:27:24.017562 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:27:24.017562 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:27:24.017562 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:27:24.017562 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:27:24.017562 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:27:24.017562 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:27:24.017562 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:27:24.017562 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:27:24.017562 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:27:24.017562 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:27:24.017562 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:27:24.017562 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application with Lock( May 25 14:27:24.017562 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:27:24.017562 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self._enter() May 25 14:27:24.017562 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:27:24.017562 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:27:24.018549 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:27:24.018549 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.creator() May 25 14:27:24.018549 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:27:24.018549 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application created_value = creator( May 25 14:27:24.018549 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:27:24.018549 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:27:24.018549 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:27:24.018549 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:27:24.018549 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:27:24.018549 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:27:24.018549 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 25 14:27:24.018549 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application May 25 14:27:24.020997 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 142/289] 10.222.0.67 () {56 vars in 1099 bytes} [Wed May 25 14:27:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:27:24.026790 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5ddaf3-9688-43fa-b82e-3559bd17dedf None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:27:24.150700 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5ddaf3-9688-43fa-b82e-3559bd17dedf None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:27:24.201685 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594761a4-fa52-477a-a0c0-f4bbd2676969 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:27:24.203674 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594761a4-fa52-477a-a0c0-f4bbd2676969 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:24.204103 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594761a4-fa52-477a-a0c0-f4bbd2676969 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:24.204522 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594761a4-fa52-477a-a0c0-f4bbd2676969 None admin] PATH_INFO: `/v3/roles` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:24.205414 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594761a4-fa52-477a-a0c0-f4bbd2676969 None admin] RBAC: Adding query filter params (name=member) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:27:24.205881 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594761a4-fa52-477a-a0c0-f4bbd2676969 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:27:24.207440 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594761a4-fa52-477a-a0c0-f4bbd2676969 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:27:24.224084 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 148/290] 10.222.0.67 () {56 vars in 1101 bytes} [Wed May 25 14:27:24 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:27:24.229468 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b215d9-8c39-4e3e-90b4-7eedd0988568 None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:27:24.394960 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b215d9-8c39-4e3e-90b4-7eedd0988568 None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:27:24.442630 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c77dbbc-a1ef-46aa-84db-485e58f42be5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:27:24.443934 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c77dbbc-a1ef-46aa-84db-485e58f42be5 None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:24.444443 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c77dbbc-a1ef-46aa-84db-485e58f42be5 None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:24.444920 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c77dbbc-a1ef-46aa-84db-485e58f42be5 None admin] PATH_INFO: `/v3/users/e118c68b35e948c7aca512c77744428d` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:24.451823 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c77dbbc-a1ef-46aa-84db-485e58f42be5 None admin] RBAC: Authorizing `identity:get_user(user_id=e118c68b35e948c7aca512c77744428d)` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:27:24.454146 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c77dbbc-a1ef-46aa-84db-485e58f42be5 None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:27:24.456570 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 143/291] 10.222.0.67 () {56 vars in 1177 bytes} [Wed May 25 14:27:24 2022] GET /identity/v3/users/e118c68b35e948c7aca512c77744428d => generated 297 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:27:24.463189 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594761a4-fa52-477a-a0c0-f4bbd2676969 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:27:24.576948 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:27:24.602258 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043c5cc2-534a-4c46-ad87-ab77aba8e00f None None] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:24.603251 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043c5cc2-534a-4c46-ad87-ab77aba8e00f None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:24.604030 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043c5cc2-534a-4c46-ad87-ab77aba8e00f None None] PATH_INFO: `/` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:24.606833 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 144/292] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 14:27:24 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:27:24.612996 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b791da5-1a72-42de-9ae7-e29a75893b69 None None] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:24.613820 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b791da5-1a72-42de-9ae7-e29a75893b69 None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:24.614617 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b791da5-1a72-42de-9ae7-e29a75893b69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:24.628595 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:27:24.647972 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594761a4-fa52-477a-a0c0-f4bbd2676969 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:27:24.656570 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.auth.core [None req-3b791da5-1a72-42de-9ae7-e29a75893b69 None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:27:24.657826 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-3b791da5-1a72-42de-9ae7-e29a75893b69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:27:24.696606 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe82010-364f-43f4-9147-f374fb77eb4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:27:24.697428 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe82010-364f-43f4-9147-f374fb77eb4b None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:24.697721 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe82010-364f-43f4-9147-f374fb77eb4b None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:24.698002 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe82010-364f-43f4-9147-f374fb77eb4b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:24.777924 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe82010-364f-43f4-9147-f374fb77eb4b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:27:24.779856 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe82010-364f-43f4-9147-f374fb77eb4b None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:27:24.867573 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:27:24.904473 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 149/293] 10.222.0.67 () {58 vars in 1282 bytes} [Wed May 25 14:27:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 442 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 14:27:24.911673 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe82010-364f-43f4-9147-f374fb77eb4b None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:27:24.913534 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 145/294] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 14:27:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 302 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 14:27:24.915197 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128df71b-7762-4e1d-a9f0-ad71ab916e5e None None] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:24.915662 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128df71b-7762-4e1d-a9f0-ad71ab916e5e None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:24.916079 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128df71b-7762-4e1d-a9f0-ad71ab916e5e None None] PATH_INFO: `/` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:24.917699 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 146/295] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 14:27:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:27:24.932609 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8132c6-cc92-4185-9406-1b5e96881de7 None None] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:24.933194 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8132c6-cc92-4185-9406-1b5e96881de7 None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:24.933691 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8132c6-cc92-4185-9406-1b5e96881de7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:24.953214 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.auth.core [None req-2f8132c6-cc92-4185-9406-1b5e96881de7 None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:27:24.954770 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-2f8132c6-cc92-4185-9406-1b5e96881de7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:27:25.026108 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe82010-364f-43f4-9147-f374fb77eb4b None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:27:25.035537 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 147/296] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 14:27:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 14:27:25.036398 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8132c6-cc92-4185-9406-1b5e96881de7 None None] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:27:25.069612 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38d0e2f-3556-40bb-b1ad-76e02b129a48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:27:25.070485 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38d0e2f-3556-40bb-b1ad-76e02b129a48 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:25.070774 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38d0e2f-3556-40bb-b1ad-76e02b129a48 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:25.071072 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38d0e2f-3556-40bb-b1ad-76e02b129a48 None admin] PATH_INFO: `/v3/projects/24460f2e7a5e44f19737eed3c6799a16` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:25.072339 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38d0e2f-3556-40bb-b1ad-76e02b129a48 None admin] RBAC: Authorizing `identity:get_project(project_id=24460f2e7a5e44f19737eed3c6799a16)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:27:25.073799 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38d0e2f-3556-40bb-b1ad-76e02b129a48 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:27:25.075533 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 150/297] 10.222.0.67 () {56 vars in 1186 bytes} [Wed May 25 14:27:24 2022] GET /identity/v3/projects/24460f2e7a5e44f19737eed3c6799a16 => generated 302 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:27:25.076836 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f25846f-be50-461b-adad-bbb5a5db2206 None None] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:25.077153 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f25846f-be50-461b-adad-bbb5a5db2206 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:25.077444 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f25846f-be50-461b-adad-bbb5a5db2206 None None] PATH_INFO: `/` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:25.079086 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 151/298] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 14:27:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:27:25.083409 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f25846f-be50-461b-adad-bbb5a5db2206 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:27:25.111833 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:27:25.116723 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:27:25.171524 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8132c6-cc92-4185-9406-1b5e96881de7 None None] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:27:25.198547 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f25846f-be50-461b-adad-bbb5a5db2206 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:27:25.215389 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33da052c-18d2-4beb-b6ca-ba41606b82eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:27:25.216346 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33da052c-18d2-4beb-b6ca-ba41606b82eb None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:25.216634 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33da052c-18d2-4beb-b6ca-ba41606b82eb None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:25.217195 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33da052c-18d2-4beb-b6ca-ba41606b82eb None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:25.230896 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33da052c-18d2-4beb-b6ca-ba41606b82eb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:27:25.234905 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e758ac74-8f98-4e75-ab8c-bd579b885afb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:27:25.235731 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e758ac74-8f98-4e75-ab8c-bd579b885afb None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:25.236011 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e758ac74-8f98-4e75-ab8c-bd579b885afb None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:25.236282 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e758ac74-8f98-4e75-ab8c-bd579b885afb None admin] PATH_INFO: `/v3/roles/member` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:25.239535 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application [None req-33da052c-18d2-4beb-b6ca-ba41606b82eb None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 25 14:27:25.239535 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:27:25.239535 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:27:25.239535 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:27:25.239535 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:27:25.239535 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:27:25.239535 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:27:25.239535 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:27:25.239535 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:27:25.239535 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:27:25.239535 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:27:25.239535 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:27:25.239535 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:27:25.239535 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:27:25.239535 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:27:25.239535 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:27:25.240431 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:27:25.240431 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:27:25.240431 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:27:25.240431 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:27:25.240431 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:27:25.240431 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:27:25.240431 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:27:25.240431 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:27:25.240431 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:27:25.240431 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:27:25.240431 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:27:25.240431 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application with Lock( May 25 14:27:25.240431 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:27:25.240431 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self._enter() May 25 14:27:25.240431 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:27:25.240431 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:27:25.241262 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:27:25.241262 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.creator() May 25 14:27:25.241262 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:27:25.241262 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application created_value = creator( May 25 14:27:25.241262 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:27:25.241262 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:27:25.241262 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:27:25.241262 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:27:25.241262 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:27:25.241262 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:27:25.241262 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 25 14:27:25.241262 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application May 25 14:27:25.241262 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 148/299] 10.222.0.67 () {56 vars in 1099 bytes} [Wed May 25 14:27:25 2022] GET /identity/v3/roles/reader => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:27:25.243998 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33da052c-18d2-4beb-b6ca-ba41606b82eb None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:27:25.248709 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e758ac74-8f98-4e75-ab8c-bd579b885afb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:27:25.256460 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application [None req-e758ac74-8f98-4e75-ab8c-bd579b885afb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 25 14:27:25.256460 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:27:25.256460 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:27:25.256460 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:27:25.256460 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:27:25.256460 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:27:25.256460 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:27:25.256460 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:27:25.256460 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:27:25.256460 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:27:25.256460 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:27:25.256460 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:27:25.256460 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:27:25.256460 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:27:25.256460 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:27:25.256460 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:27:25.257355 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:27:25.257355 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:27:25.257355 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:27:25.257355 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:27:25.257355 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:27:25.257355 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:27:25.257355 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:27:25.257355 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:27:25.257355 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:27:25.257355 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:27:25.257355 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:27:25.257355 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application with Lock( May 25 14:27:25.257355 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:27:25.257355 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._enter() May 25 14:27:25.257355 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:27:25.257355 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:27:25.258203 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:27:25.258203 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.creator() May 25 14:27:25.258203 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:27:25.258203 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application created_value = creator( May 25 14:27:25.258203 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:27:25.258203 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:27:25.258203 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:27:25.258203 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:27:25.258203 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:27:25.258203 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:27:25.258203 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 25 14:27:25.258203 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:27:25.258203 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 152/300] 10.222.0.67 () {56 vars in 1099 bytes} [Wed May 25 14:27:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:27:25.259398 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2e9dda-cb93-4864-b6af-058d1a6c53bd None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:25.259398 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2e9dda-cb93-4864-b6af-058d1a6c53bd None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:25.259567 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2e9dda-cb93-4864-b6af-058d1a6c53bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:25.276157 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-bc2e9dda-cb93-4864-b6af-058d1a6c53bd None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:27:25.277321 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-bc2e9dda-cb93-4864-b6af-058d1a6c53bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:27:25.349123 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 153/301] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 14:27:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 14:27:25.349964 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2e9dda-cb93-4864-b6af-058d1a6c53bd None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:27:25.362615 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33da052c-18d2-4beb-b6ca-ba41606b82eb None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:27:25.376880 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:27:25.388804 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:27:25.404200 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f01bbd3-ee98-4441-846e-90a139abab35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:27:25.405168 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f01bbd3-ee98-4441-846e-90a139abab35 None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:25.406027 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f01bbd3-ee98-4441-846e-90a139abab35 None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:25.406496 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f01bbd3-ee98-4441-846e-90a139abab35 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:25.407374 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f01bbd3-ee98-4441-846e-90a139abab35 None admin] RBAC: Adding query filter params (role.id=48808901834b4d5eab2c7e6b5b03791e, scope.project.id=24460f2e7a5e44f19737eed3c6799a16, user.id=e118c68b35e948c7aca512c77744428d) {{(pid=80474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:27:25.407686 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f01bbd3-ee98-4441-846e-90a139abab35 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:27:25.409136 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f01bbd3-ee98-4441-846e-90a139abab35 None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:27:25.415419 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 149/302] 10.222.0.67 () {56 vars in 1374 bytes} [Wed May 25 14:27:25 2022] GET /identity/v3/role_assignments?user.id=e118c68b35e948c7aca512c77744428d&scope.project.id=24460f2e7a5e44f19737eed3c6799a16&role.id=48808901834b4d5eab2c7e6b5b03791e => generated 608 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:27:25.416184 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f01bbd3-ee98-4441-846e-90a139abab35 None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:27:25.492295 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2e9dda-cb93-4864-b6af-058d1a6c53bd None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:27:25.539616 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f01bbd3-ee98-4441-846e-90a139abab35 None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:27:25.545347 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f523a8c8-dea7-4e78-94b1-d41f7cede4c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:27:25.546772 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f523a8c8-dea7-4e78-94b1-d41f7cede4c5 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:25.547140 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f523a8c8-dea7-4e78-94b1-d41f7cede4c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:25.547480 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f523a8c8-dea7-4e78-94b1-d41f7cede4c5 None admin] PATH_INFO: `/v3/roles` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:25.548311 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f523a8c8-dea7-4e78-94b1-d41f7cede4c5 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:27:25.548683 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f523a8c8-dea7-4e78-94b1-d41f7cede4c5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:27:25.550353 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f523a8c8-dea7-4e78-94b1-d41f7cede4c5 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:27:25.565937 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 154/303] 10.222.0.67 () {56 vars in 1101 bytes} [Wed May 25 14:27:25 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:27:25.565937 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f523a8c8-dea7-4e78-94b1-d41f7cede4c5 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:27:25.595142 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258fb3d8-82db-4995-9884-49924fce185b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:27:25.596385 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258fb3d8-82db-4995-9884-49924fce185b None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:25.596823 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258fb3d8-82db-4995-9884-49924fce185b None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:25.597878 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258fb3d8-82db-4995-9884-49924fce185b None admin] PATH_INFO: `/v3/roles` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:25.599081 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258fb3d8-82db-4995-9884-49924fce185b None admin] RBAC: Adding query filter params (name=member) {{(pid=80474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:27:25.599546 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258fb3d8-82db-4995-9884-49924fce185b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:27:25.601800 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258fb3d8-82db-4995-9884-49924fce185b None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:27:25.614106 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 150/304] 10.222.0.67 () {56 vars in 1101 bytes} [Wed May 25 14:27:25 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:27:25.615287 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258fb3d8-82db-4995-9884-49924fce185b None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:27:25.662374 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:27:25.681933 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:27:25.695507 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f523a8c8-dea7-4e78-94b1-d41f7cede4c5 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:27:25.739816 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e12aa78-d7d9-4b84-84d7-9b247d22b39f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:27:25.740788 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e12aa78-d7d9-4b84-84d7-9b247d22b39f None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:25.741150 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e12aa78-d7d9-4b84-84d7-9b247d22b39f None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:25.741432 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e12aa78-d7d9-4b84-84d7-9b247d22b39f None admin] PATH_INFO: `/v3/domains/default` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:25.742728 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e12aa78-d7d9-4b84-84d7-9b247d22b39f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:27:25.744173 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e12aa78-d7d9-4b84-84d7-9b247d22b39f None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:27:25.746263 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 155/305] 10.222.0.67 () {56 vars in 1108 bytes} [Wed May 25 14:27:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:27:25.746856 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e12aa78-d7d9-4b84-84d7-9b247d22b39f None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:27:25.754025 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258fb3d8-82db-4995-9884-49924fce185b None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:27:25.791892 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cae0432-6e45-4724-a498-5097ba367c89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:27:25.793119 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cae0432-6e45-4724-a498-5097ba367c89 None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:25.793733 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cae0432-6e45-4724-a498-5097ba367c89 None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:25.794081 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cae0432-6e45-4724-a498-5097ba367c89 None admin] PATH_INFO: `/v3/users/1706b5e6e40e426a92b17d4f01e57e6f` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:25.809565 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cae0432-6e45-4724-a498-5097ba367c89 None admin] RBAC: Authorizing `identity:get_user(user_id=1706b5e6e40e426a92b17d4f01e57e6f)` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:27:25.811710 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cae0432-6e45-4724-a498-5097ba367c89 None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:27:25.814423 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 151/306] 10.222.0.67 () {56 vars in 1177 bytes} [Wed May 25 14:27:25 2022] GET /identity/v3/users/1706b5e6e40e426a92b17d4f01e57e6f => generated 293 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:27:25.815294 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cae0432-6e45-4724-a498-5097ba367c89 None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:27:25.864894 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e12aa78-d7d9-4b84-84d7-9b247d22b39f None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:27:25.907183 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946a3c2e-7b72-46d5-9ea2-f145cb8a5ba2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:27:25.908069 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946a3c2e-7b72-46d5-9ea2-f145cb8a5ba2 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:25.908408 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946a3c2e-7b72-46d5-9ea2-f145cb8a5ba2 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:25.908694 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946a3c2e-7b72-46d5-9ea2-f145cb8a5ba2 None admin] PATH_INFO: `/v3/users/d5b773c36b6248b7aa53fd993bbaf8d4` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:25.909886 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946a3c2e-7b72-46d5-9ea2-f145cb8a5ba2 None admin] RBAC: Authorizing `identity:get_user(user_id=d5b773c36b6248b7aa53fd993bbaf8d4)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:27:25.911339 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946a3c2e-7b72-46d5-9ea2-f145cb8a5ba2 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:27:25.917482 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 156/307] 10.222.0.67 () {56 vars in 1177 bytes} [Wed May 25 14:27:25 2022] GET /identity/v3/users/d5b773c36b6248b7aa53fd993bbaf8d4 => generated 293 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:27:25.917482 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946a3c2e-7b72-46d5-9ea2-f145cb8a5ba2 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:27:25.931985 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:27:25.932428 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cae0432-6e45-4724-a498-5097ba367c89 None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:27:25.941999 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:27:25.971658 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca3ef1a-8c1f-4d03-8b71-cd5f042f24fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:27:25.972335 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca3ef1a-8c1f-4d03-8b71-cd5f042f24fe None admin] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:25.972625 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca3ef1a-8c1f-4d03-8b71-cd5f042f24fe None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:25.973015 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca3ef1a-8c1f-4d03-8b71-cd5f042f24fe None admin] PATH_INFO: `/v3/groups` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:25.974152 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca3ef1a-8c1f-4d03-8b71-cd5f042f24fe None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:27:25.975696 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca3ef1a-8c1f-4d03-8b71-cd5f042f24fe None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:27:25.991051 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 152/308] 10.222.0.67 () {60 vars in 1134 bytes} [Wed May 25 14:27:25 2022] POST /identity/v3/groups => generated 229 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:27:25.991772 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca3ef1a-8c1f-4d03-8b71-cd5f042f24fe None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:27:26.054498 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946a3c2e-7b72-46d5-9ea2-f145cb8a5ba2 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:27:26.111531 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125f0b88-77e1-4f08-939a-ad84541a9258 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:27:26.113265 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125f0b88-77e1-4f08-939a-ad84541a9258 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:26.113752 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125f0b88-77e1-4f08-939a-ad84541a9258 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:26.114478 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125f0b88-77e1-4f08-939a-ad84541a9258 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:26.115879 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125f0b88-77e1-4f08-939a-ad84541a9258 None admin] RBAC: Adding query filter params (role.id=ed5296b21eba4c49b7792056991162da, user.id=1706b5e6e40e426a92b17d4f01e57e6f, scope.system=all) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:27:26.116846 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125f0b88-77e1-4f08-939a-ad84541a9258 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:27:26.118831 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125f0b88-77e1-4f08-939a-ad84541a9258 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:27:26.119739 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca3ef1a-8c1f-4d03-8b71-cd5f042f24fe None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:27:26.127148 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 157/309] 10.222.0.67 () {56 vars in 1308 bytes} [Wed May 25 14:27:25 2022] GET /identity/v3/role_assignments?user.id=1706b5e6e40e426a92b17d4f01e57e6f&scope.system=all&role.id=ed5296b21eba4c49b7792056991162da => generated 226 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:27:26.164740 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9542818c-57fa-4482-b98d-896e754a2453 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:27:26.165972 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9542818c-57fa-4482-b98d-896e754a2453 None admin] REQUEST_METHOD: `PUT` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:26.166444 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9542818c-57fa-4482-b98d-896e754a2453 None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:26.166901 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9542818c-57fa-4482-b98d-896e754a2453 None admin] PATH_INFO: `/v3/system/users/d5b773c36b6248b7aa53fd993bbaf8d4/roles/48808901834b4d5eab2c7e6b5b03791e` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:26.168846 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9542818c-57fa-4482-b98d-896e754a2453 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=d5b773c36b6248b7aa53fd993bbaf8d4, role_id=48808901834b4d5eab2c7e6b5b03791e)` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:27:26.170574 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9542818c-57fa-4482-b98d-896e754a2453 None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:27:26.185991 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 153/310] 10.222.0.67 () {58 vars in 1334 bytes} [Wed May 25 14:27:25 2022] PUT /identity/v3/system/users/d5b773c36b6248b7aa53fd993bbaf8d4/roles/48808901834b4d5eab2c7e6b5b03791e => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:27:26.288346 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f518facb-d48d-468a-b269-cbd6c011646a None None] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:26.288639 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f518facb-d48d-468a-b269-cbd6c011646a None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:26.288930 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f518facb-d48d-468a-b269-cbd6c011646a None None] PATH_INFO: `/` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:26.291749 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 158/311] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 14:27:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:27:26.298071 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07096dae-7b48-4dc5-8c3c-f2a22597ef0c None None] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:26.298363 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07096dae-7b48-4dc5-8c3c-f2a22597ef0c None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:26.298653 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07096dae-7b48-4dc5-8c3c-f2a22597ef0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:26.318151 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.auth.core [None req-07096dae-7b48-4dc5-8c3c-f2a22597ef0c None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:27:26.319346 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-07096dae-7b48-4dc5-8c3c-f2a22597ef0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:27:26.348858 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:27:26.402579 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 154/312] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 14:27:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 14:27:26.426607 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f518facb-d48d-468a-b269-cbd6c011646a None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:27:26.513889 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:27:26.539812 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f518facb-d48d-468a-b269-cbd6c011646a None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:27:26.583199 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b36431b-f8b0-4905-8f5b-2088e89f048c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:27:26.584283 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b36431b-f8b0-4905-8f5b-2088e89f048c None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:26.584745 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b36431b-f8b0-4905-8f5b-2088e89f048c None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:26.585265 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b36431b-f8b0-4905-8f5b-2088e89f048c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:26.596737 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b36431b-f8b0-4905-8f5b-2088e89f048c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:27:26.605048 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application [None req-1b36431b-f8b0-4905-8f5b-2088e89f048c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 25 14:27:26.605048 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:27:26.605048 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:27:26.605048 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:27:26.605048 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:27:26.605048 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:27:26.605048 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:27:26.605048 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:27:26.605048 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:27:26.605048 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:27:26.605048 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:27:26.605048 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:27:26.605048 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:27:26.605048 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:27:26.605048 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:27:26.605048 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:27:26.605961 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:27:26.605961 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:27:26.605961 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:27:26.605961 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:27:26.605961 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:27:26.605961 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:27:26.605961 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:27:26.605961 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:27:26.605961 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:27:26.605961 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:27:26.605961 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:27:26.605961 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application with Lock( May 25 14:27:26.605961 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:27:26.605961 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._enter() May 25 14:27:26.605961 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:27:26.605961 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:27:26.606780 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:27:26.606780 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.creator() May 25 14:27:26.606780 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:27:26.606780 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application created_value = creator( May 25 14:27:26.606780 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:27:26.606780 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:27:26.606780 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:27:26.606780 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:27:26.606780 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:27:26.606780 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:27:26.606780 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 25 14:27:26.606780 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:27:26.609700 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 159/313] 10.222.0.67 () {56 vars in 1099 bytes} [Wed May 25 14:27:26 2022] GET /identity/v3/roles/reader => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:27:26.615533 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07096dae-7b48-4dc5-8c3c-f2a22597ef0c None None] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:27:26.731497 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07096dae-7b48-4dc5-8c3c-f2a22597ef0c None None] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:27:26.768409 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bfdd7e-25b9-4632-9ebf-88bc271cbef1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:27:26.769146 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bfdd7e-25b9-4632-9ebf-88bc271cbef1 None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:26.769436 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bfdd7e-25b9-4632-9ebf-88bc271cbef1 None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:26.769718 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bfdd7e-25b9-4632-9ebf-88bc271cbef1 None admin] PATH_INFO: `/v3/roles` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:26.770533 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bfdd7e-25b9-4632-9ebf-88bc271cbef1 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:27:26.770847 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bfdd7e-25b9-4632-9ebf-88bc271cbef1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:27:26.772272 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bfdd7e-25b9-4632-9ebf-88bc271cbef1 None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:27:26.781990 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 155/314] 10.222.0.67 () {56 vars in 1101 bytes} [Wed May 25 14:27:26 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:27:26.787388 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b36431b-f8b0-4905-8f5b-2088e89f048c None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:27:26.896547 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b36431b-f8b0-4905-8f5b-2088e89f048c None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:27:26.932671 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaaf844b-351a-4506-b45b-b3c67d8c8884 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:27:26.933897 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaf844b-351a-4506-b45b-b3c67d8c8884 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:26.934382 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaf844b-351a-4506-b45b-b3c67d8c8884 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:26.934879 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaf844b-351a-4506-b45b-b3c67d8c8884 None admin] PATH_INFO: `/v3/users/a4354e46c9ab453d8bd2030fd9ad051c` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:26.936284 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaaf844b-351a-4506-b45b-b3c67d8c8884 None admin] RBAC: Authorizing `identity:get_user(user_id=a4354e46c9ab453d8bd2030fd9ad051c)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:27:26.938555 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaaf844b-351a-4506-b45b-b3c67d8c8884 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:27:26.940732 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 160/315] 10.222.0.67 () {56 vars in 1177 bytes} [Wed May 25 14:27:26 2022] GET /identity/v3/users/a4354e46c9ab453d8bd2030fd9ad051c => generated 297 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:27:26.946248 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bfdd7e-25b9-4632-9ebf-88bc271cbef1 None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:27:26.972866 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:27:27.054067 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bfdd7e-25b9-4632-9ebf-88bc271cbef1 None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:27:27.088822 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5759ce23-d027-4dcf-a641-305994f94e10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:27:27.089473 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5759ce23-d027-4dcf-a641-305994f94e10 None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:27.089760 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5759ce23-d027-4dcf-a641-305994f94e10 None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:27.090041 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5759ce23-d027-4dcf-a641-305994f94e10 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:27.159442 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5759ce23-d027-4dcf-a641-305994f94e10 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:27:27.160937 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5759ce23-d027-4dcf-a641-305994f94e10 None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:27:27.195747 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:27:27.265555 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 156/316] 10.222.0.67 () {58 vars in 1282 bytes} [Wed May 25 14:27:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 14:27:27.271074 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaaf844b-351a-4506-b45b-b3c67d8c8884 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:27:27.281055 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:27:27.391581 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaaf844b-351a-4506-b45b-b3c67d8c8884 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:27:27.427495 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d04b15b-9572-4abc-ad6d-a2a03fe31223 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:27:27.428697 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d04b15b-9572-4abc-ad6d-a2a03fe31223 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:27.429203 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d04b15b-9572-4abc-ad6d-a2a03fe31223 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:27.429676 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d04b15b-9572-4abc-ad6d-a2a03fe31223 None admin] PATH_INFO: `/v3/projects/24460f2e7a5e44f19737eed3c6799a16` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:27.431103 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d04b15b-9572-4abc-ad6d-a2a03fe31223 None admin] RBAC: Authorizing `identity:get_project(project_id=24460f2e7a5e44f19737eed3c6799a16)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:27:27.432770 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d04b15b-9572-4abc-ad6d-a2a03fe31223 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:27:27.434963 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 161/317] 10.222.0.67 () {56 vars in 1186 bytes} [Wed May 25 14:27:27 2022] GET /identity/v3/projects/24460f2e7a5e44f19737eed3c6799a16 => generated 302 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:27:27.441796 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5759ce23-d027-4dcf-a641-305994f94e10 None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:27:27.544795 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5759ce23-d027-4dcf-a641-305994f94e10 None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:27:27.568342 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:27:27.580496 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8048197-3fbe-43e1-9f98-ef084fdbdedd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:27:27.581157 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8048197-3fbe-43e1-9f98-ef084fdbdedd None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:27.581450 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8048197-3fbe-43e1-9f98-ef084fdbdedd None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:27.581786 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8048197-3fbe-43e1-9f98-ef084fdbdedd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:27.582633 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8048197-3fbe-43e1-9f98-ef084fdbdedd None admin] RBAC: Adding query filter params (role.id=ed5296b21eba4c49b7792056991162da, scope.project.id=24460f2e7a5e44f19737eed3c6799a16, user.id=a4354e46c9ab453d8bd2030fd9ad051c) {{(pid=80474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:27:27.583018 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8048197-3fbe-43e1-9f98-ef084fdbdedd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:27:27.584480 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8048197-3fbe-43e1-9f98-ef084fdbdedd None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:27:27.590802 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 157/318] 10.222.0.67 () {56 vars in 1374 bytes} [Wed May 25 14:27:27 2022] GET /identity/v3/role_assignments?user.id=a4354e46c9ab453d8bd2030fd9ad051c&scope.project.id=24460f2e7a5e44f19737eed3c6799a16&role.id=ed5296b21eba4c49b7792056991162da => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:27:28.326084 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e72b0c7-c4ba-40dd-bf61-bee413812bf6 None None] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:28.326604 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e72b0c7-c4ba-40dd-bf61-bee413812bf6 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:28.326678 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e72b0c7-c4ba-40dd-bf61-bee413812bf6 None None] PATH_INFO: `/` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:28.328532 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 162/319] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 14:27:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:27:28.333767 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e1d428-d5f4-4298-be88-16a7e4aaa003 None None] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:28.334253 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e1d428-d5f4-4298-be88-16a7e4aaa003 None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:28.334330 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e1d428-d5f4-4298-be88-16a7e4aaa003 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:28.351259 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.auth.core [None req-18e1d428-d5f4-4298-be88-16a7e4aaa003 None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:27:28.352438 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-18e1d428-d5f4-4298-be88-16a7e4aaa003 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:27:28.419021 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 158/320] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 14:27:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 14:27:28.441622 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e72b0c7-c4ba-40dd-bf61-bee413812bf6 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:27:28.469192 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2636e843-1a45-4423-80d0-0b2626c3ed96 None None] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:28.469487 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2636e843-1a45-4423-80d0-0b2626c3ed96 None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:28.469769 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2636e843-1a45-4423-80d0-0b2626c3ed96 None None] PATH_INFO: `/` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:28.471181 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 159/321] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 14:27:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 14:27:28.476115 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdf81b9-18be-46b1-ad22-8a35ddf0fe64 None None] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:28.476601 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdf81b9-18be-46b1-ad22-8a35ddf0fe64 None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:28.476892 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdf81b9-18be-46b1-ad22-8a35ddf0fe64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:28.493144 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.auth.core [None req-9fdf81b9-18be-46b1-ad22-8a35ddf0fe64 None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:27:28.494316 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-9fdf81b9-18be-46b1-ad22-8a35ddf0fe64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:27:28.520019 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:27:28.548920 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e72b0c7-c4ba-40dd-bf61-bee413812bf6 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:27:28.566576 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 160/322] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 14:27:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 14:27:28.571240 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58fc5a6-ec69-45d7-ac53-deb1ea55e578 None None] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:28.571240 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58fc5a6-ec69-45d7-ac53-deb1ea55e578 None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:28.571240 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58fc5a6-ec69-45d7-ac53-deb1ea55e578 None None] PATH_INFO: `/` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:28.571240 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 161/323] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 14:27:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:27:28.575106 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0199a2b3-384a-4e1a-8b5b-26fb1566d962 None None] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:28.575397 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0199a2b3-384a-4e1a-8b5b-26fb1566d962 None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:28.575705 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0199a2b3-384a-4e1a-8b5b-26fb1566d962 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:28.587281 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91dd186-28e4-4966-ad95-e6ddbf497505 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:27:28.588378 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91dd186-28e4-4966-ad95-e6ddbf497505 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:28.588882 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91dd186-28e4-4966-ad95-e6ddbf497505 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:28.589225 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91dd186-28e4-4966-ad95-e6ddbf497505 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:28.590502 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91dd186-28e4-4966-ad95-e6ddbf497505 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:27:28.591998 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91dd186-28e4-4966-ad95-e6ddbf497505 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:27:28.593305 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.auth.core [None req-0199a2b3-384a-4e1a-8b5b-26fb1566d962 None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:27:28.594289 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 163/324] 10.222.0.67 () {56 vars in 1108 bytes} [Wed May 25 14:27:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:27:28.594905 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91dd186-28e4-4966-ad95-e6ddbf497505 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:27:28.595232 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-0199a2b3-384a-4e1a-8b5b-26fb1566d962 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:27:28.637876 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:27:28.663525 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 162/325] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 14:27:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 14:27:28.664343 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0199a2b3-384a-4e1a-8b5b-26fb1566d962 None None] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:27:28.709333 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91dd186-28e4-4966-ad95-e6ddbf497505 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:27:28.742111 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308e666c-cf06-4c2c-ab54-4174fd5f4c13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:27:28.742896 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308e666c-cf06-4c2c-ab54-4174fd5f4c13 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:28.743208 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308e666c-cf06-4c2c-ab54-4174fd5f4c13 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:28.743485 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308e666c-cf06-4c2c-ab54-4174fd5f4c13 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:28.753936 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308e666c-cf06-4c2c-ab54-4174fd5f4c13 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:27:28.761595 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application [None req-308e666c-cf06-4c2c-ab54-4174fd5f4c13 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 25 14:27:28.761595 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:27:28.761595 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:27:28.761595 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:27:28.761595 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:27:28.761595 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:27:28.761595 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:27:28.761595 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:27:28.761595 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:27:28.761595 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:27:28.761595 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:27:28.761595 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:27:28.761595 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:27:28.761595 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:27:28.761595 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:27:28.761595 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:27:28.762549 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:27:28.762549 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:27:28.762549 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:27:28.762549 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:27:28.762549 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:27:28.762549 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:27:28.762549 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:27:28.762549 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:27:28.762549 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:27:28.762549 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:27:28.762549 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:27:28.762549 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application with Lock( May 25 14:27:28.762549 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:27:28.762549 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._enter() May 25 14:27:28.762549 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:27:28.762549 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:27:28.763423 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:27:28.763423 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.creator() May 25 14:27:28.763423 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:27:28.763423 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application created_value = creator( May 25 14:27:28.763423 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:27:28.763423 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:27:28.763423 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:27:28.763423 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:27:28.763423 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:27:28.763423 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:27:28.763423 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 25 14:27:28.763423 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:27:28.763423 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 164/326] 10.222.0.67 () {56 vars in 1099 bytes} [Wed May 25 14:27:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:27:28.764137 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308e666c-cf06-4c2c-ab54-4174fd5f4c13 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:27:28.767325 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:27:28.771425 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0199a2b3-384a-4e1a-8b5b-26fb1566d962 None None] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:27:28.806412 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582523c6-b1e8-4b3f-a5d5-a2bfa2f5df3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:27:28.807499 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582523c6-b1e8-4b3f-a5d5-a2bfa2f5df3e None admin] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:28.807792 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582523c6-b1e8-4b3f-a5d5-a2bfa2f5df3e None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:28.808074 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582523c6-b1e8-4b3f-a5d5-a2bfa2f5df3e None admin] PATH_INFO: `/v3/groups` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:28.809151 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582523c6-b1e8-4b3f-a5d5-a2bfa2f5df3e None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:27:28.810921 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582523c6-b1e8-4b3f-a5d5-a2bfa2f5df3e None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:27:28.824375 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 163/327] 10.222.0.67 () {60 vars in 1134 bytes} [Wed May 25 14:27:28 2022] POST /identity/v3/groups => generated 226 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:27:28.825238 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582523c6-b1e8-4b3f-a5d5-a2bfa2f5df3e None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:27:28.867769 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:27:28.881794 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308e666c-cf06-4c2c-ab54-4174fd5f4c13 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:27:28.924628 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3543dbd-3cc3-4ffa-809a-f33b4be0f183 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:27:28.925903 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3543dbd-3cc3-4ffa-809a-f33b4be0f183 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:28.926448 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3543dbd-3cc3-4ffa-809a-f33b4be0f183 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:28.926928 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3543dbd-3cc3-4ffa-809a-f33b4be0f183 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:28.941415 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3543dbd-3cc3-4ffa-809a-f33b4be0f183 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:27:28.950491 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application [None req-e3543dbd-3cc3-4ffa-809a-f33b4be0f183 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 25 14:27:28.950491 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:27:28.950491 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:27:28.950491 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:27:28.950491 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:27:28.950491 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:27:28.950491 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:27:28.950491 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:27:28.950491 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:27:28.950491 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:27:28.950491 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:27:28.950491 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:27:28.950491 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:27:28.950491 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:27:28.950491 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:27:28.950491 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:27:28.951534 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:27:28.951534 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:27:28.951534 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:27:28.951534 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:27:28.951534 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:27:28.951534 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:27:28.951534 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:27:28.951534 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:27:28.951534 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:27:28.951534 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:27:28.951534 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:27:28.951534 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application with Lock( May 25 14:27:28.951534 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:27:28.951534 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._enter() May 25 14:27:28.951534 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:27:28.951534 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:27:28.952908 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:27:28.952908 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.creator() May 25 14:27:28.952908 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:27:28.952908 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application created_value = creator( May 25 14:27:28.952908 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:27:28.952908 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:27:28.952908 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:27:28.952908 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:27:28.952908 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:27:28.952908 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:27:28.952908 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 25 14:27:28.952908 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:27:28.954172 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582523c6-b1e8-4b3f-a5d5-a2bfa2f5df3e None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:27:28.955280 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 165/328] 10.222.0.67 () {56 vars in 1099 bytes} [Wed May 25 14:27:28 2022] GET /identity/v3/roles/reader => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:27:28.961111 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3543dbd-3cc3-4ffa-809a-f33b4be0f183 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:27:28.995016 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d4fa10-7c98-4f0a-9e40-3a362ec9abf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:27:28.995989 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d4fa10-7c98-4f0a-9e40-3a362ec9abf1 None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:28.996273 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d4fa10-7c98-4f0a-9e40-3a362ec9abf1 None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:28.996548 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d4fa10-7c98-4f0a-9e40-3a362ec9abf1 None admin] PATH_INFO: `/v3/roles` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:28.997314 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d4fa10-7c98-4f0a-9e40-3a362ec9abf1 None admin] RBAC: Adding query filter params (name=member) {{(pid=80474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:27:28.997623 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d4fa10-7c98-4f0a-9e40-3a362ec9abf1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:27:28.999601 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d4fa10-7c98-4f0a-9e40-3a362ec9abf1 None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:27:29.010880 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 164/329] 10.222.0.67 () {56 vars in 1101 bytes} [Wed May 25 14:27:28 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:27:29.017660 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d4fa10-7c98-4f0a-9e40-3a362ec9abf1 None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:27:29.035745 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:27:29.080468 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3543dbd-3cc3-4ffa-809a-f33b4be0f183 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:27:29.123094 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb95f173-8300-4582-90d4-a440fa2906f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:27:29.123703 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb95f173-8300-4582-90d4-a440fa2906f0 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:29.124039 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb95f173-8300-4582-90d4-a440fa2906f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:29.124434 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb95f173-8300-4582-90d4-a440fa2906f0 None admin] PATH_INFO: `/v3/roles` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:29.125740 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb95f173-8300-4582-90d4-a440fa2906f0 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:27:29.125740 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb95f173-8300-4582-90d4-a440fa2906f0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:27:29.126965 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb95f173-8300-4582-90d4-a440fa2906f0 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:27:29.136580 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 166/330] 10.222.0.67 () {56 vars in 1101 bytes} [Wed May 25 14:27:28 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:27:29.143765 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb95f173-8300-4582-90d4-a440fa2906f0 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:27:29.146052 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:27:29.151261 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d4fa10-7c98-4f0a-9e40-3a362ec9abf1 None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:27:29.192846 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4886f09-50f2-4efe-beeb-ed9a4a04ed75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:27:29.193732 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4886f09-50f2-4efe-beeb-ed9a4a04ed75 None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:29.194013 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4886f09-50f2-4efe-beeb-ed9a4a04ed75 None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:29.194291 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4886f09-50f2-4efe-beeb-ed9a4a04ed75 None admin] PATH_INFO: `/v3/users/d5b773c36b6248b7aa53fd993bbaf8d4` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:29.195577 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4886f09-50f2-4efe-beeb-ed9a4a04ed75 None admin] RBAC: Authorizing `identity:get_user(user_id=d5b773c36b6248b7aa53fd993bbaf8d4)` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:27:29.197063 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4886f09-50f2-4efe-beeb-ed9a4a04ed75 None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:27:29.200114 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 165/331] 10.222.0.67 () {56 vars in 1177 bytes} [Wed May 25 14:27:29 2022] GET /identity/v3/users/d5b773c36b6248b7aa53fd993bbaf8d4 => generated 293 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:27:29.205037 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4886f09-50f2-4efe-beeb-ed9a4a04ed75 None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:27:29.279300 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb95f173-8300-4582-90d4-a440fa2906f0 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:27:29.312489 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:27:29.332926 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe04d88-f2dc-4bd5-be01-31e7b5c6189d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:27:29.339013 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe04d88-f2dc-4bd5-be01-31e7b5c6189d None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:29.339013 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe04d88-f2dc-4bd5-be01-31e7b5c6189d None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:29.339013 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe04d88-f2dc-4bd5-be01-31e7b5c6189d None admin] PATH_INFO: `/v3/users/1706b5e6e40e426a92b17d4f01e57e6f` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:29.339013 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe04d88-f2dc-4bd5-be01-31e7b5c6189d None admin] RBAC: Authorizing `identity:get_user(user_id=1706b5e6e40e426a92b17d4f01e57e6f)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:27:29.339013 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe04d88-f2dc-4bd5-be01-31e7b5c6189d None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:27:29.339013 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 167/332] 10.222.0.67 () {56 vars in 1177 bytes} [Wed May 25 14:27:29 2022] GET /identity/v3/users/1706b5e6e40e426a92b17d4f01e57e6f => generated 293 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:27:29.346037 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe04d88-f2dc-4bd5-be01-31e7b5c6189d None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:27:29.346219 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4886f09-50f2-4efe-beeb-ed9a4a04ed75 None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:27:29.390684 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196a5b13-8190-4190-99b8-241134d0f2c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:27:29.391397 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196a5b13-8190-4190-99b8-241134d0f2c9 None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:29.391682 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196a5b13-8190-4190-99b8-241134d0f2c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:29.391961 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196a5b13-8190-4190-99b8-241134d0f2c9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:29.392812 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196a5b13-8190-4190-99b8-241134d0f2c9 None admin] RBAC: Adding query filter params (role.id=48808901834b4d5eab2c7e6b5b03791e, user.id=d5b773c36b6248b7aa53fd993bbaf8d4, scope.system=all) {{(pid=80474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:27:29.393131 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196a5b13-8190-4190-99b8-241134d0f2c9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:27:29.395097 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196a5b13-8190-4190-99b8-241134d0f2c9 None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:27:29.412187 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 166/333] 10.222.0.67 () {56 vars in 1308 bytes} [Wed May 25 14:27:29 2022] GET /identity/v3/role_assignments?user.id=d5b773c36b6248b7aa53fd993bbaf8d4&scope.system=all&role.id=48808901834b4d5eab2c7e6b5b03791e => generated 510 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:27:29.469277 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe04d88-f2dc-4bd5-be01-31e7b5c6189d None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:27:29.506950 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3a5579-7e8f-4474-902e-82ecabce595f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:27:29.507868 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3a5579-7e8f-4474-902e-82ecabce595f None admin] REQUEST_METHOD: `PUT` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:29.508137 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3a5579-7e8f-4474-902e-82ecabce595f None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:29.508419 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3a5579-7e8f-4474-902e-82ecabce595f None admin] PATH_INFO: `/v3/system/users/1706b5e6e40e426a92b17d4f01e57e6f/roles/ed5296b21eba4c49b7792056991162da` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:29.509985 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3a5579-7e8f-4474-902e-82ecabce595f None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=1706b5e6e40e426a92b17d4f01e57e6f, role_id=ed5296b21eba4c49b7792056991162da)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:27:29.511451 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3a5579-7e8f-4474-902e-82ecabce595f None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:27:29.527778 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 168/334] 10.222.0.67 () {58 vars in 1334 bytes} [Wed May 25 14:27:29 2022] PUT /identity/v3/system/users/1706b5e6e40e426a92b17d4f01e57e6f/roles/ed5296b21eba4c49b7792056991162da => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:27:31.412761 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997c273a-b768-47e8-a24e-30c443bc4249 None None] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:31.413284 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997c273a-b768-47e8-a24e-30c443bc4249 None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:31.413284 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997c273a-b768-47e8-a24e-30c443bc4249 None None] PATH_INFO: `/` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:31.414929 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 167/335] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 14:27:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:27:31.420423 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9607665-866e-49ed-9f2f-0a610d92459c None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:31.421320 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9607665-866e-49ed-9f2f-0a610d92459c None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:31.421813 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9607665-866e-49ed-9f2f-0a610d92459c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:31.448028 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-d9607665-866e-49ed-9f2f-0a610d92459c None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:27:31.449585 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-d9607665-866e-49ed-9f2f-0a610d92459c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:27:31.513260 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:27:31.532103 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 169/336] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 14:27:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 14:27:31.585234 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997c273a-b768-47e8-a24e-30c443bc4249 None None] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:27:31.617633 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:27:31.724419 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997c273a-b768-47e8-a24e-30c443bc4249 None None] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:27:31.768257 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc711eba-e589-4950-80ac-09662e40b3f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:27:31.769076 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc711eba-e589-4950-80ac-09662e40b3f2 None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:31.769359 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc711eba-e589-4950-80ac-09662e40b3f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:31.769640 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc711eba-e589-4950-80ac-09662e40b3f2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:31.784600 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc711eba-e589-4950-80ac-09662e40b3f2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:27:31.792669 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application [None req-cc711eba-e589-4950-80ac-09662e40b3f2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 25 14:27:31.792669 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:27:31.792669 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:27:31.792669 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:27:31.792669 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:27:31.792669 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:27:31.792669 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:27:31.792669 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:27:31.792669 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:27:31.792669 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:27:31.792669 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:27:31.792669 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:27:31.792669 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:27:31.792669 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:27:31.792669 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:27:31.792669 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:27:31.793583 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:27:31.793583 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:27:31.793583 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:27:31.793583 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:27:31.793583 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:27:31.793583 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:27:31.793583 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:27:31.793583 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:27:31.793583 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:27:31.793583 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:27:31.793583 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:27:31.793583 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application with Lock( May 25 14:27:31.793583 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:27:31.793583 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self._enter() May 25 14:27:31.793583 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:27:31.793583 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:27:31.794406 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:27:31.794406 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.creator() May 25 14:27:31.794406 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:27:31.794406 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application created_value = creator( May 25 14:27:31.794406 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:27:31.794406 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:27:31.794406 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:27:31.794406 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:27:31.794406 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:27:31.794406 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:27:31.794406 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 25 14:27:31.794406 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application May 25 14:27:31.795502 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 168/337] 10.222.0.67 () {56 vars in 1099 bytes} [Wed May 25 14:27:31 2022] GET /identity/v3/roles/member => generated 84 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:27:31.802329 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9607665-866e-49ed-9f2f-0a610d92459c None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:27:31.978653 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b601cc-9a08-4f12-a339-202583badcc6 None None] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:31.978845 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b601cc-9a08-4f12-a339-202583badcc6 None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:31.978936 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9607665-866e-49ed-9f2f-0a610d92459c None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:27:31.979199 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b601cc-9a08-4f12-a339-202583badcc6 None None] PATH_INFO: `/` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:31.980830 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 169/338] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 14:27:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 14:27:31.996737 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4366031-e4d5-467f-bf58-6ddec02914df None None] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:31.997353 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4366031-e4d5-467f-bf58-6ddec02914df None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:31.997868 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4366031-e4d5-467f-bf58-6ddec02914df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:32.034472 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa635b5-b849-4017-83d0-0e020b8649ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:27:32.035187 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa635b5-b849-4017-83d0-0e020b8649ea None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:32.035480 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa635b5-b849-4017-83d0-0e020b8649ea None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:32.035765 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa635b5-b849-4017-83d0-0e020b8649ea None admin] PATH_INFO: `/v3/roles` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:32.036527 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa635b5-b849-4017-83d0-0e020b8649ea None admin] RBAC: Adding query filter params (name=member) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:27:32.036838 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa635b5-b849-4017-83d0-0e020b8649ea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:27:32.038260 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa635b5-b849-4017-83d0-0e020b8649ea None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:27:32.041501 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.auth.core [None req-b4366031-e4d5-467f-bf58-6ddec02914df None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:27:32.043138 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-b4366031-e4d5-467f-bf58-6ddec02914df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:27:32.053464 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 170/339] 10.222.0.67 () {56 vars in 1101 bytes} [Wed May 25 14:27:31 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:27:32.059104 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa635b5-b849-4017-83d0-0e020b8649ea None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:27:32.154539 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:27:32.160203 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 170/340] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 14:27:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 14:27:32.189289 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4366031-e4d5-467f-bf58-6ddec02914df None None] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:27:32.208922 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:27:32.254339 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa635b5-b849-4017-83d0-0e020b8649ea None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:27:32.320380 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7e27a4-8384-4f00-89b7-feff4f77479b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:27:32.321039 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7e27a4-8384-4f00-89b7-feff4f77479b None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:32.321325 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7e27a4-8384-4f00-89b7-feff4f77479b None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:32.321601 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7e27a4-8384-4f00-89b7-feff4f77479b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:32.364602 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4366031-e4d5-467f-bf58-6ddec02914df None None] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:27:32.426071 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7221de0b-f204-4153-be50-78930ec446ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:27:32.427817 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7221de0b-f204-4153-be50-78930ec446ed None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:32.428322 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7221de0b-f204-4153-be50-78930ec446ed None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:32.428815 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7221de0b-f204-4153-be50-78930ec446ed None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:32.449153 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7e27a4-8384-4f00-89b7-feff4f77479b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:27:32.454177 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7e27a4-8384-4f00-89b7-feff4f77479b None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:27:32.457154 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7221de0b-f204-4153-be50-78930ec446ed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:27:32.465623 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application [None req-7221de0b-f204-4153-be50-78930ec446ed None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 14:27:32.465623 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:27:32.465623 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:27:32.465623 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:27:32.465623 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:27:32.465623 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:27:32.465623 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:27:32.465623 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:27:32.465623 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:27:32.465623 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:27:32.465623 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:27:32.465623 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:27:32.465623 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:27:32.465623 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:27:32.465623 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:27:32.465623 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:27:32.466530 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:27:32.466530 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:27:32.466530 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:27:32.466530 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:27:32.466530 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:27:32.466530 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:27:32.466530 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:27:32.466530 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:27:32.466530 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:27:32.466530 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:27:32.466530 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:27:32.466530 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application with Lock( May 25 14:27:32.466530 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:27:32.466530 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self._enter() May 25 14:27:32.466530 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:27:32.466530 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:27:32.467381 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:27:32.467381 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.creator() May 25 14:27:32.467381 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:27:32.467381 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application created_value = creator( May 25 14:27:32.467381 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:27:32.467381 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:27:32.467381 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:27:32.467381 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:27:32.467381 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:27:32.467381 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:27:32.467381 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 14:27:32.467381 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application May 25 14:27:32.470447 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 171/341] 10.222.0.67 () {56 vars in 1114 bytes} [Wed May 25 14:27:32 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 14:27:32.476639 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7221de0b-f204-4153-be50-78930ec446ed None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:27:32.580544 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:27:32.602198 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7221de0b-f204-4153-be50-78930ec446ed None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:27:32.605818 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:27:32.657657 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcedf9d-551b-4255-8786-c9a8be7334fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:27:32.658938 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcedf9d-551b-4255-8786-c9a8be7334fe None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:32.659511 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcedf9d-551b-4255-8786-c9a8be7334fe None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:32.659995 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcedf9d-551b-4255-8786-c9a8be7334fe None admin] PATH_INFO: `/v3/roles` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:32.661023 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcedf9d-551b-4255-8786-c9a8be7334fe None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:27:32.661646 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcedf9d-551b-4255-8786-c9a8be7334fe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:27:32.664852 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcedf9d-551b-4255-8786-c9a8be7334fe None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:27:32.669282 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 171/342] 10.222.0.67 () {58 vars in 1282 bytes} [Wed May 25 14:27:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 610 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 25 14:27:32.671367 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a469190-6205-4e42-a3bf-a6b61765cbc5 None None] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:32.672002 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a469190-6205-4e42-a3bf-a6b61765cbc5 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:32.672539 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a469190-6205-4e42-a3bf-a6b61765cbc5 None None] PATH_INFO: `/` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:32.678161 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 172/343] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 14:27:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:27:32.679921 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db856672-6079-4cc2-a7e8-bd7b3545339a None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:32.680423 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db856672-6079-4cc2-a7e8-bd7b3545339a None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:32.680888 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db856672-6079-4cc2-a7e8-bd7b3545339a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:32.685495 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 172/344] 10.222.0.67 () {56 vars in 1111 bytes} [Wed May 25 14:27:32 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:27:32.688324 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcedf9d-551b-4255-8786-c9a8be7334fe None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:27:32.713286 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-db856672-6079-4cc2-a7e8-bd7b3545339a None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:27:32.715948 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-db856672-6079-4cc2-a7e8-bd7b3545339a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:27:32.809964 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 173/345] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 14:27:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 14:27:32.811184 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db856672-6079-4cc2-a7e8-bd7b3545339a None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:27:32.845010 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcedf9d-551b-4255-8786-c9a8be7334fe None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:27:32.889310 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d64cd55-9361-4bd7-b54c-62ffefaab1e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:27:32.890670 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d64cd55-9361-4bd7-b54c-62ffefaab1e1 None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:32.890964 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d64cd55-9361-4bd7-b54c-62ffefaab1e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:32.891271 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d64cd55-9361-4bd7-b54c-62ffefaab1e1 None admin] PATH_INFO: `/v3/projects/652aa39dec91415abc8e6c301800eb00` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:32.892803 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d64cd55-9361-4bd7-b54c-62ffefaab1e1 None admin] RBAC: Authorizing `identity:get_project(project_id=652aa39dec91415abc8e6c301800eb00)` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:27:32.894820 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d64cd55-9361-4bd7-b54c-62ffefaab1e1 None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:27:32.899072 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 173/346] 10.222.0.67 () {56 vars in 1186 bytes} [Wed May 25 14:27:32 2022] GET /identity/v3/projects/652aa39dec91415abc8e6c301800eb00 => generated 298 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:27:32.899072 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfd8899-e0ab-4683-9708-5b2769198b35 None None] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:32.899072 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfd8899-e0ab-4683-9708-5b2769198b35 None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:32.899454 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfd8899-e0ab-4683-9708-5b2769198b35 None None] PATH_INFO: `/` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:32.901103 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 174/347] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 14:27:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:27:32.902858 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfd8899-e0ab-4683-9708-5b2769198b35 None None] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:27:32.911345 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:27:32.917923 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:27:32.943979 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db856672-6079-4cc2-a7e8-bd7b3545339a None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:27:32.992632 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9766514c-4a63-405a-a57d-7c64ea9b27dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:27:32.993785 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9766514c-4a63-405a-a57d-7c64ea9b27dd None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:32.994771 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9766514c-4a63-405a-a57d-7c64ea9b27dd None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:32.995289 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9766514c-4a63-405a-a57d-7c64ea9b27dd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:33.040186 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfd8899-e0ab-4683-9708-5b2769198b35 None None] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:27:33.081486 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710e923d-8049-4012-9e09-603edebe10bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:27:33.082802 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710e923d-8049-4012-9e09-603edebe10bb None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:33.083322 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710e923d-8049-4012-9e09-603edebe10bb None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:33.083836 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710e923d-8049-4012-9e09-603edebe10bb None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:33.085334 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9766514c-4a63-405a-a57d-7c64ea9b27dd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:27:33.086980 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9766514c-4a63-405a-a57d-7c64ea9b27dd None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:27:33.097722 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710e923d-8049-4012-9e09-603edebe10bb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:27:33.106606 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application [None req-710e923d-8049-4012-9e09-603edebe10bb None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 25 14:27:33.106606 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:27:33.106606 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:27:33.106606 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:27:33.106606 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:27:33.106606 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:27:33.106606 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:27:33.106606 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:27:33.106606 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:27:33.106606 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:27:33.106606 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:27:33.106606 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:27:33.106606 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:27:33.106606 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:27:33.106606 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:27:33.106606 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:27:33.108012 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:27:33.108012 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:27:33.108012 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:27:33.108012 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:27:33.108012 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:27:33.108012 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:27:33.108012 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:27:33.108012 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:27:33.108012 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:27:33.108012 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:27:33.108012 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:27:33.108012 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application with Lock( May 25 14:27:33.108012 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:27:33.108012 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self._enter() May 25 14:27:33.108012 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:27:33.108012 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:27:33.109436 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:27:33.109436 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.creator() May 25 14:27:33.109436 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:27:33.109436 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application created_value = creator( May 25 14:27:33.109436 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:27:33.109436 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:27:33.109436 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:27:33.109436 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:27:33.109436 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:27:33.109436 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:27:33.109436 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 25 14:27:33.109436 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application May 25 14:27:33.112210 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 175/348] 10.222.0.67 () {56 vars in 1099 bytes} [Wed May 25 14:27:32 2022] GET /identity/v3/roles/reader => generated 84 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:27:33.113436 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710e923d-8049-4012-9e09-603edebe10bb None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:27:33.178705 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:27:33.190529 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:27:33.206417 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 174/349] 10.222.0.67 () {58 vars in 1282 bytes} [Wed May 25 14:27:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 14:27:33.208511 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a60068f-8b7d-4ba0-8188-8128f13085f4 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:33.208798 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a60068f-8b7d-4ba0-8188-8128f13085f4 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:33.209075 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a60068f-8b7d-4ba0-8188-8128f13085f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:33.228731 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-3a60068f-8b7d-4ba0-8188-8128f13085f4 None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:27:33.229906 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-3a60068f-8b7d-4ba0-8188-8128f13085f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:27:33.246746 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710e923d-8049-4012-9e09-603edebe10bb None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:27:33.289464 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f2ca22-0d57-4ff0-bdac-7a4153f97708 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:27:33.290736 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f2ca22-0d57-4ff0-bdac-7a4153f97708 None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:33.291361 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f2ca22-0d57-4ff0-bdac-7a4153f97708 None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:33.291947 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f2ca22-0d57-4ff0-bdac-7a4153f97708 None admin] PATH_INFO: `/v3/groups/c72c213d70fc435b823e76d99d8310a8` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:33.298780 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f2ca22-0d57-4ff0-bdac-7a4153f97708 None admin] RBAC: Authorizing `identity:get_group(group_id=c72c213d70fc435b823e76d99d8310a8)` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:27:33.301075 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f2ca22-0d57-4ff0-bdac-7a4153f97708 None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:27:33.303312 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 176/350] 10.222.0.67 () {56 vars in 1180 bytes} [Wed May 25 14:27:33 2022] GET /identity/v3/groups/c72c213d70fc435b823e76d99d8310a8 => generated 226 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:27:33.304336 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f2ca22-0d57-4ff0-bdac-7a4153f97708 None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:27:33.319945 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 175/351] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 14:27:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 14:27:33.320802 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a60068f-8b7d-4ba0-8188-8128f13085f4 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:27:33.439199 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f2ca22-0d57-4ff0-bdac-7a4153f97708 None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:27:33.459327 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a60068f-8b7d-4ba0-8188-8128f13085f4 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:27:33.470811 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:27:33.475904 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:27:33.485923 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36515526-7c42-4201-9021-126393a07802 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:27:33.486699 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36515526-7c42-4201-9021-126393a07802 None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:33.487123 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36515526-7c42-4201-9021-126393a07802 None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:33.487486 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36515526-7c42-4201-9021-126393a07802 None admin] PATH_INFO: `/v3/roles` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:33.488520 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36515526-7c42-4201-9021-126393a07802 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:27:33.488834 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36515526-7c42-4201-9021-126393a07802 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:27:33.490714 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36515526-7c42-4201-9021-126393a07802 None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:27:33.500947 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 177/352] 10.222.0.67 () {56 vars in 1101 bytes} [Wed May 25 14:27:33 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:27:33.502191 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36515526-7c42-4201-9021-126393a07802 None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:27:33.504369 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452c3e6f-0f22-4077-8739-d25488ab3a2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:27:33.506291 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452c3e6f-0f22-4077-8739-d25488ab3a2c None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:33.506291 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452c3e6f-0f22-4077-8739-d25488ab3a2c None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:33.506291 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452c3e6f-0f22-4077-8739-d25488ab3a2c None admin] PATH_INFO: `/v3/projects/652aa39dec91415abc8e6c301800eb00` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:33.507487 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452c3e6f-0f22-4077-8739-d25488ab3a2c None admin] RBAC: Authorizing `identity:get_project(project_id=652aa39dec91415abc8e6c301800eb00)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:27:33.509154 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452c3e6f-0f22-4077-8739-d25488ab3a2c None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:27:33.514227 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 176/353] 10.222.0.67 () {56 vars in 1186 bytes} [Wed May 25 14:27:33 2022] GET /identity/v3/projects/652aa39dec91415abc8e6c301800eb00 => generated 298 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:27:33.515751 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452c3e6f-0f22-4077-8739-d25488ab3a2c None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:27:33.626226 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36515526-7c42-4201-9021-126393a07802 None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:27:33.637688 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452c3e6f-0f22-4077-8739-d25488ab3a2c None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:27:33.679645 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79adc90-f853-4f08-b8c9-f296de8dd04f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:27:33.680589 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79adc90-f853-4f08-b8c9-f296de8dd04f None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:33.680873 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79adc90-f853-4f08-b8c9-f296de8dd04f None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:33.681154 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79adc90-f853-4f08-b8c9-f296de8dd04f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:33.682003 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79adc90-f853-4f08-b8c9-f296de8dd04f None admin] RBAC: Adding query filter params (group.id=c72c213d70fc435b823e76d99d8310a8, role.id=48808901834b4d5eab2c7e6b5b03791e, scope.project.id=652aa39dec91415abc8e6c301800eb00) {{(pid=80474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:27:33.682318 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79adc90-f853-4f08-b8c9-f296de8dd04f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:27:33.683797 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79adc90-f853-4f08-b8c9-f296de8dd04f None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:27:33.688274 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfe07e1-bef6-4ebe-8dce-91f510578edd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:27:33.689073 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfe07e1-bef6-4ebe-8dce-91f510578edd None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:33.689411 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfe07e1-bef6-4ebe-8dce-91f510578edd None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:33.689636 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfe07e1-bef6-4ebe-8dce-91f510578edd None admin] PATH_INFO: `/v3/roles/member` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:33.692688 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 178/354] 10.222.0.67 () {56 vars in 1376 bytes} [Wed May 25 14:27:33 2022] GET /identity/v3/role_assignments?group.id=c72c213d70fc435b823e76d99d8310a8&scope.project.id=652aa39dec91415abc8e6c301800eb00&role.id=48808901834b4d5eab2c7e6b5b03791e => generated 260 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:27:33.693677 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79adc90-f853-4f08-b8c9-f296de8dd04f None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:27:33.707568 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfe07e1-bef6-4ebe-8dce-91f510578edd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:27:33.716148 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application [None req-3dfe07e1-bef6-4ebe-8dce-91f510578edd None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 25 14:27:33.716148 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:27:33.716148 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:27:33.716148 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:27:33.716148 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:27:33.716148 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:27:33.716148 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:27:33.716148 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:27:33.716148 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:27:33.716148 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:27:33.716148 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:27:33.716148 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:27:33.716148 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:27:33.716148 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:27:33.716148 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:27:33.716148 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:27:33.717083 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:27:33.717083 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:27:33.717083 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:27:33.717083 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:27:33.717083 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:27:33.717083 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:27:33.717083 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:27:33.717083 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:27:33.717083 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:27:33.717083 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:27:33.717083 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:27:33.717083 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application with Lock( May 25 14:27:33.717083 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:27:33.717083 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._enter() May 25 14:27:33.717083 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:27:33.717083 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:27:33.718441 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:27:33.718441 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.creator() May 25 14:27:33.718441 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:27:33.718441 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application created_value = creator( May 25 14:27:33.718441 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:27:33.718441 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:27:33.718441 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:27:33.718441 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:27:33.718441 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:27:33.718441 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:27:33.718441 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 25 14:27:33.718441 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:27:33.718441 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 177/355] 10.222.0.67 () {56 vars in 1099 bytes} [Wed May 25 14:27:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:27:33.719161 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfe07e1-bef6-4ebe-8dce-91f510578edd None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:27:33.775111 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:27:33.776994 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:27:33.854724 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79adc90-f853-4f08-b8c9-f296de8dd04f None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:27:33.875846 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfe07e1-bef6-4ebe-8dce-91f510578edd None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:27:33.905337 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8e0e08-ddf3-4395-8909-09f595b8fbda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:27:33.905989 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8e0e08-ddf3-4395-8909-09f595b8fbda None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:33.906278 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8e0e08-ddf3-4395-8909-09f595b8fbda None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:33.906628 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8e0e08-ddf3-4395-8909-09f595b8fbda None admin] PATH_INFO: `/v3/users/1706b5e6e40e426a92b17d4f01e57e6f` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:33.908160 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8e0e08-ddf3-4395-8909-09f595b8fbda None admin] RBAC: Authorizing `identity:get_user(user_id=1706b5e6e40e426a92b17d4f01e57e6f)` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:27:33.909612 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8e0e08-ddf3-4395-8909-09f595b8fbda None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:27:33.912880 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 179/356] 10.222.0.67 () {56 vars in 1177 bytes} [Wed May 25 14:27:33 2022] GET /identity/v3/users/1706b5e6e40e426a92b17d4f01e57e6f => generated 293 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:27:33.918860 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6c6a6e-824b-4f71-b96f-5c345812fd15 None None] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:33.919180 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6c6a6e-824b-4f71-b96f-5c345812fd15 None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:33.919467 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6c6a6e-824b-4f71-b96f-5c345812fd15 None None] PATH_INFO: `/` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:33.922175 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 180/357] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 14:27:33 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:27:33.922396 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6c6a6e-824b-4f71-b96f-5c345812fd15 None None] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:27:33.932146 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d487e6-c00b-4d18-bcef-1a91def8e04b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:27:33.933036 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d487e6-c00b-4d18-bcef-1a91def8e04b None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:33.933320 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d487e6-c00b-4d18-bcef-1a91def8e04b None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:33.933597 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d487e6-c00b-4d18-bcef-1a91def8e04b None admin] PATH_INFO: `/v3/groups/c72c213d70fc435b823e76d99d8310a8` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:33.935480 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d487e6-c00b-4d18-bcef-1a91def8e04b None admin] RBAC: Authorizing `identity:get_group(group_id=c72c213d70fc435b823e76d99d8310a8)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:27:33.937233 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d487e6-c00b-4d18-bcef-1a91def8e04b None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:27:33.939884 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 178/358] 10.222.0.67 () {56 vars in 1180 bytes} [Wed May 25 14:27:33 2022] GET /identity/v3/groups/c72c213d70fc435b823e76d99d8310a8 => generated 226 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:27:33.940784 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d487e6-c00b-4d18-bcef-1a91def8e04b None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:27:34.079332 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6c6a6e-824b-4f71-b96f-5c345812fd15 None None] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:27:34.083826 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d487e6-c00b-4d18-bcef-1a91def8e04b None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:27:34.086220 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:27:34.110216 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:27:34.123500 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e04f5e0-f661-4a17-be44-2036c9728c0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:27:34.124236 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e04f5e0-f661-4a17-be44-2036c9728c0d None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:34.124509 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e04f5e0-f661-4a17-be44-2036c9728c0d None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:34.124793 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e04f5e0-f661-4a17-be44-2036c9728c0d None admin] PATH_INFO: `/v3/roles` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:34.125558 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e04f5e0-f661-4a17-be44-2036c9728c0d None admin] RBAC: Adding query filter params (name=member) {{(pid=80474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:27:34.125887 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e04f5e0-f661-4a17-be44-2036c9728c0d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:27:34.127343 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e04f5e0-f661-4a17-be44-2036c9728c0d None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:27:34.128089 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67444a66-6f01-4cac-9999-d0a6ee56c75c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:27:34.129023 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67444a66-6f01-4cac-9999-d0a6ee56c75c None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:34.129579 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67444a66-6f01-4cac-9999-d0a6ee56c75c None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:34.130085 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67444a66-6f01-4cac-9999-d0a6ee56c75c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:34.131085 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67444a66-6f01-4cac-9999-d0a6ee56c75c None admin] RBAC: Adding query filter params (role.id=ed5296b21eba4c49b7792056991162da, user.id=1706b5e6e40e426a92b17d4f01e57e6f, scope.system=all) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:27:34.131591 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67444a66-6f01-4cac-9999-d0a6ee56c75c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:27:34.133247 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67444a66-6f01-4cac-9999-d0a6ee56c75c None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:27:34.143023 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 181/359] 10.222.0.67 () {56 vars in 1101 bytes} [Wed May 25 14:27:33 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:27:34.143023 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793a5a91-60b6-41cd-af4a-7341f4f55fc9 None None] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:34.143023 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793a5a91-60b6-41cd-af4a-7341f4f55fc9 None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:34.143023 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793a5a91-60b6-41cd-af4a-7341f4f55fc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:34.153818 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 179/360] 10.222.0.67 () {56 vars in 1308 bytes} [Wed May 25 14:27:33 2022] GET /identity/v3/role_assignments?user.id=1706b5e6e40e426a92b17d4f01e57e6f&scope.system=all&role.id=ed5296b21eba4c49b7792056991162da => generated 510 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:27:34.154733 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67444a66-6f01-4cac-9999-d0a6ee56c75c None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:27:34.163847 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.auth.core [None req-793a5a91-60b6-41cd-af4a-7341f4f55fc9 None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:27:34.165064 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-793a5a91-60b6-41cd-af4a-7341f4f55fc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:27:34.259190 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 182/361] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 14:27:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 14:27:34.260984 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565acc7f-a870-4889-be9b-6d51ef24adfa None None] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:34.261497 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565acc7f-a870-4889-be9b-6d51ef24adfa None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:34.261993 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565acc7f-a870-4889-be9b-6d51ef24adfa None None] PATH_INFO: `/` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:34.263718 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 183/362] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 14:27:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:27:34.265432 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565acc7f-a870-4889-be9b-6d51ef24adfa None None] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:27:34.293080 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67444a66-6f01-4cac-9999-d0a6ee56c75c None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:27:34.337072 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9406e230-af82-4e93-8d6a-71c74018e56e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:27:34.337722 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9406e230-af82-4e93-8d6a-71c74018e56e None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:34.338008 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9406e230-af82-4e93-8d6a-71c74018e56e None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:34.338285 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9406e230-af82-4e93-8d6a-71c74018e56e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:34.339215 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9406e230-af82-4e93-8d6a-71c74018e56e None admin] RBAC: Adding query filter params (group.id=c72c213d70fc435b823e76d99d8310a8, role.id=3e87d9311f1d411395a3fcd41ac81431, scope.project.id=652aa39dec91415abc8e6c301800eb00) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:27:34.339558 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9406e230-af82-4e93-8d6a-71c74018e56e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:27:34.341054 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9406e230-af82-4e93-8d6a-71c74018e56e None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:27:34.348411 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 180/363] 10.222.0.67 () {56 vars in 1376 bytes} [Wed May 25 14:27:34 2022] GET /identity/v3/role_assignments?group.id=c72c213d70fc435b823e76d99d8310a8&scope.project.id=652aa39dec91415abc8e6c301800eb00&role.id=3e87d9311f1d411395a3fcd41ac81431 => generated 260 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:27:34.349775 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed2d79c-a99c-465b-91bd-26d9aadf1978 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:34.350074 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed2d79c-a99c-465b-91bd-26d9aadf1978 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:34.350408 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed2d79c-a99c-465b-91bd-26d9aadf1978 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:34.369832 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-bed2d79c-a99c-465b-91bd-26d9aadf1978 None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:27:34.371403 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-bed2d79c-a99c-465b-91bd-26d9aadf1978 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:27:34.395696 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565acc7f-a870-4889-be9b-6d51ef24adfa None None] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:27:34.397212 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:27:34.414041 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:27:34.441325 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b1dcc4-bfe5-4410-a307-4692d9d46b69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:27:34.442759 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b1dcc4-bfe5-4410-a307-4692d9d46b69 None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:34.443243 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b1dcc4-bfe5-4410-a307-4692d9d46b69 None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:34.443696 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b1dcc4-bfe5-4410-a307-4692d9d46b69 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:34.476867 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 181/364] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 14:27:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 14:27:34.477795 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed2d79c-a99c-465b-91bd-26d9aadf1978 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:27:34.537503 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b1dcc4-bfe5-4410-a307-4692d9d46b69 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:27:34.539354 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b1dcc4-bfe5-4410-a307-4692d9d46b69 None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:27:34.619660 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed2d79c-a99c-465b-91bd-26d9aadf1978 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:27:34.678551 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21f8c22-0f6a-4336-95ee-3b74788af272 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:27:34.679404 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21f8c22-0f6a-4336-95ee-3b74788af272 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:34.679688 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21f8c22-0f6a-4336-95ee-3b74788af272 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:34.679962 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21f8c22-0f6a-4336-95ee-3b74788af272 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:34.685698 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 184/365] 10.222.0.67 () {58 vars in 1282 bytes} [Wed May 25 14:27:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 14:27:34.687677 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b1dcc4-bfe5-4410-a307-4692d9d46b69 None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:27:34.694857 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21f8c22-0f6a-4336-95ee-3b74788af272 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:27:34.706223 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application [None req-a21f8c22-0f6a-4336-95ee-3b74788af272 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 14:27:34.706223 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:27:34.706223 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:27:34.706223 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:27:34.706223 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:27:34.706223 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:27:34.706223 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:27:34.706223 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:27:34.706223 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:27:34.706223 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:27:34.706223 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:27:34.706223 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:27:34.706223 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:27:34.706223 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:27:34.706223 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:27:34.706223 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:27:34.707231 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:27:34.707231 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:27:34.707231 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:27:34.707231 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:27:34.707231 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:27:34.707231 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:27:34.707231 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:27:34.707231 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:27:34.707231 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:27:34.707231 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:27:34.707231 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:27:34.707231 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application with Lock( May 25 14:27:34.707231 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:27:34.707231 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._enter() May 25 14:27:34.707231 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:27:34.707231 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:27:34.708693 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:27:34.708693 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.creator() May 25 14:27:34.708693 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:27:34.708693 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application created_value = creator( May 25 14:27:34.708693 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:27:34.708693 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:27:34.708693 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:27:34.708693 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:27:34.708693 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:27:34.708693 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:27:34.708693 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 14:27:34.708693 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:27:34.708693 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 182/366] 10.222.0.67 () {56 vars in 1114 bytes} [Wed May 25 14:27:34 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:27:34.708693 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21f8c22-0f6a-4336-95ee-3b74788af272 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:27:34.711200 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:27:34.737903 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:27:34.862046 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b1dcc4-bfe5-4410-a307-4692d9d46b69 None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:27:34.873358 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21f8c22-0f6a-4336-95ee-3b74788af272 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:27:34.912809 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771b9088-5957-420e-86a0-14edd457499b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:27:34.913891 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771b9088-5957-420e-86a0-14edd457499b None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:34.914321 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771b9088-5957-420e-86a0-14edd457499b None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:34.914725 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771b9088-5957-420e-86a0-14edd457499b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:34.919503 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b959bc-de87-428e-8ac2-a3da1d12dbe7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:27:34.920386 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b959bc-de87-428e-8ac2-a3da1d12dbe7 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:34.920675 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b959bc-de87-428e-8ac2-a3da1d12dbe7 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:34.921609 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b959bc-de87-428e-8ac2-a3da1d12dbe7 None admin] PATH_INFO: `/v3/projects/24460f2e7a5e44f19737eed3c6799a16` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:34.923127 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b959bc-de87-428e-8ac2-a3da1d12dbe7 None admin] RBAC: Authorizing `identity:get_project(project_id=24460f2e7a5e44f19737eed3c6799a16)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:27:34.925892 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b959bc-de87-428e-8ac2-a3da1d12dbe7 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:27:34.928716 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 183/367] 10.222.0.67 () {56 vars in 1186 bytes} [Wed May 25 14:27:34 2022] GET /identity/v3/projects/24460f2e7a5e44f19737eed3c6799a16 => generated 302 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:27:34.929256 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771b9088-5957-420e-86a0-14edd457499b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:27:34.929527 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b959bc-de87-428e-8ac2-a3da1d12dbe7 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:27:34.940103 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application [None req-771b9088-5957-420e-86a0-14edd457499b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 14:27:34.940103 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:27:34.940103 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:27:34.940103 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:27:34.940103 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:27:34.940103 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:27:34.940103 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:27:34.940103 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:27:34.940103 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:27:34.940103 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:27:34.940103 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:27:34.940103 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:27:34.940103 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:27:34.940103 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:27:34.940103 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:27:34.940103 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:27:34.941204 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:27:34.941204 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:27:34.941204 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:27:34.941204 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:27:34.941204 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:27:34.941204 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:27:34.941204 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:27:34.941204 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:27:34.941204 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:27:34.941204 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:27:34.941204 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:27:34.941204 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application with Lock( May 25 14:27:34.941204 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:27:34.941204 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self._enter() May 25 14:27:34.941204 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:27:34.941204 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:27:34.942216 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:27:34.942216 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.creator() May 25 14:27:34.942216 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:27:34.942216 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application created_value = creator( May 25 14:27:34.942216 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:27:34.942216 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:27:34.942216 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:27:34.942216 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:27:34.942216 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:27:34.942216 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:27:34.942216 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 14:27:34.942216 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application May 25 14:27:34.944537 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 185/368] 10.222.0.67 () {56 vars in 1096 bytes} [Wed May 25 14:27:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:27:34.945203 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771b9088-5957-420e-86a0-14edd457499b None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:27:35.043922 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:27:35.053630 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:27:35.081592 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b959bc-de87-428e-8ac2-a3da1d12dbe7 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:27:35.096100 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771b9088-5957-420e-86a0-14edd457499b None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:27:35.125777 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5187efc1-1c4d-4225-92fe-afba4fe871f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:27:35.126477 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5187efc1-1c4d-4225-92fe-afba4fe871f9 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:35.126760 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5187efc1-1c4d-4225-92fe-afba4fe871f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:35.127063 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5187efc1-1c4d-4225-92fe-afba4fe871f9 None admin] PATH_INFO: `/v3/roles` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:35.128259 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5187efc1-1c4d-4225-92fe-afba4fe871f9 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:27:35.128259 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5187efc1-1c4d-4225-92fe-afba4fe871f9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:27:35.129719 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5187efc1-1c4d-4225-92fe-afba4fe871f9 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:27:35.140235 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 184/369] 10.222.0.67 () {56 vars in 1111 bytes} [Wed May 25 14:27:34 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:27:35.141217 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5187efc1-1c4d-4225-92fe-afba4fe871f9 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:27:35.149790 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40271a13-1b2d-4b68-ac72-99c66d3c6325 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:27:35.150954 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40271a13-1b2d-4b68-ac72-99c66d3c6325 None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:35.151467 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40271a13-1b2d-4b68-ac72-99c66d3c6325 None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:35.151984 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40271a13-1b2d-4b68-ac72-99c66d3c6325 None admin] PATH_INFO: `/v3/groups/c72c213d70fc435b823e76d99d8310a8` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:35.153929 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40271a13-1b2d-4b68-ac72-99c66d3c6325 None admin] RBAC: Authorizing `identity:get_group(group_id=c72c213d70fc435b823e76d99d8310a8)` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:27:35.156732 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40271a13-1b2d-4b68-ac72-99c66d3c6325 None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:27:35.159367 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 186/370] 10.222.0.67 () {56 vars in 1180 bytes} [Wed May 25 14:27:34 2022] GET /identity/v3/groups/c72c213d70fc435b823e76d99d8310a8 => generated 226 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:27:35.160585 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40271a13-1b2d-4b68-ac72-99c66d3c6325 None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:27:35.279759 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5187efc1-1c4d-4225-92fe-afba4fe871f9 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:27:35.297457 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40271a13-1b2d-4b68-ac72-99c66d3c6325 None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:27:35.322153 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8742f5c2-282d-42aa-9c7d-8259c8c54b2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:27:35.322829 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8742f5c2-282d-42aa-9c7d-8259c8c54b2e None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:35.323318 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8742f5c2-282d-42aa-9c7d-8259c8c54b2e None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:35.323594 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8742f5c2-282d-42aa-9c7d-8259c8c54b2e None admin] PATH_INFO: `/v3/roles` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:35.324338 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8742f5c2-282d-42aa-9c7d-8259c8c54b2e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:27:35.324643 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8742f5c2-282d-42aa-9c7d-8259c8c54b2e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:27:35.326029 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8742f5c2-282d-42aa-9c7d-8259c8c54b2e None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:27:35.338420 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 185/371] 10.222.0.67 () {56 vars in 1099 bytes} [Wed May 25 14:27:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:27:35.339360 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8742f5c2-282d-42aa-9c7d-8259c8c54b2e None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:27:35.340957 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf40b14-4d7c-4cd3-82da-d8b2aca408d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:27:35.341615 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf40b14-4d7c-4cd3-82da-d8b2aca408d1 None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:35.342182 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf40b14-4d7c-4cd3-82da-d8b2aca408d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:35.342469 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf40b14-4d7c-4cd3-82da-d8b2aca408d1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:35.353272 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:27:35.361222 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:27:35.434366 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf40b14-4d7c-4cd3-82da-d8b2aca408d1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:27:35.436369 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf40b14-4d7c-4cd3-82da-d8b2aca408d1 None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:27:35.464991 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8742f5c2-282d-42aa-9c7d-8259c8c54b2e None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:27:35.505930 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aced8b65-8083-4584-8603-59f637d58672 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:27:35.506690 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aced8b65-8083-4584-8603-59f637d58672 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:35.506875 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aced8b65-8083-4584-8603-59f637d58672 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:35.507189 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aced8b65-8083-4584-8603-59f637d58672 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:35.508028 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aced8b65-8083-4584-8603-59f637d58672 None admin] RBAC: Adding query filter params (group.id=c72c213d70fc435b823e76d99d8310a8, role.id=48808901834b4d5eab2c7e6b5b03791e, scope.project.id=24460f2e7a5e44f19737eed3c6799a16) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:27:35.508343 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aced8b65-8083-4584-8603-59f637d58672 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:27:35.509785 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aced8b65-8083-4584-8603-59f637d58672 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:27:35.516452 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 186/372] 10.222.0.67 () {56 vars in 1376 bytes} [Wed May 25 14:27:35 2022] GET /identity/v3/role_assignments?group.id=c72c213d70fc435b823e76d99d8310a8&scope.project.id=24460f2e7a5e44f19737eed3c6799a16&role.id=48808901834b4d5eab2c7e6b5b03791e => generated 260 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:27:35.517253 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aced8b65-8083-4584-8603-59f637d58672 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:27:35.566759 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 187/373] 10.222.0.67 () {58 vars in 1282 bytes} [Wed May 25 14:27:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 14:27:35.572233 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf40b14-4d7c-4cd3-82da-d8b2aca408d1 None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:27:35.617726 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:27:35.638823 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:27:35.656320 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aced8b65-8083-4584-8603-59f637d58672 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:27:35.697601 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03607e2-b42f-4844-bc09-e9d94d368f9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:27:35.698264 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03607e2-b42f-4844-bc09-e9d94d368f9e None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:35.698554 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03607e2-b42f-4844-bc09-e9d94d368f9e None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:35.698841 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03607e2-b42f-4844-bc09-e9d94d368f9e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:35.711320 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf40b14-4d7c-4cd3-82da-d8b2aca408d1 None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:27:35.755593 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ffc113-6328-4921-b0f0-89e1ab8c8596 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:27:35.756803 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ffc113-6328-4921-b0f0-89e1ab8c8596 None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:35.757254 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ffc113-6328-4921-b0f0-89e1ab8c8596 None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:35.757847 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ffc113-6328-4921-b0f0-89e1ab8c8596 None admin] PATH_INFO: `/v3/projects/24460f2e7a5e44f19737eed3c6799a16` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:35.759384 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ffc113-6328-4921-b0f0-89e1ab8c8596 None admin] RBAC: Authorizing `identity:get_project(project_id=24460f2e7a5e44f19737eed3c6799a16)` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:27:35.761094 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ffc113-6328-4921-b0f0-89e1ab8c8596 None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:27:35.763289 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 188/374] 10.222.0.67 () {56 vars in 1186 bytes} [Wed May 25 14:27:35 2022] GET /identity/v3/projects/24460f2e7a5e44f19737eed3c6799a16 => generated 302 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:27:35.769727 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ffc113-6328-4921-b0f0-89e1ab8c8596 None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:27:35.809451 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03607e2-b42f-4844-bc09-e9d94d368f9e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:27:35.811917 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03607e2-b42f-4844-bc09-e9d94d368f9e None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:27:35.919916 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:27:35.959789 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 187/375] 10.222.0.67 () {58 vars in 1282 bytes} [Wed May 25 14:27:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 443 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 14:27:35.965126 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03607e2-b42f-4844-bc09-e9d94d368f9e None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:27:35.984041 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ffc113-6328-4921-b0f0-89e1ab8c8596 None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:27:36.011103 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:27:36.066235 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64a23ba-08a0-41a8-a303-54c5c9acc1a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:27:36.067516 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64a23ba-08a0-41a8-a303-54c5c9acc1a5 None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:36.068141 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64a23ba-08a0-41a8-a303-54c5c9acc1a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:36.068638 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64a23ba-08a0-41a8-a303-54c5c9acc1a5 None admin] PATH_INFO: `/v3/groups/c72c213d70fc435b823e76d99d8310a8` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:36.073486 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64a23ba-08a0-41a8-a303-54c5c9acc1a5 None admin] RBAC: Authorizing `identity:get_group(group_id=c72c213d70fc435b823e76d99d8310a8)` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:27:36.075329 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64a23ba-08a0-41a8-a303-54c5c9acc1a5 None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:27:36.078421 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 189/376] 10.222.0.67 () {56 vars in 1180 bytes} [Wed May 25 14:27:35 2022] GET /identity/v3/groups/c72c213d70fc435b823e76d99d8310a8 => generated 226 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:27:36.087055 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64a23ba-08a0-41a8-a303-54c5c9acc1a5 None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:27:36.107039 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03607e2-b42f-4844-bc09-e9d94d368f9e None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:27:36.148603 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae52e06-178b-413d-bf68-6cc55175e7c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:27:36.149473 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae52e06-178b-413d-bf68-6cc55175e7c7 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:36.149751 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae52e06-178b-413d-bf68-6cc55175e7c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:36.150020 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae52e06-178b-413d-bf68-6cc55175e7c7 None admin] PATH_INFO: `/v3/projects/277acbf9eb0e4a9b87508241a478db4f` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:36.156645 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae52e06-178b-413d-bf68-6cc55175e7c7 None admin] RBAC: Authorizing `identity:get_project(project_id=277acbf9eb0e4a9b87508241a478db4f)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:27:36.158391 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae52e06-178b-413d-bf68-6cc55175e7c7 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:27:36.160357 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 188/377] 10.222.0.67 () {56 vars in 1186 bytes} [Wed May 25 14:27:35 2022] GET /identity/v3/projects/277acbf9eb0e4a9b87508241a478db4f => generated 344 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:27:36.165987 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae52e06-178b-413d-bf68-6cc55175e7c7 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:27:36.213183 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64a23ba-08a0-41a8-a303-54c5c9acc1a5 None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:27:36.224849 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:27:36.253707 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5c9b5c-d960-4e00-95a4-3635987207fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:27:36.254755 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5c9b5c-d960-4e00-95a4-3635987207fb None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:36.255263 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5c9b5c-d960-4e00-95a4-3635987207fb None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:36.255769 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5c9b5c-d960-4e00-95a4-3635987207fb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:36.256917 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5c9b5c-d960-4e00-95a4-3635987207fb None admin] RBAC: Adding query filter params (group.id=c72c213d70fc435b823e76d99d8310a8, role.id=3e87d9311f1d411395a3fcd41ac81431, scope.project.id=24460f2e7a5e44f19737eed3c6799a16) {{(pid=80474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:27:36.257430 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5c9b5c-d960-4e00-95a4-3635987207fb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:27:36.259212 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5c9b5c-d960-4e00-95a4-3635987207fb None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:27:36.266411 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 190/378] 10.222.0.67 () {56 vars in 1376 bytes} [Wed May 25 14:27:36 2022] GET /identity/v3/role_assignments?group.id=c72c213d70fc435b823e76d99d8310a8&scope.project.id=24460f2e7a5e44f19737eed3c6799a16&role.id=3e87d9311f1d411395a3fcd41ac81431 => generated 260 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:27:36.318877 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae52e06-178b-413d-bf68-6cc55175e7c7 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:27:36.358774 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7c8e4f-8995-4c7f-a4bf-cd5defd1c304 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:27:36.360052 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7c8e4f-8995-4c7f-a4bf-cd5defd1c304 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:36.360540 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7c8e4f-8995-4c7f-a4bf-cd5defd1c304 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:36.361012 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7c8e4f-8995-4c7f-a4bf-cd5defd1c304 None admin] PATH_INFO: `/v3/groups/ff10c2a59f714a45b16862f1cf81d4e7` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:36.374745 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7c8e4f-8995-4c7f-a4bf-cd5defd1c304 None admin] RBAC: Authorizing `identity:get_group(group_id=ff10c2a59f714a45b16862f1cf81d4e7)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:27:36.376667 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7c8e4f-8995-4c7f-a4bf-cd5defd1c304 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:27:36.378751 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 189/379] 10.222.0.67 () {56 vars in 1180 bytes} [Wed May 25 14:27:36 2022] GET /identity/v3/groups/ff10c2a59f714a45b16862f1cf81d4e7 => generated 229 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:27:36.385342 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5c9b5c-d960-4e00-95a4-3635987207fb None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:27:36.439181 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:27:36.508138 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5c9b5c-d960-4e00-95a4-3635987207fb None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:27:36.547354 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b499e6f-27a2-4347-8e6f-4a249e0c82f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:27:36.548438 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b499e6f-27a2-4347-8e6f-4a249e0c82f4 None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:36.548924 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b499e6f-27a2-4347-8e6f-4a249e0c82f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:36.549401 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b499e6f-27a2-4347-8e6f-4a249e0c82f4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:36.550478 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b499e6f-27a2-4347-8e6f-4a249e0c82f4 None admin] RBAC: Adding query filter params (group.id=ff10c2a59f714a45b16862f1cf81d4e7, role.id=399893e19eac4ab5a8e596f7c07be13c, scope.project.id=277acbf9eb0e4a9b87508241a478db4f) {{(pid=80474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:27:36.551013 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b499e6f-27a2-4347-8e6f-4a249e0c82f4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:27:36.552677 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b499e6f-27a2-4347-8e6f-4a249e0c82f4 None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:27:36.559682 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 191/380] 10.222.0.67 () {56 vars in 1376 bytes} [Wed May 25 14:27:36 2022] GET /identity/v3/role_assignments?group.id=ff10c2a59f714a45b16862f1cf81d4e7&scope.project.id=277acbf9eb0e4a9b87508241a478db4f&role.id=399893e19eac4ab5a8e596f7c07be13c => generated 260 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:27:36.663061 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb5eefe-e679-4b37-9ecd-09fcfff70bce None None] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:36.664074 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb5eefe-e679-4b37-9ecd-09fcfff70bce None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:36.664574 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb5eefe-e679-4b37-9ecd-09fcfff70bce None None] PATH_INFO: `/` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:36.666315 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 190/381] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 14:27:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:27:36.672958 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110bc602-6205-497b-8b65-53410f7843be None None] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:36.673933 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110bc602-6205-497b-8b65-53410f7843be None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:36.674444 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110bc602-6205-497b-8b65-53410f7843be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:36.695704 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.auth.core [None req-110bc602-6205-497b-8b65-53410f7843be None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:27:36.697339 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-110bc602-6205-497b-8b65-53410f7843be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:27:36.786659 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 192/382] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 14:27:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 14:27:36.809016 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb5eefe-e679-4b37-9ecd-09fcfff70bce None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:27:36.955984 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb5eefe-e679-4b37-9ecd-09fcfff70bce None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:27:36.958862 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:27:37.009357 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22a98b4-84aa-4a72-b1ae-11d2a60f5e26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:27:37.010507 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22a98b4-84aa-4a72-b1ae-11d2a60f5e26 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:37.011043 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22a98b4-84aa-4a72-b1ae-11d2a60f5e26 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:37.011542 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22a98b4-84aa-4a72-b1ae-11d2a60f5e26 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:37.027483 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22a98b4-84aa-4a72-b1ae-11d2a60f5e26 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:27:37.036229 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application [None req-b22a98b4-84aa-4a72-b1ae-11d2a60f5e26 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 25 14:27:37.036229 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:27:37.036229 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:27:37.036229 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:27:37.036229 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:27:37.036229 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:27:37.036229 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:27:37.036229 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:27:37.036229 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:27:37.036229 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:27:37.036229 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:27:37.036229 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:27:37.036229 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:27:37.036229 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:27:37.036229 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:27:37.036229 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:27:37.037304 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:27:37.037304 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:27:37.037304 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:27:37.037304 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:27:37.037304 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:27:37.037304 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:27:37.037304 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:27:37.037304 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:27:37.037304 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:27:37.037304 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:27:37.037304 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:27:37.037304 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application with Lock( May 25 14:27:37.037304 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:27:37.037304 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._enter() May 25 14:27:37.037304 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:27:37.037304 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:27:37.038114 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:27:37.038114 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.creator() May 25 14:27:37.038114 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:27:37.038114 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application created_value = creator( May 25 14:27:37.038114 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:27:37.038114 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:27:37.038114 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:27:37.038114 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:27:37.038114 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:27:37.038114 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:27:37.038114 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 25 14:27:37.038114 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:27:37.040942 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 191/383] 10.222.0.67 () {56 vars in 1099 bytes} [Wed May 25 14:27:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:27:37.046900 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110bc602-6205-497b-8b65-53410f7843be None None] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:27:37.093023 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:27:37.184429 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110bc602-6205-497b-8b65-53410f7843be None None] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:27:37.226681 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50469cd-f777-41f9-b114-c4bedd805e97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:27:37.227393 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50469cd-f777-41f9-b114-c4bedd805e97 None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:37.227674 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50469cd-f777-41f9-b114-c4bedd805e97 None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:37.227946 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50469cd-f777-41f9-b114-c4bedd805e97 None admin] PATH_INFO: `/v3/roles` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:37.228710 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50469cd-f777-41f9-b114-c4bedd805e97 None admin] RBAC: Adding query filter params (name=member) {{(pid=80474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:27:37.229030 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50469cd-f777-41f9-b114-c4bedd805e97 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:27:37.230408 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50469cd-f777-41f9-b114-c4bedd805e97 None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:27:37.242613 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 193/384] 10.222.0.67 () {56 vars in 1101 bytes} [Wed May 25 14:27:37 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:27:37.248436 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22a98b4-84aa-4a72-b1ae-11d2a60f5e26 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:27:37.329394 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a57bb2-15c0-4860-9da3-cc94674190e7 None None] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:37.329668 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a57bb2-15c0-4860-9da3-cc94674190e7 None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:37.329885 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a57bb2-15c0-4860-9da3-cc94674190e7 None None] PATH_INFO: `/` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:37.332106 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 194/385] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 14:27:37 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:27:37.341552 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae0de1c-8fe9-488b-9a85-43ede22fa8fd None None] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:37.341990 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae0de1c-8fe9-488b-9a85-43ede22fa8fd None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:37.342518 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae0de1c-8fe9-488b-9a85-43ede22fa8fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:37.366191 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.auth.core [None req-9ae0de1c-8fe9-488b-9a85-43ede22fa8fd None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:27:37.368045 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-9ae0de1c-8fe9-488b-9a85-43ede22fa8fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:27:37.397816 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22a98b4-84aa-4a72-b1ae-11d2a60f5e26 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:27:37.462317 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c07cc57-b76e-48f7-acec-6884dc2b72ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:27:37.463469 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c07cc57-b76e-48f7-acec-6884dc2b72ab None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:37.463916 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c07cc57-b76e-48f7-acec-6884dc2b72ab None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:37.464353 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c07cc57-b76e-48f7-acec-6884dc2b72ab None admin] PATH_INFO: `/v3/groups/c72c213d70fc435b823e76d99d8310a8` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:37.465957 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c07cc57-b76e-48f7-acec-6884dc2b72ab None admin] RBAC: Authorizing `identity:get_group(group_id=c72c213d70fc435b823e76d99d8310a8)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:27:37.469098 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c07cc57-b76e-48f7-acec-6884dc2b72ab None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:27:37.471714 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 192/386] 10.222.0.67 () {56 vars in 1180 bytes} [Wed May 25 14:27:37 2022] GET /identity/v3/groups/c72c213d70fc435b823e76d99d8310a8 => generated 226 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:27:37.479874 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c07cc57-b76e-48f7-acec-6884dc2b72ab None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:27:37.490258 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 195/387] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 14:27:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 14:27:37.513390 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae0de1c-8fe9-488b-9a85-43ede22fa8fd None None] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:27:37.555248 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:27:37.561700 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:27:37.697154 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae0de1c-8fe9-488b-9a85-43ede22fa8fd None None] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:27:37.707341 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c07cc57-b76e-48f7-acec-6884dc2b72ab None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:27:37.771526 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa376c7-c549-4e6f-87a1-8ed568e4913d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:27:37.772354 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa376c7-c549-4e6f-87a1-8ed568e4913d None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:37.772637 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa376c7-c549-4e6f-87a1-8ed568e4913d None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:37.772912 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa376c7-c549-4e6f-87a1-8ed568e4913d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:37.779980 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f0cfdc-6bd2-4299-a510-0f0e6bed3061 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:27:37.781640 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f0cfdc-6bd2-4299-a510-0f0e6bed3061 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:37.781924 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f0cfdc-6bd2-4299-a510-0f0e6bed3061 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:37.782201 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f0cfdc-6bd2-4299-a510-0f0e6bed3061 None admin] PATH_INFO: `/v3/projects/652aa39dec91415abc8e6c301800eb00` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:37.784497 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f0cfdc-6bd2-4299-a510-0f0e6bed3061 None admin] RBAC: Authorizing `identity:get_project(project_id=652aa39dec91415abc8e6c301800eb00)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:27:37.785961 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f0cfdc-6bd2-4299-a510-0f0e6bed3061 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:27:37.790497 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 193/388] 10.222.0.67 () {56 vars in 1186 bytes} [Wed May 25 14:27:37 2022] GET /identity/v3/projects/652aa39dec91415abc8e6c301800eb00 => generated 298 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:27:37.793424 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f0cfdc-6bd2-4299-a510-0f0e6bed3061 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:27:37.800170 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa376c7-c549-4e6f-87a1-8ed568e4913d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:27:37.808540 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application [None req-aaa376c7-c549-4e6f-87a1-8ed568e4913d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 14:27:37.808540 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:27:37.808540 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:27:37.808540 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:27:37.808540 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:27:37.808540 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:27:37.808540 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:27:37.808540 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:27:37.808540 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:27:37.808540 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:27:37.808540 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:27:37.808540 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:27:37.808540 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:27:37.808540 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:27:37.808540 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:27:37.808540 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:27:37.809453 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:27:37.809453 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:27:37.809453 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:27:37.809453 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:27:37.809453 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:27:37.809453 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:27:37.809453 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:27:37.809453 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:27:37.809453 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:27:37.809453 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:27:37.809453 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:27:37.809453 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application with Lock( May 25 14:27:37.809453 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:27:37.809453 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self._enter() May 25 14:27:37.809453 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:27:37.809453 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:27:37.810277 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:27:37.810277 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.creator() May 25 14:27:37.810277 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:27:37.810277 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application created_value = creator( May 25 14:27:37.810277 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:27:37.810277 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:27:37.810277 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:27:37.810277 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:27:37.810277 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:27:37.810277 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:27:37.810277 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 14:27:37.810277 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application May 25 14:27:37.820904 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 196/389] 10.222.0.67 () {56 vars in 1114 bytes} [Wed May 25 14:27:37 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 308 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 14:27:37.821824 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa376c7-c549-4e6f-87a1-8ed568e4913d None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:27:37.932968 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:27:37.940329 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f0cfdc-6bd2-4299-a510-0f0e6bed3061 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:27:37.980172 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68c721f-a7ae-404c-ad48-37608af89947 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:27:37.980994 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68c721f-a7ae-404c-ad48-37608af89947 None admin] REQUEST_METHOD: `PUT` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:37.981282 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68c721f-a7ae-404c-ad48-37608af89947 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:37.981562 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68c721f-a7ae-404c-ad48-37608af89947 None admin] PATH_INFO: `/v3/projects/652aa39dec91415abc8e6c301800eb00/groups/c72c213d70fc435b823e76d99d8310a8/roles/48808901834b4d5eab2c7e6b5b03791e` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:37.985589 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68c721f-a7ae-404c-ad48-37608af89947 None admin] RBAC: Authorizing `identity:create_grant(project_id=652aa39dec91415abc8e6c301800eb00, group_id=c72c213d70fc435b823e76d99d8310a8, role_id=48808901834b4d5eab2c7e6b5b03791e)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:27:37.987523 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68c721f-a7ae-404c-ad48-37608af89947 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:27:38.016308 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 194/390] 10.222.0.67 () {58 vars in 1442 bytes} [Wed May 25 14:27:37 2022] PUT /identity/v3/projects/652aa39dec91415abc8e6c301800eb00/groups/c72c213d70fc435b823e76d99d8310a8/roles/48808901834b4d5eab2c7e6b5b03791e => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:27:38.024068 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:27:38.048934 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa376c7-c549-4e6f-87a1-8ed568e4913d None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:27:38.102609 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556eb2d1-a5b3-4d57-9d20-e0a5f996a3f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:27:38.103328 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556eb2d1-a5b3-4d57-9d20-e0a5f996a3f5 None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:38.103619 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556eb2d1-a5b3-4d57-9d20-e0a5f996a3f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:38.103903 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556eb2d1-a5b3-4d57-9d20-e0a5f996a3f5 None admin] PATH_INFO: `/v3/roles` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:38.104671 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556eb2d1-a5b3-4d57-9d20-e0a5f996a3f5 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:27:38.104978 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556eb2d1-a5b3-4d57-9d20-e0a5f996a3f5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:27:38.106369 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556eb2d1-a5b3-4d57-9d20-e0a5f996a3f5 None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:27:38.116056 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 197/391] 10.222.0.67 () {56 vars in 1111 bytes} [Wed May 25 14:27:37 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:27:38.123562 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68c721f-a7ae-404c-ad48-37608af89947 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:27:38.284950 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68c721f-a7ae-404c-ad48-37608af89947 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:27:38.331216 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aef9f93-2110-48cd-bbb4-97bf24380237 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:27:38.332482 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aef9f93-2110-48cd-bbb4-97bf24380237 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:38.332995 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aef9f93-2110-48cd-bbb4-97bf24380237 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:38.333471 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aef9f93-2110-48cd-bbb4-97bf24380237 None admin] PATH_INFO: `/v3/groups/c72c213d70fc435b823e76d99d8310a8` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:38.336083 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aef9f93-2110-48cd-bbb4-97bf24380237 None admin] RBAC: Authorizing `identity:get_group(group_id=c72c213d70fc435b823e76d99d8310a8)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:27:38.337841 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aef9f93-2110-48cd-bbb4-97bf24380237 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:27:38.340205 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 195/392] 10.222.0.67 () {56 vars in 1180 bytes} [Wed May 25 14:27:38 2022] GET /identity/v3/groups/c72c213d70fc435b823e76d99d8310a8 => generated 226 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:27:38.346108 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556eb2d1-a5b3-4d57-9d20-e0a5f996a3f5 None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:27:38.510539 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556eb2d1-a5b3-4d57-9d20-e0a5f996a3f5 None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:27:38.530491 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2966882e-8dec-4b0f-bc89-05efa5a87cbf None None] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:38.531136 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2966882e-8dec-4b0f-bc89-05efa5a87cbf None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:38.531615 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2966882e-8dec-4b0f-bc89-05efa5a87cbf None None] PATH_INFO: `/` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:38.533205 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 196/393] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 14:27:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 14:27:38.540229 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607a25b3-e08e-45cc-b9cd-efc912239419 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:38.540771 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607a25b3-e08e-45cc-b9cd-efc912239419 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:38.541250 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607a25b3-e08e-45cc-b9cd-efc912239419 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:38.568650 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcd31b8-34c2-45b4-8b76-20c54da57a9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:27:38.569915 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcd31b8-34c2-45b4-8b76-20c54da57a9c None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:38.570400 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcd31b8-34c2-45b4-8b76-20c54da57a9c None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:38.570884 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcd31b8-34c2-45b4-8b76-20c54da57a9c None admin] PATH_INFO: `/v3/projects/652aa39dec91415abc8e6c301800eb00` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:38.572499 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-607a25b3-e08e-45cc-b9cd-efc912239419 None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:27:38.573341 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcd31b8-34c2-45b4-8b76-20c54da57a9c None admin] RBAC: Authorizing `identity:get_project(project_id=652aa39dec91415abc8e6c301800eb00)` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:27:38.575028 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcd31b8-34c2-45b4-8b76-20c54da57a9c None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:27:38.578473 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-607a25b3-e08e-45cc-b9cd-efc912239419 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:27:38.578954 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 198/394] 10.222.0.67 () {56 vars in 1186 bytes} [Wed May 25 14:27:38 2022] GET /identity/v3/projects/652aa39dec91415abc8e6c301800eb00 => generated 298 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:27:38.583157 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcd31b8-34c2-45b4-8b76-20c54da57a9c None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:27:38.623729 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:27:38.632711 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:27:38.728097 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 197/395] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 14:27:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 14:27:38.761717 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcd31b8-34c2-45b4-8b76-20c54da57a9c None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:27:38.805524 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a27e6f-c8a3-4a11-ba57-631fa6595435 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:27:38.806332 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a27e6f-c8a3-4a11-ba57-631fa6595435 None admin] REQUEST_METHOD: `PUT` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:38.806618 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a27e6f-c8a3-4a11-ba57-631fa6595435 None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:38.806897 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a27e6f-c8a3-4a11-ba57-631fa6595435 None admin] PATH_INFO: `/v3/projects/652aa39dec91415abc8e6c301800eb00/groups/c72c213d70fc435b823e76d99d8310a8/roles/3e87d9311f1d411395a3fcd41ac81431` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:38.810828 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607a25b3-e08e-45cc-b9cd-efc912239419 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:27:38.814774 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a27e6f-c8a3-4a11-ba57-631fa6595435 None admin] RBAC: Authorizing `identity:create_grant(project_id=652aa39dec91415abc8e6c301800eb00, group_id=c72c213d70fc435b823e76d99d8310a8, role_id=3e87d9311f1d411395a3fcd41ac81431)` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:27:38.820655 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a27e6f-c8a3-4a11-ba57-631fa6595435 None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:27:38.862330 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 199/396] 10.222.0.67 () {58 vars in 1442 bytes} [Wed May 25 14:27:38 2022] PUT /identity/v3/projects/652aa39dec91415abc8e6c301800eb00/groups/c72c213d70fc435b823e76d99d8310a8/roles/3e87d9311f1d411395a3fcd41ac81431 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:27:38.969138 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607a25b3-e08e-45cc-b9cd-efc912239419 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:27:39.019121 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fa43c4-414b-4db3-8c83-af18fea83b5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:27:39.019943 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fa43c4-414b-4db3-8c83-af18fea83b5c None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:39.020227 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fa43c4-414b-4db3-8c83-af18fea83b5c None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:39.020503 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fa43c4-414b-4db3-8c83-af18fea83b5c None admin] PATH_INFO: `/v3/roles/member` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:39.035339 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fa43c4-414b-4db3-8c83-af18fea83b5c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:27:39.043567 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application [None req-95fa43c4-414b-4db3-8c83-af18fea83b5c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 25 14:27:39.043567 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:27:39.043567 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:27:39.043567 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:27:39.043567 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:27:39.043567 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:27:39.043567 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:27:39.043567 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:27:39.043567 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:27:39.043567 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:27:39.043567 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:27:39.043567 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:27:39.043567 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:27:39.043567 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:27:39.043567 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:27:39.043567 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:27:39.044641 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:27:39.044641 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:27:39.044641 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:27:39.044641 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:27:39.044641 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:27:39.044641 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:27:39.044641 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:27:39.044641 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:27:39.044641 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:27:39.044641 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:27:39.044641 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:27:39.044641 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application with Lock( May 25 14:27:39.044641 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:27:39.044641 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._enter() May 25 14:27:39.044641 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:27:39.044641 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:27:39.045433 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:27:39.045433 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.creator() May 25 14:27:39.045433 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:27:39.045433 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application created_value = creator( May 25 14:27:39.045433 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:27:39.045433 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:27:39.045433 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:27:39.045433 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:27:39.045433 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:27:39.045433 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:27:39.045433 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 25 14:27:39.045433 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:27:39.045433 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 198/397] 10.222.0.67 () {56 vars in 1099 bytes} [Wed May 25 14:27:38 2022] GET /identity/v3/roles/member => generated 84 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 14:27:39.051791 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a27e6f-c8a3-4a11-ba57-631fa6595435 None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:27:39.152188 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:27:39.181773 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a27e6f-c8a3-4a11-ba57-631fa6595435 None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:27:39.220569 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b2af31-fdd8-4986-81dd-6a57be6d7581 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:27:39.221252 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b2af31-fdd8-4986-81dd-6a57be6d7581 None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:39.221541 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b2af31-fdd8-4986-81dd-6a57be6d7581 None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:39.221819 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b2af31-fdd8-4986-81dd-6a57be6d7581 None admin] PATH_INFO: `/v3/roles` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:39.222643 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b2af31-fdd8-4986-81dd-6a57be6d7581 None admin] RBAC: Adding query filter params (name=member) {{(pid=80474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:27:39.222960 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b2af31-fdd8-4986-81dd-6a57be6d7581 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:27:39.224388 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b2af31-fdd8-4986-81dd-6a57be6d7581 None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:27:39.236316 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 200/398] 10.222.0.67 () {56 vars in 1101 bytes} [Wed May 25 14:27:39 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:27:39.242179 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fa43c4-414b-4db3-8c83-af18fea83b5c None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:27:39.265283 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:27:39.368194 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fa43c4-414b-4db3-8c83-af18fea83b5c None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:27:39.409824 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374791f3-9ffa-41ff-8b22-5b5b72c477cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:27:39.410614 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374791f3-9ffa-41ff-8b22-5b5b72c477cc None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:39.410904 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374791f3-9ffa-41ff-8b22-5b5b72c477cc None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:39.411210 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374791f3-9ffa-41ff-8b22-5b5b72c477cc None admin] PATH_INFO: `/v3/groups/c72c213d70fc435b823e76d99d8310a8` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:39.412410 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374791f3-9ffa-41ff-8b22-5b5b72c477cc None admin] RBAC: Authorizing `identity:get_group(group_id=c72c213d70fc435b823e76d99d8310a8)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:27:39.413875 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374791f3-9ffa-41ff-8b22-5b5b72c477cc None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:27:39.415839 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 199/399] 10.222.0.67 () {56 vars in 1180 bytes} [Wed May 25 14:27:39 2022] GET /identity/v3/groups/c72c213d70fc435b823e76d99d8310a8 => generated 226 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:27:39.421912 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b2af31-fdd8-4986-81dd-6a57be6d7581 None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:27:39.536280 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4104b77d-7ea4-4144-a838-6ee37bafa5be None None] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:39.536595 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4104b77d-7ea4-4144-a838-6ee37bafa5be None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:39.536857 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4104b77d-7ea4-4144-a838-6ee37bafa5be None None] PATH_INFO: `/` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:39.538229 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 200/400] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 14:27:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 14:27:39.544184 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a970a1b-77b8-4f7f-9c31-db3dd5537453 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:39.544719 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a970a1b-77b8-4f7f-9c31-db3dd5537453 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:39.546014 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a970a1b-77b8-4f7f-9c31-db3dd5537453 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:39.553751 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b2af31-fdd8-4986-81dd-6a57be6d7581 None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:27:39.569294 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-5a970a1b-77b8-4f7f-9c31-db3dd5537453 None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:27:39.570822 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-5a970a1b-77b8-4f7f-9c31-db3dd5537453 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:27:39.598099 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef1b476-f487-4e7e-b05f-7b7871ef658f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:27:39.598985 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef1b476-f487-4e7e-b05f-7b7871ef658f None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:39.599296 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef1b476-f487-4e7e-b05f-7b7871ef658f None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:39.599577 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef1b476-f487-4e7e-b05f-7b7871ef658f None admin] PATH_INFO: `/v3/projects/24460f2e7a5e44f19737eed3c6799a16` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:39.603727 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef1b476-f487-4e7e-b05f-7b7871ef658f None admin] RBAC: Authorizing `identity:get_project(project_id=24460f2e7a5e44f19737eed3c6799a16)` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:27:39.605198 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef1b476-f487-4e7e-b05f-7b7871ef658f None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:27:39.609899 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 201/401] 10.222.0.67 () {56 vars in 1186 bytes} [Wed May 25 14:27:39 2022] GET /identity/v3/projects/24460f2e7a5e44f19737eed3c6799a16 => generated 302 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:27:39.617614 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef1b476-f487-4e7e-b05f-7b7871ef658f None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:27:39.634311 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:27:39.677482 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 201/402] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 14:27:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 14:27:39.714400 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a970a1b-77b8-4f7f-9c31-db3dd5537453 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:27:39.742553 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:27:39.768030 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef1b476-f487-4e7e-b05f-7b7871ef658f None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:27:39.807696 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2137b9-6253-4504-9a62-b8fe977d78be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:27:39.808585 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2137b9-6253-4504-9a62-b8fe977d78be None admin] REQUEST_METHOD: `PUT` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:39.808873 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2137b9-6253-4504-9a62-b8fe977d78be None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:39.809152 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2137b9-6253-4504-9a62-b8fe977d78be None admin] PATH_INFO: `/v3/projects/24460f2e7a5e44f19737eed3c6799a16/groups/c72c213d70fc435b823e76d99d8310a8/roles/48808901834b4d5eab2c7e6b5b03791e` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:39.811173 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2137b9-6253-4504-9a62-b8fe977d78be None admin] RBAC: Authorizing `identity:create_grant(project_id=24460f2e7a5e44f19737eed3c6799a16, group_id=c72c213d70fc435b823e76d99d8310a8, role_id=48808901834b4d5eab2c7e6b5b03791e)` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:27:39.813354 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2137b9-6253-4504-9a62-b8fe977d78be None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:27:39.834912 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 202/403] 10.222.0.67 () {58 vars in 1442 bytes} [Wed May 25 14:27:39 2022] PUT /identity/v3/projects/24460f2e7a5e44f19737eed3c6799a16/groups/c72c213d70fc435b823e76d99d8310a8/roles/48808901834b4d5eab2c7e6b5b03791e => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 14:27:39.836532 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c00d54-8566-4f28-899f-5b2712430087 None None] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:39.836824 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c00d54-8566-4f28-899f-5b2712430087 None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:39.837109 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c00d54-8566-4f28-899f-5b2712430087 None None] PATH_INFO: `/` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:39.838699 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 203/404] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 14:27:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:27:39.845184 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2137c5-8429-4385-a5ee-5f5c391d91bc None None] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:39.845475 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2137c5-8429-4385-a5ee-5f5c391d91bc None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:39.845752 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2137c5-8429-4385-a5ee-5f5c391d91bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:39.848857 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a970a1b-77b8-4f7f-9c31-db3dd5537453 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:27:39.889057 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbc51fd-6d6f-47b3-923d-701fade09e56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:27:39.891069 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbc51fd-6d6f-47b3-923d-701fade09e56 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:39.891703 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbc51fd-6d6f-47b3-923d-701fade09e56 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:39.892179 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbc51fd-6d6f-47b3-923d-701fade09e56 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:39.910029 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbc51fd-6d6f-47b3-923d-701fade09e56 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:27:39.916154 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.auth.core [None req-1d2137c5-8429-4385-a5ee-5f5c391d91bc None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:27:39.917754 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-1d2137c5-8429-4385-a5ee-5f5c391d91bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:27:39.927194 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application [None req-ccbc51fd-6d6f-47b3-923d-701fade09e56 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 14:27:39.927194 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:27:39.927194 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:27:39.927194 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:27:39.927194 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:27:39.927194 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:27:39.927194 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:27:39.927194 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:27:39.927194 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:27:39.927194 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:27:39.927194 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:27:39.927194 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:27:39.927194 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:27:39.927194 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:27:39.927194 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:27:39.927194 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:27:39.928256 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:27:39.928256 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:27:39.928256 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:27:39.928256 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:27:39.928256 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:27:39.928256 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:27:39.928256 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:27:39.928256 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:27:39.928256 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:27:39.928256 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:27:39.928256 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:27:39.928256 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application with Lock( May 25 14:27:39.928256 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:27:39.928256 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._enter() May 25 14:27:39.928256 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:27:39.928256 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:27:39.929080 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:27:39.929080 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.creator() May 25 14:27:39.929080 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:27:39.929080 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application created_value = creator( May 25 14:27:39.929080 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:27:39.929080 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:27:39.929080 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:27:39.929080 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:27:39.929080 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:27:39.929080 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:27:39.929080 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 14:27:39.929080 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:27:39.939173 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 202/405] 10.222.0.67 () {56 vars in 1114 bytes} [Wed May 25 14:27:39 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 14:27:39.944357 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbc51fd-6d6f-47b3-923d-701fade09e56 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:27:40.060954 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:27:40.075087 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 204/406] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 14:27:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 14:27:40.099874 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2137c5-8429-4385-a5ee-5f5c391d91bc None None] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:27:40.111232 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:27:40.143944 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbc51fd-6d6f-47b3-923d-701fade09e56 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:27:40.187780 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccc93dc-a3a1-4c29-8f18-0bcbb499bfd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:27:40.188776 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccc93dc-a3a1-4c29-8f18-0bcbb499bfd0 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:40.189214 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccc93dc-a3a1-4c29-8f18-0bcbb499bfd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:40.189641 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccc93dc-a3a1-4c29-8f18-0bcbb499bfd0 None admin] PATH_INFO: `/v3/roles` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:40.190535 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccc93dc-a3a1-4c29-8f18-0bcbb499bfd0 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:27:40.191022 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccc93dc-a3a1-4c29-8f18-0bcbb499bfd0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:27:40.192639 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccc93dc-a3a1-4c29-8f18-0bcbb499bfd0 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:27:40.207310 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 203/407] 10.222.0.67 () {56 vars in 1111 bytes} [Wed May 25 14:27:39 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:27:40.208471 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccc93dc-a3a1-4c29-8f18-0bcbb499bfd0 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:27:40.214199 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2137c5-8429-4385-a5ee-5f5c391d91bc None None] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:27:40.254235 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e0e4e0-84ba-42e1-8483-dd469ef1ecc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:27:40.255273 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e0e4e0-84ba-42e1-8483-dd469ef1ecc0 None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:40.255678 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e0e4e0-84ba-42e1-8483-dd469ef1ecc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:40.256055 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e0e4e0-84ba-42e1-8483-dd469ef1ecc0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:40.268491 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e0e4e0-84ba-42e1-8483-dd469ef1ecc0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:27:40.276701 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application [None req-12e0e4e0-84ba-42e1-8483-dd469ef1ecc0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 14:27:40.276701 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:27:40.276701 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:27:40.276701 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:27:40.276701 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:27:40.276701 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:27:40.276701 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:27:40.276701 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:27:40.276701 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:27:40.276701 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:27:40.276701 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:27:40.276701 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:27:40.276701 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:27:40.276701 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:27:40.276701 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:27:40.276701 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:27:40.277639 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:27:40.277639 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:27:40.277639 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:27:40.277639 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:27:40.277639 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:27:40.277639 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:27:40.277639 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:27:40.277639 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:27:40.277639 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:27:40.277639 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:27:40.277639 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:27:40.277639 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application with Lock( May 25 14:27:40.277639 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:27:40.277639 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self._enter() May 25 14:27:40.277639 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:27:40.277639 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:27:40.278470 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:27:40.278470 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.creator() May 25 14:27:40.278470 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:27:40.278470 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application created_value = creator( May 25 14:27:40.278470 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:27:40.278470 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:27:40.278470 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:27:40.278470 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:27:40.278470 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:27:40.278470 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:27:40.278470 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 14:27:40.278470 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application May 25 14:27:40.283333 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 205/408] 10.222.0.67 () {56 vars in 1096 bytes} [Wed May 25 14:27:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 14:27:40.285173 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e0e4e0-84ba-42e1-8483-dd469ef1ecc0 None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:27:40.329580 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccc93dc-a3a1-4c29-8f18-0bcbb499bfd0 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:27:40.353605 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:27:40.369543 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05186be0-247b-4516-87ad-b7f137c48741 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:27:40.371014 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05186be0-247b-4516-87ad-b7f137c48741 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:40.371506 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05186be0-247b-4516-87ad-b7f137c48741 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:40.372004 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05186be0-247b-4516-87ad-b7f137c48741 None admin] PATH_INFO: `/v3/groups/c72c213d70fc435b823e76d99d8310a8` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:40.373406 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05186be0-247b-4516-87ad-b7f137c48741 None admin] RBAC: Authorizing `identity:get_group(group_id=c72c213d70fc435b823e76d99d8310a8)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:27:40.375460 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05186be0-247b-4516-87ad-b7f137c48741 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:27:40.377636 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 204/409] 10.222.0.67 () {56 vars in 1180 bytes} [Wed May 25 14:27:40 2022] GET /identity/v3/groups/c72c213d70fc435b823e76d99d8310a8 => generated 226 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:27:40.385047 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05186be0-247b-4516-87ad-b7f137c48741 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:27:40.401210 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:27:40.403673 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e0e4e0-84ba-42e1-8483-dd469ef1ecc0 None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:27:40.444849 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f653c9d-9a31-4fa6-a9ba-568eff7cd7d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:27:40.445478 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f653c9d-9a31-4fa6-a9ba-568eff7cd7d8 None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:40.445764 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f653c9d-9a31-4fa6-a9ba-568eff7cd7d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:40.446104 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f653c9d-9a31-4fa6-a9ba-568eff7cd7d8 None admin] PATH_INFO: `/v3/roles` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:40.446794 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f653c9d-9a31-4fa6-a9ba-568eff7cd7d8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:27:40.447134 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f653c9d-9a31-4fa6-a9ba-568eff7cd7d8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:27:40.448520 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f653c9d-9a31-4fa6-a9ba-568eff7cd7d8 None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:27:40.463057 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 206/410] 10.222.0.67 () {56 vars in 1099 bytes} [Wed May 25 14:27:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:27:40.470086 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f653c9d-9a31-4fa6-a9ba-568eff7cd7d8 None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:27:40.546488 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05186be0-247b-4516-87ad-b7f137c48741 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:27:40.634664 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f653c9d-9a31-4fa6-a9ba-568eff7cd7d8 None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:27:40.644353 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2627955-f1cd-48e1-83c7-2be387dca523 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:27:40.645241 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2627955-f1cd-48e1-83c7-2be387dca523 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:40.645529 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2627955-f1cd-48e1-83c7-2be387dca523 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:40.645809 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2627955-f1cd-48e1-83c7-2be387dca523 None admin] PATH_INFO: `/v3/projects/24460f2e7a5e44f19737eed3c6799a16` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:40.651721 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2627955-f1cd-48e1-83c7-2be387dca523 None admin] RBAC: Authorizing `identity:get_project(project_id=24460f2e7a5e44f19737eed3c6799a16)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:27:40.653186 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2627955-f1cd-48e1-83c7-2be387dca523 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:27:40.654897 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 205/411] 10.222.0.67 () {56 vars in 1186 bytes} [Wed May 25 14:27:40 2022] GET /identity/v3/projects/24460f2e7a5e44f19737eed3c6799a16 => generated 302 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:27:40.660681 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:27:40.660829 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2627955-f1cd-48e1-83c7-2be387dca523 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:27:40.679032 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33a8d6b-2703-40ba-8c17-8f4ccedd6a90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:27:40.680292 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33a8d6b-2703-40ba-8c17-8f4ccedd6a90 None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:40.681262 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33a8d6b-2703-40ba-8c17-8f4ccedd6a90 None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:40.681753 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33a8d6b-2703-40ba-8c17-8f4ccedd6a90 None admin] PATH_INFO: `/v3/groups/ff10c2a59f714a45b16862f1cf81d4e7` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:40.683195 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33a8d6b-2703-40ba-8c17-8f4ccedd6a90 None admin] RBAC: Authorizing `identity:get_group(group_id=ff10c2a59f714a45b16862f1cf81d4e7)` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:27:40.685592 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33a8d6b-2703-40ba-8c17-8f4ccedd6a90 None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:27:40.687966 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 207/412] 10.222.0.67 () {56 vars in 1180 bytes} [Wed May 25 14:27:40 2022] GET /identity/v3/groups/ff10c2a59f714a45b16862f1cf81d4e7 => generated 229 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:27:40.693241 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33a8d6b-2703-40ba-8c17-8f4ccedd6a90 None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:27:40.828886 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:27:40.853565 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33a8d6b-2703-40ba-8c17-8f4ccedd6a90 None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:27:40.891374 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd8059d-bb07-4c74-93db-54654165b9b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:27:40.892304 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd8059d-bb07-4c74-93db-54654165b9b7 None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:40.892586 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd8059d-bb07-4c74-93db-54654165b9b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:40.892860 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd8059d-bb07-4c74-93db-54654165b9b7 None admin] PATH_INFO: `/v3/projects/277acbf9eb0e4a9b87508241a478db4f` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:40.892961 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2627955-f1cd-48e1-83c7-2be387dca523 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:27:40.894115 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd8059d-bb07-4c74-93db-54654165b9b7 None admin] RBAC: Authorizing `identity:get_project(project_id=277acbf9eb0e4a9b87508241a478db4f)` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:27:40.895954 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd8059d-bb07-4c74-93db-54654165b9b7 None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:27:40.899027 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 208/413] 10.222.0.67 () {56 vars in 1186 bytes} [Wed May 25 14:27:40 2022] GET /identity/v3/projects/277acbf9eb0e4a9b87508241a478db4f => generated 344 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:27:40.908572 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd8059d-bb07-4c74-93db-54654165b9b7 None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:27:40.964423 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc1c6d9-dd60-4dc0-8b68-aace69862ddc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:27:40.965307 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc1c6d9-dd60-4dc0-8b68-aace69862ddc None admin] REQUEST_METHOD: `PUT` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:40.965587 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc1c6d9-dd60-4dc0-8b68-aace69862ddc None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:40.965861 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc1c6d9-dd60-4dc0-8b68-aace69862ddc None admin] PATH_INFO: `/v3/projects/24460f2e7a5e44f19737eed3c6799a16/groups/c72c213d70fc435b823e76d99d8310a8/roles/3e87d9311f1d411395a3fcd41ac81431` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:40.970198 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc1c6d9-dd60-4dc0-8b68-aace69862ddc None admin] RBAC: Authorizing `identity:create_grant(project_id=24460f2e7a5e44f19737eed3c6799a16, group_id=c72c213d70fc435b823e76d99d8310a8, role_id=3e87d9311f1d411395a3fcd41ac81431)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:27:40.971677 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc1c6d9-dd60-4dc0-8b68-aace69862ddc None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:27:40.989862 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 206/414] 10.222.0.67 () {58 vars in 1442 bytes} [Wed May 25 14:27:40 2022] PUT /identity/v3/projects/24460f2e7a5e44f19737eed3c6799a16/groups/c72c213d70fc435b823e76d99d8310a8/roles/3e87d9311f1d411395a3fcd41ac81431 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 14:27:40.995370 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2491de6-892e-4e93-bc57-1cde03bfb343 None None] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:40.995958 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2491de6-892e-4e93-bc57-1cde03bfb343 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:40.996242 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2491de6-892e-4e93-bc57-1cde03bfb343 None None] PATH_INFO: `/` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:40.997710 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 207/415] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 14:27:40 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:27:41.006984 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc34bfa-981f-47aa-9075-ff55985e1564 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:41.007933 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc34bfa-981f-47aa-9075-ff55985e1564 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:41.009719 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc34bfa-981f-47aa-9075-ff55985e1564 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:41.013395 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:27:41.045528 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-5cc34bfa-981f-47aa-9075-ff55985e1564 None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:27:41.051511 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-5cc34bfa-981f-47aa-9075-ff55985e1564 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:27:41.105724 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd8059d-bb07-4c74-93db-54654165b9b7 None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:27:41.161937 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8f12f8-02f0-405b-bbfa-49728410686f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:27:41.162839 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8f12f8-02f0-405b-bbfa-49728410686f None admin] REQUEST_METHOD: `PUT` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:41.163148 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8f12f8-02f0-405b-bbfa-49728410686f None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:41.163424 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8f12f8-02f0-405b-bbfa-49728410686f None admin] PATH_INFO: `/v3/projects/277acbf9eb0e4a9b87508241a478db4f/groups/ff10c2a59f714a45b16862f1cf81d4e7/roles/399893e19eac4ab5a8e596f7c07be13c` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:41.169557 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8f12f8-02f0-405b-bbfa-49728410686f None admin] RBAC: Authorizing `identity:create_grant(project_id=277acbf9eb0e4a9b87508241a478db4f, group_id=ff10c2a59f714a45b16862f1cf81d4e7, role_id=399893e19eac4ab5a8e596f7c07be13c)` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:27:41.175599 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8f12f8-02f0-405b-bbfa-49728410686f None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:27:41.199758 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 208/416] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 14:27:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 14:27:41.205802 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 209/417] 10.222.0.67 () {58 vars in 1442 bytes} [Wed May 25 14:27:40 2022] PUT /identity/v3/projects/277acbf9eb0e4a9b87508241a478db4f/groups/ff10c2a59f714a45b16862f1cf81d4e7/roles/399893e19eac4ab5a8e596f7c07be13c => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:27:41.225570 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc34bfa-981f-47aa-9075-ff55985e1564 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:27:41.300782 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:27:41.360169 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc34bfa-981f-47aa-9075-ff55985e1564 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:27:41.413283 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b226503d-0684-47f9-9f57-e605e8f5ad2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:27:41.414107 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b226503d-0684-47f9-9f57-e605e8f5ad2c None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:41.414397 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b226503d-0684-47f9-9f57-e605e8f5ad2c None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:41.414674 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b226503d-0684-47f9-9f57-e605e8f5ad2c None admin] PATH_INFO: `/v3/roles/member` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:41.432135 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b226503d-0684-47f9-9f57-e605e8f5ad2c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:27:41.440429 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application [None req-b226503d-0684-47f9-9f57-e605e8f5ad2c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 25 14:27:41.440429 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:27:41.440429 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:27:41.440429 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:27:41.440429 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:27:41.440429 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:27:41.440429 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:27:41.440429 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:27:41.440429 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:27:41.440429 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:27:41.440429 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:27:41.440429 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:27:41.440429 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:27:41.440429 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:27:41.440429 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:27:41.440429 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:27:41.441582 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:27:41.441582 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:27:41.441582 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:27:41.441582 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:27:41.441582 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:27:41.441582 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:27:41.441582 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:27:41.441582 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:27:41.441582 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:27:41.441582 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:27:41.441582 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:27:41.441582 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application with Lock( May 25 14:27:41.441582 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:27:41.441582 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._enter() May 25 14:27:41.441582 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:27:41.441582 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:27:41.442584 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:27:41.442584 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.creator() May 25 14:27:41.442584 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:27:41.442584 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application created_value = creator( May 25 14:27:41.442584 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:27:41.442584 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:27:41.442584 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:27:41.442584 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:27:41.442584 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:27:41.442584 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:27:41.442584 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 25 14:27:41.442584 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:27:41.442584 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 209/418] 10.222.0.67 () {56 vars in 1099 bytes} [Wed May 25 14:27:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:27:41.449417 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8f12f8-02f0-405b-bbfa-49728410686f None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:27:41.576507 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8f12f8-02f0-405b-bbfa-49728410686f None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:27:41.599747 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:27:41.621476 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc615890-39f9-4d43-a2bf-7b0dd0bf6c5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:27:41.622086 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc615890-39f9-4d43-a2bf-7b0dd0bf6c5e None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:41.622367 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc615890-39f9-4d43-a2bf-7b0dd0bf6c5e None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:41.622642 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc615890-39f9-4d43-a2bf-7b0dd0bf6c5e None admin] PATH_INFO: `/v3/roles` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:41.623500 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc615890-39f9-4d43-a2bf-7b0dd0bf6c5e None admin] RBAC: Adding query filter params (name=member) {{(pid=80474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:27:41.623904 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc615890-39f9-4d43-a2bf-7b0dd0bf6c5e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:27:41.626001 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc615890-39f9-4d43-a2bf-7b0dd0bf6c5e None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:27:41.635191 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 210/419] 10.222.0.67 () {56 vars in 1101 bytes} [Wed May 25 14:27:41 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:27:41.640646 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b226503d-0684-47f9-9f57-e605e8f5ad2c None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:27:41.766710 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4752f9c9-6b62-4640-a4ec-c99763147ade None None] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:41.767059 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4752f9c9-6b62-4640-a4ec-c99763147ade None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:41.767300 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4752f9c9-6b62-4640-a4ec-c99763147ade None None] PATH_INFO: `/` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:41.768809 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 211/420] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 14:27:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:27:41.774209 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768bede4-1126-4b61-915b-b92bef203114 None None] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:41.774906 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768bede4-1126-4b61-915b-b92bef203114 None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:41.775441 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768bede4-1126-4b61-915b-b92bef203114 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:41.798163 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b226503d-0684-47f9-9f57-e605e8f5ad2c None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:27:41.810659 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.auth.core [None req-768bede4-1126-4b61-915b-b92bef203114 None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:27:41.813116 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-768bede4-1126-4b61-915b-b92bef203114 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:27:41.827252 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:27:41.860710 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a39fbf1-e486-4f83-8d6e-34209e9231ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:27:41.861379 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a39fbf1-e486-4f83-8d6e-34209e9231ca None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:41.861646 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a39fbf1-e486-4f83-8d6e-34209e9231ca None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:41.861979 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a39fbf1-e486-4f83-8d6e-34209e9231ca None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:41.948129 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 212/421] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 14:27:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 14:27:41.973888 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768bede4-1126-4b61-915b-b92bef203114 None None] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:27:42.000434 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a39fbf1-e486-4f83-8d6e-34209e9231ca None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:27:42.001915 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a39fbf1-e486-4f83-8d6e-34209e9231ca None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:27:42.182249 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768bede4-1126-4b61-915b-b92bef203114 None None] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:27:42.199667 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:27:42.208299 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 210/422] 10.222.0.67 () {58 vars in 1282 bytes} [Wed May 25 14:27:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 568 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 14:27:42.214124 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a39fbf1-e486-4f83-8d6e-34209e9231ca None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:27:42.241928 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:27:42.249865 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad73e6a-f388-4fdf-af4e-3f8d8020a90d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:27:42.250701 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad73e6a-f388-4fdf-af4e-3f8d8020a90d None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:42.250985 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad73e6a-f388-4fdf-af4e-3f8d8020a90d None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:42.251278 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad73e6a-f388-4fdf-af4e-3f8d8020a90d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:42.272476 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad73e6a-f388-4fdf-af4e-3f8d8020a90d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:27:42.293175 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application [None req-7ad73e6a-f388-4fdf-af4e-3f8d8020a90d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 14:27:42.293175 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:27:42.293175 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:27:42.293175 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:27:42.293175 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:27:42.293175 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:27:42.293175 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:27:42.293175 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:27:42.293175 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:27:42.293175 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:27:42.293175 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:27:42.293175 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:27:42.293175 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:27:42.293175 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:27:42.293175 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:27:42.293175 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:27:42.294148 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:27:42.294148 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:27:42.294148 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:27:42.294148 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:27:42.294148 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:27:42.294148 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:27:42.294148 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:27:42.294148 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:27:42.294148 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:27:42.294148 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:27:42.294148 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:27:42.294148 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application with Lock( May 25 14:27:42.294148 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:27:42.294148 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self._enter() May 25 14:27:42.294148 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:27:42.294148 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:27:42.294985 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:27:42.294985 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.creator() May 25 14:27:42.294985 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:27:42.294985 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application created_value = creator( May 25 14:27:42.294985 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:27:42.294985 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:27:42.294985 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:27:42.294985 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:27:42.294985 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:27:42.294985 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:27:42.294985 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 14:27:42.294985 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application May 25 14:27:42.294985 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 213/423] 10.222.0.67 () {56 vars in 1114 bytes} [Wed May 25 14:27:41 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 321 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 14:27:42.302507 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad73e6a-f388-4fdf-af4e-3f8d8020a90d None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:27:42.319615 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a39fbf1-e486-4f83-8d6e-34209e9231ca None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:27:42.363633 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f4b31c-0741-41b2-9b8a-a7e09a13a24f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:27:42.364590 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f4b31c-0741-41b2-9b8a-a7e09a13a24f None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:42.364897 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f4b31c-0741-41b2-9b8a-a7e09a13a24f None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:42.365236 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f4b31c-0741-41b2-9b8a-a7e09a13a24f None admin] PATH_INFO: `/v3/projects/652aa39dec91415abc8e6c301800eb00` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:42.366420 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f4b31c-0741-41b2-9b8a-a7e09a13a24f None admin] RBAC: Authorizing `identity:get_project(project_id=652aa39dec91415abc8e6c301800eb00)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:27:42.367986 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f4b31c-0741-41b2-9b8a-a7e09a13a24f None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:27:42.369767 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 211/424] 10.222.0.67 () {56 vars in 1186 bytes} [Wed May 25 14:27:42 2022] GET /identity/v3/projects/652aa39dec91415abc8e6c301800eb00 => generated 298 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:27:42.375927 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f4b31c-0741-41b2-9b8a-a7e09a13a24f None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:27:42.446295 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad73e6a-f388-4fdf-af4e-3f8d8020a90d None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:27:42.478294 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:27:42.481696 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f4b31c-0741-41b2-9b8a-a7e09a13a24f None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:27:42.484148 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a50c33-e9b0-40aa-9a87-898d5eae2893 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:27:42.485046 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a50c33-e9b0-40aa-9a87-898d5eae2893 None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:42.485334 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a50c33-e9b0-40aa-9a87-898d5eae2893 None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:42.485607 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a50c33-e9b0-40aa-9a87-898d5eae2893 None admin] PATH_INFO: `/v3/roles` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:42.486366 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a50c33-e9b0-40aa-9a87-898d5eae2893 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:27:42.486673 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a50c33-e9b0-40aa-9a87-898d5eae2893 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:27:42.488081 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a50c33-e9b0-40aa-9a87-898d5eae2893 None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:27:42.497124 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 214/425] 10.222.0.67 () {56 vars in 1111 bytes} [Wed May 25 14:27:42 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:27:42.498651 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41585522-c600-4863-8731-2afd134bd2b9 None None] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:42.499507 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41585522-c600-4863-8731-2afd134bd2b9 None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:42.499788 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41585522-c600-4863-8731-2afd134bd2b9 None None] PATH_INFO: `/` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:42.501444 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 215/426] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 14:27:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:27:42.507653 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4a8c40-f9b1-4897-bd7d-1238b311d06d None None] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:42.508127 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4a8c40-f9b1-4897-bd7d-1238b311d06d None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:42.508650 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4a8c40-f9b1-4897-bd7d-1238b311d06d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:42.520127 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493e0416-82f6-4efb-925a-789632d73942 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:27:42.520974 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493e0416-82f6-4efb-925a-789632d73942 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:42.521252 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493e0416-82f6-4efb-925a-789632d73942 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:42.521525 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493e0416-82f6-4efb-925a-789632d73942 None admin] PATH_INFO: `/v3/groups/c72c213d70fc435b823e76d99d8310a8` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:42.522812 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493e0416-82f6-4efb-925a-789632d73942 None admin] RBAC: Authorizing `identity:get_group(group_id=c72c213d70fc435b823e76d99d8310a8)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:27:42.524370 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493e0416-82f6-4efb-925a-789632d73942 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:27:42.526324 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 212/427] 10.222.0.67 () {56 vars in 1180 bytes} [Wed May 25 14:27:42 2022] GET /identity/v3/groups/c72c213d70fc435b823e76d99d8310a8 => generated 226 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:27:42.528406 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.auth.core [None req-cd4a8c40-f9b1-4897-bd7d-1238b311d06d None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:27:42.529788 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-cd4a8c40-f9b1-4897-bd7d-1238b311d06d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:27:42.532177 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493e0416-82f6-4efb-925a-789632d73942 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:27:42.558439 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:27:42.619020 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 216/428] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 14:27:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 14:27:42.619020 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4a8c40-f9b1-4897-bd7d-1238b311d06d None None] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:27:42.668438 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493e0416-82f6-4efb-925a-789632d73942 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:27:42.705931 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad2421e-51f0-43fb-8e6e-5c2c38087d03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:27:42.706302 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad2421e-51f0-43fb-8e6e-5c2c38087d03 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:42.706625 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad2421e-51f0-43fb-8e6e-5c2c38087d03 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:42.706888 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad2421e-51f0-43fb-8e6e-5c2c38087d03 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:42.739503 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:27:42.769303 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4a8c40-f9b1-4897-bd7d-1238b311d06d None None] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:27:42.794032 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad2421e-51f0-43fb-8e6e-5c2c38087d03 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:27:42.795555 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad2421e-51f0-43fb-8e6e-5c2c38087d03 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:27:42.820649 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b82ca5-1a9e-4fdd-8f71-41f1101f70fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:27:42.822060 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b82ca5-1a9e-4fdd-8f71-41f1101f70fc None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:42.822772 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b82ca5-1a9e-4fdd-8f71-41f1101f70fc None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:42.827473 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b82ca5-1a9e-4fdd-8f71-41f1101f70fc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:42.828347 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b82ca5-1a9e-4fdd-8f71-41f1101f70fc None admin] RBAC: Adding query filter params (group.id=c72c213d70fc435b823e76d99d8310a8, role.id=48808901834b4d5eab2c7e6b5b03791e, scope.project.id=652aa39dec91415abc8e6c301800eb00) {{(pid=80474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:27:42.828667 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b82ca5-1a9e-4fdd-8f71-41f1101f70fc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:27:42.830112 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b82ca5-1a9e-4fdd-8f71-41f1101f70fc None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:27:42.845674 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 217/429] 10.222.0.67 () {56 vars in 1376 bytes} [Wed May 25 14:27:42 2022] GET /identity/v3/role_assignments?group.id=c72c213d70fc435b823e76d99d8310a8&scope.project.id=652aa39dec91415abc8e6c301800eb00&role.id=48808901834b4d5eab2c7e6b5b03791e => generated 611 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:27:42.846156 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b82ca5-1a9e-4fdd-8f71-41f1101f70fc None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:27:42.911388 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:27:42.927296 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 213/430] 10.222.0.67 () {58 vars in 1282 bytes} [Wed May 25 14:27:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 14:27:42.941180 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad2421e-51f0-43fb-8e6e-5c2c38087d03 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:27:43.018564 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:27:43.067270 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad2421e-51f0-43fb-8e6e-5c2c38087d03 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:27:43.074757 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b82ca5-1a9e-4fdd-8f71-41f1101f70fc None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:27:43.106448 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f17e7b2-3fee-4858-a32c-08802e862ed7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:27:43.107889 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f17e7b2-3fee-4858-a32c-08802e862ed7 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:43.108921 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f17e7b2-3fee-4858-a32c-08802e862ed7 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:43.113636 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f17e7b2-3fee-4858-a32c-08802e862ed7 None admin] PATH_INFO: `/v3/projects/652aa39dec91415abc8e6c301800eb00` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:43.113636 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f17e7b2-3fee-4858-a32c-08802e862ed7 None admin] RBAC: Authorizing `identity:get_project(project_id=652aa39dec91415abc8e6c301800eb00)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:27:43.114390 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f17e7b2-3fee-4858-a32c-08802e862ed7 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:27:43.116323 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 214/431] 10.222.0.67 () {56 vars in 1186 bytes} [Wed May 25 14:27:42 2022] GET /identity/v3/projects/652aa39dec91415abc8e6c301800eb00 => generated 298 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:27:43.122511 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f17e7b2-3fee-4858-a32c-08802e862ed7 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:27:43.123478 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a53139-41b6-4f0b-b98c-6a216d771a0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:27:43.124352 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a53139-41b6-4f0b-b98c-6a216d771a0f None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:43.124622 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a53139-41b6-4f0b-b98c-6a216d771a0f None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:43.124901 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a53139-41b6-4f0b-b98c-6a216d771a0f None admin] PATH_INFO: `/v3/roles/member` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:43.138698 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a53139-41b6-4f0b-b98c-6a216d771a0f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:27:43.149701 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application [None req-95a53139-41b6-4f0b-b98c-6a216d771a0f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 25 14:27:43.149701 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:27:43.149701 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:27:43.149701 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:27:43.149701 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:27:43.149701 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:27:43.149701 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:27:43.149701 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:27:43.149701 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:27:43.149701 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:27:43.149701 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:27:43.149701 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:27:43.149701 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:27:43.149701 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:27:43.149701 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:27:43.149701 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:27:43.150633 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:27:43.150633 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:27:43.150633 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:27:43.150633 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:27:43.150633 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:27:43.150633 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:27:43.150633 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:27:43.150633 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:27:43.150633 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:27:43.150633 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:27:43.150633 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:27:43.150633 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application with Lock( May 25 14:27:43.150633 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:27:43.150633 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self._enter() May 25 14:27:43.150633 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:27:43.150633 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:27:43.151540 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:27:43.151540 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.creator() May 25 14:27:43.151540 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:27:43.151540 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application created_value = creator( May 25 14:27:43.151540 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:27:43.151540 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:27:43.151540 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:27:43.151540 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:27:43.151540 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:27:43.151540 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:27:43.151540 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 25 14:27:43.151540 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application May 25 14:27:43.156766 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 218/432] 10.222.0.67 () {56 vars in 1099 bytes} [Wed May 25 14:27:42 2022] GET /identity/v3/roles/member => generated 84 bytes in 311 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:27:43.162566 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a53139-41b6-4f0b-b98c-6a216d771a0f None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:27:43.278391 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f17e7b2-3fee-4858-a32c-08802e862ed7 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:27:43.281689 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:27:43.305868 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a53139-41b6-4f0b-b98c-6a216d771a0f None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:27:43.313284 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:27:43.322892 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d15246-a9bb-47f7-9634-81a70d664e7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:27:43.323890 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d15246-a9bb-47f7-9634-81a70d664e7d None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:43.324249 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d15246-a9bb-47f7-9634-81a70d664e7d None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:43.324598 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d15246-a9bb-47f7-9634-81a70d664e7d None admin] PATH_INFO: `/v3/groups/c72c213d70fc435b823e76d99d8310a8` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:43.325851 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d15246-a9bb-47f7-9634-81a70d664e7d None admin] RBAC: Authorizing `identity:get_group(group_id=c72c213d70fc435b823e76d99d8310a8)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:27:43.329858 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d15246-a9bb-47f7-9634-81a70d664e7d None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:27:43.333119 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 215/433] 10.222.0.67 () {56 vars in 1180 bytes} [Wed May 25 14:27:43 2022] GET /identity/v3/groups/c72c213d70fc435b823e76d99d8310a8 => generated 226 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:27:43.339434 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d15246-a9bb-47f7-9634-81a70d664e7d None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:27:43.351792 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3343ce9d-7eb3-458e-9869-d018badf0af6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:27:43.353441 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3343ce9d-7eb3-458e-9869-d018badf0af6 None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:43.354023 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3343ce9d-7eb3-458e-9869-d018badf0af6 None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:43.354507 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3343ce9d-7eb3-458e-9869-d018badf0af6 None admin] PATH_INFO: `/v3/roles` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:43.356331 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3343ce9d-7eb3-458e-9869-d018badf0af6 None admin] RBAC: Adding query filter params (name=member) {{(pid=80474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:27:43.357013 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3343ce9d-7eb3-458e-9869-d018badf0af6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:27:43.359261 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3343ce9d-7eb3-458e-9869-d018badf0af6 None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:27:43.372459 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 219/434] 10.222.0.67 () {56 vars in 1101 bytes} [Wed May 25 14:27:43 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:27:43.378904 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3343ce9d-7eb3-458e-9869-d018badf0af6 None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:27:43.466651 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d15246-a9bb-47f7-9634-81a70d664e7d None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:27:43.507808 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef284629-2387-4fbf-bceb-f291c3cf601c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:27:43.508510 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef284629-2387-4fbf-bceb-f291c3cf601c None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:43.508820 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef284629-2387-4fbf-bceb-f291c3cf601c None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:43.509069 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef284629-2387-4fbf-bceb-f291c3cf601c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:43.509910 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef284629-2387-4fbf-bceb-f291c3cf601c None admin] RBAC: Adding query filter params (group.id=c72c213d70fc435b823e76d99d8310a8, role.id=3e87d9311f1d411395a3fcd41ac81431, scope.project.id=652aa39dec91415abc8e6c301800eb00) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:27:43.510223 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef284629-2387-4fbf-bceb-f291c3cf601c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:27:43.511712 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef284629-2387-4fbf-bceb-f291c3cf601c None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:27:43.519653 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3343ce9d-7eb3-458e-9869-d018badf0af6 None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:27:43.520351 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 216/435] 10.222.0.67 () {56 vars in 1376 bytes} [Wed May 25 14:27:43 2022] GET /identity/v3/role_assignments?group.id=c72c213d70fc435b823e76d99d8310a8&scope.project.id=652aa39dec91415abc8e6c301800eb00&role.id=3e87d9311f1d411395a3fcd41ac81431 => generated 611 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:27:43.571928 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f47a2c-6e8d-45d3-8fe6-975ebb9830f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:27:43.572948 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f47a2c-6e8d-45d3-8fe6-975ebb9830f9 None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:43.573438 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f47a2c-6e8d-45d3-8fe6-975ebb9830f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:43.573918 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f47a2c-6e8d-45d3-8fe6-975ebb9830f9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:43.603208 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:27:43.682328 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f47a2c-6e8d-45d3-8fe6-975ebb9830f9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:27:43.683892 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f47a2c-6e8d-45d3-8fe6-975ebb9830f9 None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:27:43.814380 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 220/436] 10.222.0.67 () {58 vars in 1282 bytes} [Wed May 25 14:27:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 14:27:43.819741 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef284629-2387-4fbf-bceb-f291c3cf601c None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:27:43.892399 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:27:43.901212 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8a9c66-b2cc-418c-859e-441558b09ef0 None None] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:43.901500 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8a9c66-b2cc-418c-859e-441558b09ef0 None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:43.901846 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8a9c66-b2cc-418c-859e-441558b09ef0 None None] PATH_INFO: `/` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:43.903253 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 221/437] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 14:27:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 14:27:43.904315 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1312b96-2157-40f8-8455-9563c2d189e0 None None] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:43.904594 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1312b96-2157-40f8-8455-9563c2d189e0 None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:43.904864 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1312b96-2157-40f8-8455-9563c2d189e0 None None] PATH_INFO: `/` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:43.906846 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 222/438] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 14:27:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:27:43.910382 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe562f35-7522-4d64-95b6-8129674cfe66 None None] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:43.910682 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe562f35-7522-4d64-95b6-8129674cfe66 None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:43.910971 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe562f35-7522-4d64-95b6-8129674cfe66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:43.930069 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.auth.core [None req-fe562f35-7522-4d64-95b6-8129674cfe66 None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:27:43.931469 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-fe562f35-7522-4d64-95b6-8129674cfe66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:27:43.941486 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef284629-2387-4fbf-bceb-f291c3cf601c None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:27:43.984372 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48a47d1-a9bf-4695-8b8a-3f4b3050924b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:27:43.985239 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48a47d1-a9bf-4695-8b8a-3f4b3050924b None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:43.985528 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48a47d1-a9bf-4695-8b8a-3f4b3050924b None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:43.985807 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48a47d1-a9bf-4695-8b8a-3f4b3050924b None admin] PATH_INFO: `/v3/projects/24460f2e7a5e44f19737eed3c6799a16` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:43.986734 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:27:43.987141 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48a47d1-a9bf-4695-8b8a-3f4b3050924b None admin] RBAC: Authorizing `identity:get_project(project_id=24460f2e7a5e44f19737eed3c6799a16)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:27:43.988657 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48a47d1-a9bf-4695-8b8a-3f4b3050924b None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:27:43.990327 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 217/439] 10.222.0.67 () {56 vars in 1186 bytes} [Wed May 25 14:27:43 2022] GET /identity/v3/projects/24460f2e7a5e44f19737eed3c6799a16 => generated 302 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:27:43.991642 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9e1d38-10db-4317-9248-2b8a80beb95d None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:43.991931 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9e1d38-10db-4317-9248-2b8a80beb95d None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:43.992212 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9e1d38-10db-4317-9248-2b8a80beb95d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:44.012329 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-7e9e1d38-10db-4317-9248-2b8a80beb95d None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:27:44.013512 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-7e9e1d38-10db-4317-9248-2b8a80beb95d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:27:44.019077 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 223/440] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 14:27:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 14:27:44.019710 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe562f35-7522-4d64-95b6-8129674cfe66 None None] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:27:44.091948 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 218/441] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 14:27:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 14:27:44.093707 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9e1d38-10db-4317-9248-2b8a80beb95d None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:27:44.135196 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe562f35-7522-4d64-95b6-8129674cfe66 None None] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:27:44.154882 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:27:44.170260 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce985fa0-8a18-41cf-a2b3-bb36cf883ee9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:27:44.171790 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce985fa0-8a18-41cf-a2b3-bb36cf883ee9 None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:44.172082 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce985fa0-8a18-41cf-a2b3-bb36cf883ee9 None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:44.172361 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce985fa0-8a18-41cf-a2b3-bb36cf883ee9 None admin] PATH_INFO: `/v3/groups/c72c213d70fc435b823e76d99d8310a8` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:44.173544 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce985fa0-8a18-41cf-a2b3-bb36cf883ee9 None admin] RBAC: Authorizing `identity:get_group(group_id=c72c213d70fc435b823e76d99d8310a8)` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:27:44.174983 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce985fa0-8a18-41cf-a2b3-bb36cf883ee9 None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:27:44.176630 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 224/442] 10.222.0.67 () {56 vars in 1180 bytes} [Wed May 25 14:27:44 2022] GET /identity/v3/groups/c72c213d70fc435b823e76d99d8310a8 => generated 226 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:27:44.177377 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce985fa0-8a18-41cf-a2b3-bb36cf883ee9 None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:27:44.197293 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9e1d38-10db-4317-9248-2b8a80beb95d None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:27:44.222380 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:27:44.230956 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f9d693-dbfc-4ca7-a499-220e58cbba1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:27:44.231780 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f9d693-dbfc-4ca7-a499-220e58cbba1a None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:44.232059 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f9d693-dbfc-4ca7-a499-220e58cbba1a None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:44.232328 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f9d693-dbfc-4ca7-a499-220e58cbba1a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:44.243249 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f9d693-dbfc-4ca7-a499-220e58cbba1a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:27:44.251712 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application [None req-a9f9d693-dbfc-4ca7-a499-220e58cbba1a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 14:27:44.251712 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:27:44.251712 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:27:44.251712 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:27:44.251712 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:27:44.251712 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:27:44.251712 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:27:44.251712 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:27:44.251712 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:27:44.251712 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:27:44.251712 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:27:44.251712 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:27:44.251712 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:27:44.251712 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:27:44.251712 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:27:44.251712 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:27:44.252639 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:27:44.252639 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:27:44.252639 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:27:44.252639 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:27:44.252639 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:27:44.252639 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:27:44.252639 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:27:44.252639 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:27:44.252639 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:27:44.252639 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:27:44.252639 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:27:44.252639 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application with Lock( May 25 14:27:44.252639 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:27:44.252639 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._enter() May 25 14:27:44.252639 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:27:44.252639 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:27:44.253839 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:27:44.253839 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.creator() May 25 14:27:44.253839 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:27:44.253839 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application created_value = creator( May 25 14:27:44.253839 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:27:44.253839 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:27:44.253839 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:27:44.253839 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:27:44.253839 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:27:44.253839 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:27:44.253839 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 14:27:44.253839 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:27:44.253839 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 219/443] 10.222.0.67 () {56 vars in 1114 bytes} [Wed May 25 14:27:44 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:27:44.254662 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f9d693-dbfc-4ca7-a499-220e58cbba1a None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:27:44.280845 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce985fa0-8a18-41cf-a2b3-bb36cf883ee9 None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:27:44.314187 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffd32c8-5a48-4a63-93cd-9305f60e0c16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:27:44.314978 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffd32c8-5a48-4a63-93cd-9305f60e0c16 None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:44.315291 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffd32c8-5a48-4a63-93cd-9305f60e0c16 None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:44.315574 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffd32c8-5a48-4a63-93cd-9305f60e0c16 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:44.325497 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffd32c8-5a48-4a63-93cd-9305f60e0c16 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:27:44.333277 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application [None req-cffd32c8-5a48-4a63-93cd-9305f60e0c16 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 14:27:44.333277 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:27:44.333277 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:27:44.333277 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:27:44.333277 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:27:44.333277 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:27:44.333277 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:27:44.333277 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:27:44.333277 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:27:44.333277 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:27:44.333277 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:27:44.333277 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:27:44.333277 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:27:44.333277 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:27:44.333277 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:27:44.333277 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:27:44.334252 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:27:44.334252 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:27:44.334252 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:27:44.334252 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:27:44.334252 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:27:44.334252 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:27:44.334252 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:27:44.334252 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:27:44.334252 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:27:44.334252 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:27:44.334252 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:27:44.334252 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application with Lock( May 25 14:27:44.334252 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:27:44.334252 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self._enter() May 25 14:27:44.334252 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:27:44.334252 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:27:44.335100 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:27:44.335100 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.creator() May 25 14:27:44.335100 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:27:44.335100 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application created_value = creator( May 25 14:27:44.335100 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:27:44.335100 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:27:44.335100 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:27:44.335100 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:27:44.335100 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:27:44.335100 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:27:44.335100 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 14:27:44.335100 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application May 25 14:27:44.335100 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 225/444] 10.222.0.67 () {56 vars in 1096 bytes} [Wed May 25 14:27:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:27:44.335781 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffd32c8-5a48-4a63-93cd-9305f60e0c16 None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:27:44.354636 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f9d693-dbfc-4ca7-a499-220e58cbba1a None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:27:44.377403 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:27:44.396642 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9477308-8356-4ba5-ad8f-eca2baef69b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:27:44.397291 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9477308-8356-4ba5-ad8f-eca2baef69b1 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:44.397570 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9477308-8356-4ba5-ad8f-eca2baef69b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:44.397843 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9477308-8356-4ba5-ad8f-eca2baef69b1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:44.398678 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9477308-8356-4ba5-ad8f-eca2baef69b1 None admin] RBAC: Adding query filter params (group.id=c72c213d70fc435b823e76d99d8310a8, role.id=48808901834b4d5eab2c7e6b5b03791e, scope.project.id=24460f2e7a5e44f19737eed3c6799a16) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:27:44.398972 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9477308-8356-4ba5-ad8f-eca2baef69b1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:27:44.400429 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9477308-8356-4ba5-ad8f-eca2baef69b1 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:27:44.407279 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 220/445] 10.222.0.67 () {56 vars in 1376 bytes} [Wed May 25 14:27:44 2022] GET /identity/v3/role_assignments?group.id=c72c213d70fc435b823e76d99d8310a8&scope.project.id=24460f2e7a5e44f19737eed3c6799a16&role.id=48808901834b4d5eab2c7e6b5b03791e => generated 611 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:27:44.408101 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9477308-8356-4ba5-ad8f-eca2baef69b1 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:27:44.459291 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffd32c8-5a48-4a63-93cd-9305f60e0c16 None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:27:44.461989 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:27:44.498512 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d18329-940e-4610-8b86-7a5f4083e7f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:27:44.499254 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d18329-940e-4610-8b86-7a5f4083e7f7 None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:44.499669 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d18329-940e-4610-8b86-7a5f4083e7f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:44.499958 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d18329-940e-4610-8b86-7a5f4083e7f7 None admin] PATH_INFO: `/v3/roles` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:44.500732 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d18329-940e-4610-8b86-7a5f4083e7f7 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:27:44.501044 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d18329-940e-4610-8b86-7a5f4083e7f7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:27:44.502450 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d18329-940e-4610-8b86-7a5f4083e7f7 None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:27:44.511678 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 226/446] 10.222.0.67 () {56 vars in 1111 bytes} [Wed May 25 14:27:44 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:27:44.518110 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d18329-940e-4610-8b86-7a5f4083e7f7 None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:27:44.531619 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9477308-8356-4ba5-ad8f-eca2baef69b1 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:27:44.572160 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318a1de4-9f22-4927-9a35-bdfd0ed9747f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:27:44.572963 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318a1de4-9f22-4927-9a35-bdfd0ed9747f None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:44.573248 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318a1de4-9f22-4927-9a35-bdfd0ed9747f None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:44.573525 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318a1de4-9f22-4927-9a35-bdfd0ed9747f None admin] PATH_INFO: `/v3/roles` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:44.574285 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318a1de4-9f22-4927-9a35-bdfd0ed9747f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:27:44.574592 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318a1de4-9f22-4927-9a35-bdfd0ed9747f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:27:44.576177 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318a1de4-9f22-4927-9a35-bdfd0ed9747f None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:27:44.591452 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 221/447] 10.222.0.67 () {56 vars in 1099 bytes} [Wed May 25 14:27:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:27:44.592178 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318a1de4-9f22-4927-9a35-bdfd0ed9747f None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:27:44.630114 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d18329-940e-4610-8b86-7a5f4083e7f7 None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:27:44.652401 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:27:44.676219 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b13f9c-4afc-4bf6-9b43-5ab497311421 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:27:44.677114 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b13f9c-4afc-4bf6-9b43-5ab497311421 None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:44.677398 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b13f9c-4afc-4bf6-9b43-5ab497311421 None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:44.677682 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b13f9c-4afc-4bf6-9b43-5ab497311421 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:44.722376 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:27:44.724148 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318a1de4-9f22-4927-9a35-bdfd0ed9747f None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:27:44.768529 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b13f9c-4afc-4bf6-9b43-5ab497311421 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:27:44.769808 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0422002f-3b61-4b1f-9576-8e5c821f33e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:27:44.770009 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b13f9c-4afc-4bf6-9b43-5ab497311421 None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:27:44.770789 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0422002f-3b61-4b1f-9576-8e5c821f33e7 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:44.771250 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0422002f-3b61-4b1f-9576-8e5c821f33e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:44.771672 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0422002f-3b61-4b1f-9576-8e5c821f33e7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:44.850095 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0422002f-3b61-4b1f-9576-8e5c821f33e7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:27:44.851615 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0422002f-3b61-4b1f-9576-8e5c821f33e7 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:27:44.883127 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 227/448] 10.222.0.67 () {58 vars in 1282 bytes} [Wed May 25 14:27:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 14:27:44.888672 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b13f9c-4afc-4bf6-9b43-5ab497311421 None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:27:44.895793 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:27:44.951952 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 222/449] 10.222.0.67 () {58 vars in 1282 bytes} [Wed May 25 14:27:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 25 14:27:44.954040 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:27:44.957333 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0422002f-3b61-4b1f-9576-8e5c821f33e7 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:27:44.989860 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b13f9c-4afc-4bf6-9b43-5ab497311421 None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:27:45.022423 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a252b44-b250-435d-9084-4e73dea71006 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:27:45.023315 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a252b44-b250-435d-9084-4e73dea71006 None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:45.023603 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a252b44-b250-435d-9084-4e73dea71006 None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:45.023886 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a252b44-b250-435d-9084-4e73dea71006 None admin] PATH_INFO: `/v3/projects/24460f2e7a5e44f19737eed3c6799a16` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:45.025103 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a252b44-b250-435d-9084-4e73dea71006 None admin] RBAC: Authorizing `identity:get_project(project_id=24460f2e7a5e44f19737eed3c6799a16)` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:27:45.026571 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a252b44-b250-435d-9084-4e73dea71006 None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:27:45.028301 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 228/450] 10.222.0.67 () {56 vars in 1186 bytes} [Wed May 25 14:27:44 2022] GET /identity/v3/projects/24460f2e7a5e44f19737eed3c6799a16 => generated 302 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:27:45.034228 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a252b44-b250-435d-9084-4e73dea71006 None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:27:45.054170 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0422002f-3b61-4b1f-9576-8e5c821f33e7 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:27:45.087465 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519c082a-bbe7-48fa-b0c9-d0fb8309ed83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:27:45.088317 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519c082a-bbe7-48fa-b0c9-d0fb8309ed83 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:45.088596 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519c082a-bbe7-48fa-b0c9-d0fb8309ed83 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:45.088871 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519c082a-bbe7-48fa-b0c9-d0fb8309ed83 None admin] PATH_INFO: `/v3/projects/277acbf9eb0e4a9b87508241a478db4f` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:45.090037 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519c082a-bbe7-48fa-b0c9-d0fb8309ed83 None admin] RBAC: Authorizing `identity:get_project(project_id=277acbf9eb0e4a9b87508241a478db4f)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:27:45.091511 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519c082a-bbe7-48fa-b0c9-d0fb8309ed83 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:27:45.094030 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 223/451] 10.222.0.67 () {56 vars in 1186 bytes} [Wed May 25 14:27:44 2022] GET /identity/v3/projects/277acbf9eb0e4a9b87508241a478db4f => generated 344 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:27:45.099295 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519c082a-bbe7-48fa-b0c9-d0fb8309ed83 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:27:45.113764 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:27:45.134286 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a252b44-b250-435d-9084-4e73dea71006 None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:27:45.167805 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87e2b27-19e4-4ed7-8b0c-f2db2b07ec4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:27:45.168662 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87e2b27-19e4-4ed7-8b0c-f2db2b07ec4f None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:45.168942 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87e2b27-19e4-4ed7-8b0c-f2db2b07ec4f None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:45.169216 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87e2b27-19e4-4ed7-8b0c-f2db2b07ec4f None admin] PATH_INFO: `/v3/groups/c72c213d70fc435b823e76d99d8310a8` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:45.170391 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87e2b27-19e4-4ed7-8b0c-f2db2b07ec4f None admin] RBAC: Authorizing `identity:get_group(group_id=c72c213d70fc435b823e76d99d8310a8)` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:27:45.172121 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87e2b27-19e4-4ed7-8b0c-f2db2b07ec4f None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:27:45.173732 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 229/452] 10.222.0.67 () {56 vars in 1180 bytes} [Wed May 25 14:27:45 2022] GET /identity/v3/groups/c72c213d70fc435b823e76d99d8310a8 => generated 226 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:27:45.179348 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87e2b27-19e4-4ed7-8b0c-f2db2b07ec4f None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:27:45.181847 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:27:45.199236 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519c082a-bbe7-48fa-b0c9-d0fb8309ed83 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:27:45.232999 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e490d9-070b-4a7f-97bc-29f562c70e66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:27:45.233966 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e490d9-070b-4a7f-97bc-29f562c70e66 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:45.234255 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e490d9-070b-4a7f-97bc-29f562c70e66 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:45.234536 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e490d9-070b-4a7f-97bc-29f562c70e66 None admin] PATH_INFO: `/v3/groups/ff10c2a59f714a45b16862f1cf81d4e7` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:45.235743 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e490d9-070b-4a7f-97bc-29f562c70e66 None admin] RBAC: Authorizing `identity:get_group(group_id=ff10c2a59f714a45b16862f1cf81d4e7)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:27:45.237178 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e490d9-070b-4a7f-97bc-29f562c70e66 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:27:45.238780 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 224/453] 10.222.0.67 () {56 vars in 1180 bytes} [Wed May 25 14:27:45 2022] GET /identity/v3/groups/ff10c2a59f714a45b16862f1cf81d4e7 => generated 229 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:27:45.244404 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e490d9-070b-4a7f-97bc-29f562c70e66 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:27:45.281446 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87e2b27-19e4-4ed7-8b0c-f2db2b07ec4f None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:27:45.313887 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266437f9-b433-483e-8be7-211f2e9b5afd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:27:45.314533 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266437f9-b433-483e-8be7-211f2e9b5afd None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:45.314812 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266437f9-b433-483e-8be7-211f2e9b5afd None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:45.315115 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266437f9-b433-483e-8be7-211f2e9b5afd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:45.315942 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266437f9-b433-483e-8be7-211f2e9b5afd None admin] RBAC: Adding query filter params (group.id=c72c213d70fc435b823e76d99d8310a8, role.id=3e87d9311f1d411395a3fcd41ac81431, scope.project.id=24460f2e7a5e44f19737eed3c6799a16) {{(pid=80474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:27:45.316254 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266437f9-b433-483e-8be7-211f2e9b5afd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:27:45.317688 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266437f9-b433-483e-8be7-211f2e9b5afd None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:27:45.322462 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:27:45.323379 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 230/454] 10.222.0.67 () {56 vars in 1376 bytes} [Wed May 25 14:27:45 2022] GET /identity/v3/role_assignments?group.id=c72c213d70fc435b823e76d99d8310a8&scope.project.id=24460f2e7a5e44f19737eed3c6799a16&role.id=3e87d9311f1d411395a3fcd41ac81431 => generated 611 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:27:45.344659 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e490d9-070b-4a7f-97bc-29f562c70e66 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:27:45.382386 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf9c547-13f0-4f88-ba72-3db7b2d2d3d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:27:45.383087 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf9c547-13f0-4f88-ba72-3db7b2d2d3d8 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:45.383375 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf9c547-13f0-4f88-ba72-3db7b2d2d3d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:45.383654 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf9c547-13f0-4f88-ba72-3db7b2d2d3d8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:45.384569 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf9c547-13f0-4f88-ba72-3db7b2d2d3d8 None admin] RBAC: Adding query filter params (group.id=ff10c2a59f714a45b16862f1cf81d4e7, role.id=399893e19eac4ab5a8e596f7c07be13c, scope.project.id=277acbf9eb0e4a9b87508241a478db4f) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:27:45.384827 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf9c547-13f0-4f88-ba72-3db7b2d2d3d8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:27:45.386326 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf9c547-13f0-4f88-ba72-3db7b2d2d3d8 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:27:45.393698 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 225/455] 10.222.0.67 () {56 vars in 1376 bytes} [Wed May 25 14:27:45 2022] GET /identity/v3/role_assignments?group.id=ff10c2a59f714a45b16862f1cf81d4e7&scope.project.id=277acbf9eb0e4a9b87508241a478db4f&role.id=399893e19eac4ab5a8e596f7c07be13c => generated 611 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:27:48.318788 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86eb4987-03cc-41bb-834a-16bff78c5da3 None None] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:48.319328 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86eb4987-03cc-41bb-834a-16bff78c5da3 None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:48.319402 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86eb4987-03cc-41bb-834a-16bff78c5da3 None None] PATH_INFO: `/` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:48.320720 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 231/456] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 14:27:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:27:48.336616 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b60c534-f516-49ae-ac75-56d77717847d None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:48.337201 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b60c534-f516-49ae-ac75-56d77717847d None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:48.337279 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b60c534-f516-49ae-ac75-56d77717847d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:48.360979 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-2b60c534-f516-49ae-ac75-56d77717847d None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:27:48.362176 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-2b60c534-f516-49ae-ac75-56d77717847d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:27:48.409517 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69ce1e9-e03b-442d-acb2-63b506442af5 None None] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:48.409859 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69ce1e9-e03b-442d-acb2-63b506442af5 None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:48.410086 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69ce1e9-e03b-442d-acb2-63b506442af5 None None] PATH_INFO: `/` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:48.411753 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 232/457] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 14:27:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:27:48.417215 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e6d521-5850-4873-aa2b-4eaa70cdc4d8 None None] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:48.417498 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e6d521-5850-4873-aa2b-4eaa70cdc4d8 None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:48.417780 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e6d521-5850-4873-aa2b-4eaa70cdc4d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:48.464164 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.auth.core [None req-83e6d521-5850-4873-aa2b-4eaa70cdc4d8 None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:27:48.465381 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-83e6d521-5850-4873-aa2b-4eaa70cdc4d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:27:48.482074 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 226/458] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 14:27:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 14:27:48.511350 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b60c534-f516-49ae-ac75-56d77717847d None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:27:48.583475 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:27:48.603356 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 233/459] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 14:27:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 14:27:48.605932 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797146a4-6b9c-4dca-bba8-7d782677df19 None None] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:48.606225 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797146a4-6b9c-4dca-bba8-7d782677df19 None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:48.606505 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797146a4-6b9c-4dca-bba8-7d782677df19 None None] PATH_INFO: `/` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:48.608734 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 234/460] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 14:27:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:27:48.614086 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865cf49e-f4cd-40a2-8c9c-5d5945585281 None None] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:48.614382 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865cf49e-f4cd-40a2-8c9c-5d5945585281 None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:48.614663 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865cf49e-f4cd-40a2-8c9c-5d5945585281 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:48.636571 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.auth.core [None req-865cf49e-f4cd-40a2-8c9c-5d5945585281 None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:27:48.637759 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-865cf49e-f4cd-40a2-8c9c-5d5945585281 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:27:48.646205 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:27:48.677739 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b60c534-f516-49ae-ac75-56d77717847d None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:27:48.727092 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 235/461] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 14:27:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 14:27:48.727978 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865cf49e-f4cd-40a2-8c9c-5d5945585281 None None] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:27:48.729144 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d701c03-0a63-437e-a5f6-e0a737231b0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:27:48.729943 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d701c03-0a63-437e-a5f6-e0a737231b0a None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:48.730226 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d701c03-0a63-437e-a5f6-e0a737231b0a None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:48.730501 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d701c03-0a63-437e-a5f6-e0a737231b0a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:48.751719 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d701c03-0a63-437e-a5f6-e0a737231b0a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:27:48.752983 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d701c03-0a63-437e-a5f6-e0a737231b0a None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:27:48.780532 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application [None req-8d701c03-0a63-437e-a5f6-e0a737231b0a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:27:48.780532 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:27:48.780532 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:27:48.780532 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:27:48.780532 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:27:48.780532 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:27:48.780532 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:27:48.780532 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:27:48.780532 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:27:48.780532 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:27:48.780532 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:27:48.780532 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:27:48.780532 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 14:27:48.780532 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 14:27:48.780532 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 14:27:48.781483 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 14:27:48.781483 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:27:48.781483 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:27:48.781483 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:27:48.781483 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:27:48.781483 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:27:48.781483 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:27:48.781483 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:27:48.781483 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application with Lock( May 25 14:27:48.781483 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:27:48.781483 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._enter() May 25 14:27:48.781483 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:27:48.781483 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:27:48.781483 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:27:48.781483 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.creator() May 25 14:27:48.781483 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:27:48.781483 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application created_value = creator( May 25 14:27:48.782361 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 14:27:48.782361 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 14:27:48.782361 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:27:48.782361 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:27:48.785278 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 227/462] 10.222.0.67 () {56 vars in 1108 bytes} [Wed May 25 14:27:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 14:27:48.786392 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d701c03-0a63-437e-a5f6-e0a737231b0a None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:27:48.852652 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865cf49e-f4cd-40a2-8c9c-5d5945585281 None None] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:27:48.881075 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:27:48.893722 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737ea2cd-73f6-4267-8374-e0cb4c915e5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:27:48.894970 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737ea2cd-73f6-4267-8374-e0cb4c915e5d None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:48.895502 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737ea2cd-73f6-4267-8374-e0cb4c915e5d None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:48.895979 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737ea2cd-73f6-4267-8374-e0cb4c915e5d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:48.908988 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737ea2cd-73f6-4267-8374-e0cb4c915e5d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:27:48.911186 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737ea2cd-73f6-4267-8374-e0cb4c915e5d None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:27:48.929051 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d701c03-0a63-437e-a5f6-e0a737231b0a None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:27:48.932754 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application [None req-737ea2cd-73f6-4267-8374-e0cb4c915e5d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:27:48.932754 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:27:48.932754 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:27:48.932754 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:27:48.932754 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:27:48.932754 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:27:48.932754 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:27:48.932754 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:27:48.932754 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:27:48.932754 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:27:48.932754 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:27:48.932754 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:27:48.932754 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 14:27:48.932754 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 14:27:48.932754 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 14:27:48.933604 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 14:27:48.933604 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:27:48.933604 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:27:48.933604 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:27:48.933604 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:27:48.933604 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:27:48.933604 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:27:48.933604 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:27:48.933604 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application with Lock( May 25 14:27:48.933604 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:27:48.933604 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self._enter() May 25 14:27:48.933604 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:27:48.933604 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:27:48.933604 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:27:48.933604 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.creator() May 25 14:27:48.933604 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:27:48.933604 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application created_value = creator( May 25 14:27:48.934468 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 14:27:48.934468 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 14:27:48.934468 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:27:48.934468 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application May 25 14:27:48.941519 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 236/463] 10.222.0.67 () {56 vars in 1108 bytes} [Wed May 25 14:27:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:27:48.942755 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737ea2cd-73f6-4267-8374-e0cb4c915e5d None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:27:48.963414 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:27:48.975526 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b52a5a4-286e-4292-b79a-446cc02aca94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:27:48.976604 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b52a5a4-286e-4292-b79a-446cc02aca94 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:48.976893 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b52a5a4-286e-4292-b79a-446cc02aca94 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:48.977194 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b52a5a4-286e-4292-b79a-446cc02aca94 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:48.992800 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b52a5a4-286e-4292-b79a-446cc02aca94 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:27:48.994702 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b52a5a4-286e-4292-b79a-446cc02aca94 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:27:49.018942 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application [None req-7b52a5a4-286e-4292-b79a-446cc02aca94 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:27:49.018942 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:27:49.018942 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:27:49.018942 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:27:49.018942 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:27:49.018942 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:27:49.018942 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:27:49.018942 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:27:49.018942 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:27:49.018942 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:27:49.018942 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:27:49.018942 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:27:49.018942 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 14:27:49.018942 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 14:27:49.018942 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 14:27:49.019869 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 14:27:49.019869 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:27:49.019869 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:27:49.019869 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:27:49.019869 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:27:49.019869 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:27:49.019869 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:27:49.019869 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:27:49.019869 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application with Lock( May 25 14:27:49.019869 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:27:49.019869 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._enter() May 25 14:27:49.019869 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:27:49.019869 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:27:49.019869 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:27:49.019869 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.creator() May 25 14:27:49.019869 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:27:49.019869 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application created_value = creator( May 25 14:27:49.020720 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 14:27:49.020720 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 14:27:49.020720 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:27:49.020720 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:27:49.020720 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 228/464] 10.222.0.67 () {56 vars in 1108 bytes} [Wed May 25 14:27:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:27:49.023849 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b52a5a4-286e-4292-b79a-446cc02aca94 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:27:49.073036 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737ea2cd-73f6-4267-8374-e0cb4c915e5d None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:27:49.112476 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441c732e-82d6-4a30-b040-0d53a463ea20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:27:49.113065 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441c732e-82d6-4a30-b040-0d53a463ea20 None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:49.113356 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441c732e-82d6-4a30-b040-0d53a463ea20 None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:49.113635 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441c732e-82d6-4a30-b040-0d53a463ea20 None admin] PATH_INFO: `/v3/domains` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:49.114370 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441c732e-82d6-4a30-b040-0d53a463ea20 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:27:49.114683 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441c732e-82d6-4a30-b040-0d53a463ea20 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:27:49.116109 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441c732e-82d6-4a30-b040-0d53a463ea20 None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:27:49.129101 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 237/465] 10.222.0.67 () {56 vars in 1109 bytes} [Wed May 25 14:27:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:27:49.129911 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441c732e-82d6-4a30-b040-0d53a463ea20 None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:27:49.139060 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b52a5a4-286e-4292-b79a-446cc02aca94 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:27:49.170577 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:27:49.176627 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c9943e-1bf6-4276-a334-193b874b4526 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:27:49.177469 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c9943e-1bf6-4276-a334-193b874b4526 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:49.177902 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c9943e-1bf6-4276-a334-193b874b4526 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:49.178351 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c9943e-1bf6-4276-a334-193b874b4526 None admin] PATH_INFO: `/v3/domains` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:49.179258 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c9943e-1bf6-4276-a334-193b874b4526 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:27:49.179787 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c9943e-1bf6-4276-a334-193b874b4526 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:27:49.181327 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c9943e-1bf6-4276-a334-193b874b4526 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:27:49.200218 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 229/466] 10.222.0.67 () {56 vars in 1109 bytes} [Wed May 25 14:27:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:27:49.201792 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bc344e-2bbe-4a57-9fb1-ccad7cc2c554 None None] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:49.202219 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bc344e-2bbe-4a57-9fb1-ccad7cc2c554 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:49.202659 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bc344e-2bbe-4a57-9fb1-ccad7cc2c554 None None] PATH_INFO: `/` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:49.204077 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 230/467] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 14:27:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:27:49.205097 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bc344e-2bbe-4a57-9fb1-ccad7cc2c554 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:27:49.246283 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441c732e-82d6-4a30-b040-0d53a463ea20 None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:27:49.250404 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:27:49.283889 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a86ee46-d7c8-4913-a9bf-ecb2539773b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:27:49.284591 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a86ee46-d7c8-4913-a9bf-ecb2539773b3 None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:49.284882 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a86ee46-d7c8-4913-a9bf-ecb2539773b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:49.285161 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a86ee46-d7c8-4913-a9bf-ecb2539773b3 None admin] PATH_INFO: `/v3/domains` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:49.285894 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a86ee46-d7c8-4913-a9bf-ecb2539773b3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:27:49.286206 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a86ee46-d7c8-4913-a9bf-ecb2539773b3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:27:49.287631 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a86ee46-d7c8-4913-a9bf-ecb2539773b3 None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:27:49.300141 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 238/468] 10.222.0.67 () {56 vars in 1109 bytes} [Wed May 25 14:27:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:27:49.305501 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a86ee46-d7c8-4913-a9bf-ecb2539773b3 None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:27:49.316455 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bc344e-2bbe-4a57-9fb1-ccad7cc2c554 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:27:49.352438 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9e532a-3a08-4611-9eb0-711b7c9a1cd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:27:49.353213 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9e532a-3a08-4611-9eb0-711b7c9a1cd8 None admin] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:49.353566 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9e532a-3a08-4611-9eb0-711b7c9a1cd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:49.353852 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9e532a-3a08-4611-9eb0-711b7c9a1cd8 None admin] PATH_INFO: `/v3/users` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:49.354562 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9e532a-3a08-4611-9eb0-711b7c9a1cd8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:27:49.356050 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9e532a-3a08-4611-9eb0-711b7c9a1cd8 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:27:49.378044 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 231/469] 10.222.0.67 () {60 vars in 1132 bytes} [Wed May 25 14:27:49 2022] POST /identity/v3/users => generated 246 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:27:49.379444 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3304a3fb-8e71-4d76-9a75-41f2e0cad0e0 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:49.379814 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3304a3fb-8e71-4d76-9a75-41f2e0cad0e0 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:49.380165 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3304a3fb-8e71-4d76-9a75-41f2e0cad0e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:49.398247 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-3304a3fb-8e71-4d76-9a75-41f2e0cad0e0 None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:27:49.399667 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-3304a3fb-8e71-4d76-9a75-41f2e0cad0e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:27:49.436255 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:27:49.443042 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a86ee46-d7c8-4913-a9bf-ecb2539773b3 None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:27:49.484067 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4ee2de-9497-4ab4-b6ec-cfd8be6fb58f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:27:49.491018 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4ee2de-9497-4ab4-b6ec-cfd8be6fb58f None admin] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:49.491018 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4ee2de-9497-4ab4-b6ec-cfd8be6fb58f None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:49.491018 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4ee2de-9497-4ab4-b6ec-cfd8be6fb58f None admin] PATH_INFO: `/v3/users` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:49.491018 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4ee2de-9497-4ab4-b6ec-cfd8be6fb58f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:27:49.491018 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4ee2de-9497-4ab4-b6ec-cfd8be6fb58f None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:27:49.492496 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 232/470] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 14:27:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 14:27:49.493466 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3304a3fb-8e71-4d76-9a75-41f2e0cad0e0 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:27:49.528073 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 239/471] 10.222.0.67 () {60 vars in 1132 bytes} [Wed May 25 14:27:49 2022] POST /identity/v3/users => generated 248 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:27:49.531081 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4ee2de-9497-4ab4-b6ec-cfd8be6fb58f None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:27:49.542032 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:27:49.646549 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3304a3fb-8e71-4d76-9a75-41f2e0cad0e0 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:27:49.685615 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4ee2de-9497-4ab4-b6ec-cfd8be6fb58f None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:27:49.700995 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f488fbe-c0b9-482a-9ec3-588769de5d1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:27:49.703046 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f488fbe-c0b9-482a-9ec3-588769de5d1d None admin] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:49.703559 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f488fbe-c0b9-482a-9ec3-588769de5d1d None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:49.704562 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f488fbe-c0b9-482a-9ec3-588769de5d1d None admin] PATH_INFO: `/v3/users` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:49.705769 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f488fbe-c0b9-482a-9ec3-588769de5d1d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:27:49.708221 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f488fbe-c0b9-482a-9ec3-588769de5d1d None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:27:49.739433 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71786ad1-5541-42e3-a025-518684f16340 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:27:49.739739 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71786ad1-5541-42e3-a025-518684f16340 None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:49.740022 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71786ad1-5541-42e3-a025-518684f16340 None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:49.740301 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71786ad1-5541-42e3-a025-518684f16340 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:49.746403 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 233/472] 10.222.0.67 () {60 vars in 1132 bytes} [Wed May 25 14:27:49 2022] POST /identity/v3/users => generated 248 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:27:49.748203 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec88f94e-8ff8-4670-ac1a-6d3a7fbd0b1a None None] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:49.748744 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec88f94e-8ff8-4670-ac1a-6d3a7fbd0b1a None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:49.751280 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec88f94e-8ff8-4670-ac1a-6d3a7fbd0b1a None None] PATH_INFO: `/` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:49.753398 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 234/473] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 14:27:49 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:27:49.758045 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71786ad1-5541-42e3-a025-518684f16340 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:27:49.758045 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71786ad1-5541-42e3-a025-518684f16340 None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:27:49.759953 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2588002-c26b-4f28-bd59-075059712b92 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:49.760440 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2588002-c26b-4f28-bd59-075059712b92 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:49.760898 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2588002-c26b-4f28-bd59-075059712b92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:49.778354 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application [None req-71786ad1-5541-42e3-a025-518684f16340 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:27:49.778354 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:27:49.778354 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:27:49.778354 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:27:49.778354 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:27:49.778354 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:27:49.778354 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:27:49.778354 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:27:49.778354 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:27:49.778354 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:27:49.778354 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:27:49.778354 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:27:49.778354 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 14:27:49.778354 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 14:27:49.778354 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 14:27:49.779400 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 14:27:49.779400 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:27:49.779400 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:27:49.779400 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:27:49.779400 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:27:49.779400 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:27:49.779400 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:27:49.779400 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:27:49.779400 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application with Lock( May 25 14:27:49.779400 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:27:49.779400 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self._enter() May 25 14:27:49.779400 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:27:49.779400 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:27:49.779400 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:27:49.779400 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.creator() May 25 14:27:49.779400 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:27:49.779400 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application created_value = creator( May 25 14:27:49.780375 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 14:27:49.780375 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 14:27:49.780375 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:27:49.780375 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application May 25 14:27:49.781036 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 240/474] 10.222.0.67 () {56 vars in 1108 bytes} [Wed May 25 14:27:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:27:49.782154 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-c2588002-c26b-4f28-bd59-075059712b92 None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:27:49.783439 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-c2588002-c26b-4f28-bd59-075059712b92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:27:49.787435 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71786ad1-5541-42e3-a025-518684f16340 None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:27:49.799072 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:27:49.887026 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 235/475] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 14:27:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 14:27:49.913065 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2588002-c26b-4f28-bd59-075059712b92 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:27:49.929219 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71786ad1-5541-42e3-a025-518684f16340 None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:27:49.931206 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:27:49.984437 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2566d085-a085-4331-9ff9-5893cb7b3068 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:27:49.985296 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2566d085-a085-4331-9ff9-5893cb7b3068 None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:49.985592 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2566d085-a085-4331-9ff9-5893cb7b3068 None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:49.985864 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2566d085-a085-4331-9ff9-5893cb7b3068 None admin] PATH_INFO: `/v3/domains` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:49.986671 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2566d085-a085-4331-9ff9-5893cb7b3068 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:27:49.987095 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2566d085-a085-4331-9ff9-5893cb7b3068 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:27:49.988426 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2566d085-a085-4331-9ff9-5893cb7b3068 None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:27:50.004477 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 241/476] 10.222.0.67 () {56 vars in 1109 bytes} [Wed May 25 14:27:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:27:50.009842 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2566d085-a085-4331-9ff9-5893cb7b3068 None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:27:50.052942 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2588002-c26b-4f28-bd59-075059712b92 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:27:50.096242 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d755c05-6cb1-49da-81b2-668994a3838c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:27:50.097266 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d755c05-6cb1-49da-81b2-668994a3838c None admin] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:50.097756 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d755c05-6cb1-49da-81b2-668994a3838c None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:50.098222 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d755c05-6cb1-49da-81b2-668994a3838c None admin] PATH_INFO: `/v3/roles` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:50.099189 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d755c05-6cb1-49da-81b2-668994a3838c None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:27:50.100160 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:27:50.101564 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d755c05-6cb1-49da-81b2-668994a3838c None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:27:50.110004 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.sql.core [None req-6d755c05-6cb1-49da-81b2-668994a3838c None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 25 14:27:50.110004 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] May 25 14:27:50.110004 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [parameters: {'id': 'ab5c3efa5d574a79b480f874c23b877b', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] May 25 14:27:50.110004 dv-cinder-787296-9-smb devstack@keystone.service[80475]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80475) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 25 14:27:50.129179 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application [None req-6d755c05-6cb1-49da-81b2-668994a3838c None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. May 25 14:27:50.129179 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:27:50.129179 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 25 14:27:50.129179 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application self.dialect.do_execute( May 25 14:27:50.129179 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 25 14:27:50.129179 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 25 14:27:50.129179 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 25 14:27:50.129179 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application result = self._query(query) May 25 14:27:50.129179 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 25 14:27:50.129179 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application conn.query(q) May 25 14:27:50.129179 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 25 14:27:50.129179 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 25 14:27:50.129179 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 25 14:27:50.129179 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application result.read() May 25 14:27:50.129179 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 25 14:27:50.130152 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 25 14:27:50.130152 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 25 14:27:50.130152 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application packet.raise_for_error() May 25 14:27:50.130152 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 25 14:27:50.130152 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 25 14:27:50.130152 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 25 14:27:50.130152 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 25 14:27:50.130152 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 25 14:27:50.130152 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:27:50.130152 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 25 14:27:50.130152 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:27:50.130152 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:27:50.130152 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 25 14:27:50.130152 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 25 14:27:50.130152 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role May 25 14:27:50.130152 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return ref.to_dict() May 25 14:27:50.130152 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 25 14:27:50.130152 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application next(self.gen) May 25 14:27:50.131108 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 25 14:27:50.131108 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application yield resource May 25 14:27:50.131108 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 25 14:27:50.131108 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application next(self.gen) May 25 14:27:50.131108 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 25 14:27:50.131108 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application self.session.rollback() May 25 14:27:50.131108 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 25 14:27:50.131108 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application self.force_reraise() May 25 14:27:50.131108 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 25 14:27:50.131108 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application raise self.value May 25 14:27:50.131108 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 25 14:27:50.131108 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 25 14:27:50.131108 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 25 14:27:50.131108 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application session.commit() May 25 14:27:50.131108 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 25 14:27:50.131108 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 25 14:27:50.131108 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 25 14:27:50.131973 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application self._prepare_impl() May 25 14:27:50.131973 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 25 14:27:50.131973 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application self.session.flush() May 25 14:27:50.131973 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 25 14:27:50.131973 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application self._flush(objects) May 25 14:27:50.131973 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 25 14:27:50.131973 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 25 14:27:50.131973 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 25 14:27:50.131973 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application compat.raise_( May 25 14:27:50.131973 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 25 14:27:50.131973 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application raise exception May 25 14:27:50.131973 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 25 14:27:50.131973 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application flush_context.execute() May 25 14:27:50.131973 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 25 14:27:50.131973 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application rec.execute(self) May 25 14:27:50.131973 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 25 14:27:50.131973 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 25 14:27:50.132892 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 25 14:27:50.132892 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application _emit_insert_statements( May 25 14:27:50.132892 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 25 14:27:50.132892 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application c = connection._execute_20( May 25 14:27:50.132892 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 25 14:27:50.132892 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 25 14:27:50.132892 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 25 14:27:50.132892 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 25 14:27:50.132892 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 25 14:27:50.132892 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application ret = self._execute_context( May 25 14:27:50.132892 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 25 14:27:50.132892 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 25 14:27:50.132892 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 25 14:27:50.132892 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 25 14:27:50.132892 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 25 14:27:50.132892 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application raise exception May 25 14:27:50.133721 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 25 14:27:50.133721 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application self.dialect.do_execute( May 25 14:27:50.133721 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 25 14:27:50.133721 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 25 14:27:50.133721 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 25 14:27:50.133721 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application result = self._query(query) May 25 14:27:50.133721 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 25 14:27:50.133721 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application conn.query(q) May 25 14:27:50.133721 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 25 14:27:50.133721 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 25 14:27:50.133721 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 25 14:27:50.133721 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application result.read() May 25 14:27:50.133721 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 25 14:27:50.133721 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 25 14:27:50.133721 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 25 14:27:50.133721 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application packet.raise_for_error() May 25 14:27:50.134517 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 25 14:27:50.134517 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 25 14:27:50.134517 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 25 14:27:50.134517 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 25 14:27:50.134517 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 25 14:27:50.134517 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] May 25 14:27:50.134517 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application [parameters: {'id': 'ab5c3efa5d574a79b480f874c23b877b', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] May 25 14:27:50.134517 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 25 14:27:50.134517 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:27:50.134517 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 14:27:50.134517 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:27:50.134517 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:27:50.134517 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:27:50.134517 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:27:50.134517 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:27:50.134517 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:27:50.136976 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:27:50.136976 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:27:50.136976 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:27:50.136976 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:27:50.136976 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:27:50.136976 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:27:50.136976 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post May 25 14:27:50.136976 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( May 25 14:27:50.136976 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:27:50.136976 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:27:50.136976 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role May 25 14:27:50.136976 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) May 25 14:27:50.136976 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 25 14:27:50.136976 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 25 14:27:50.136976 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. May 25 14:27:50.136976 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:27:50.140649 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 236/477] 10.222.0.67 () {60 vars in 1131 bytes} [Wed May 25 14:27:49 2022] POST /identity/v3/roles => generated 144 bytes in 228 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) May 25 14:27:50.148143 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d755c05-6cb1-49da-81b2-668994a3838c None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:27:50.149199 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2566d085-a085-4331-9ff9-5893cb7b3068 None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:27:50.199344 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f606fbef-97b1-4229-a2cb-ea4229c09994 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:27:50.200362 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f606fbef-97b1-4229-a2cb-ea4229c09994 None admin] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:50.200753 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f606fbef-97b1-4229-a2cb-ea4229c09994 None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:50.201139 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f606fbef-97b1-4229-a2cb-ea4229c09994 None admin] PATH_INFO: `/v3/users` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:50.203640 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f606fbef-97b1-4229-a2cb-ea4229c09994 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:27:50.205272 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f606fbef-97b1-4229-a2cb-ea4229c09994 None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:27:50.235077 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 242/478] 10.222.0.67 () {60 vars in 1132 bytes} [Wed May 25 14:27:50 2022] POST /identity/v3/users => generated 249 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 14:27:50.255769 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:27:50.288331 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d755c05-6cb1-49da-81b2-668994a3838c None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:27:50.327912 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afecb087-8321-47df-8260-fe21d8c06e31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:27:50.329094 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afecb087-8321-47df-8260-fe21d8c06e31 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:50.329535 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afecb087-8321-47df-8260-fe21d8c06e31 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:50.329967 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afecb087-8321-47df-8260-fe21d8c06e31 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:50.343167 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afecb087-8321-47df-8260-fe21d8c06e31 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:27:50.352021 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application [None req-afecb087-8321-47df-8260-fe21d8c06e31 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 14:27:50.352021 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:27:50.352021 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:27:50.352021 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:27:50.352021 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:27:50.352021 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:27:50.352021 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:27:50.352021 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:27:50.352021 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:27:50.352021 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:27:50.352021 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:27:50.352021 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:27:50.352021 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:27:50.352021 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:27:50.352021 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:27:50.352021 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:27:50.353731 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:27:50.353731 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:27:50.353731 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:27:50.353731 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:27:50.353731 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:27:50.353731 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:27:50.353731 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:27:50.353731 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:27:50.353731 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:27:50.353731 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:27:50.353731 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:27:50.353731 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application with Lock( May 25 14:27:50.353731 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:27:50.353731 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._enter() May 25 14:27:50.353731 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:27:50.353731 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:27:50.354799 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:27:50.354799 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.creator() May 25 14:27:50.354799 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:27:50.354799 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application created_value = creator( May 25 14:27:50.354799 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:27:50.354799 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:27:50.354799 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:27:50.354799 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:27:50.354799 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:27:50.354799 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:27:50.354799 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 14:27:50.354799 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:27:50.357397 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 237/479] 10.222.0.67 () {56 vars in 1114 bytes} [Wed May 25 14:27:50 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:27:50.363052 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f606fbef-97b1-4229-a2cb-ea4229c09994 None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:27:50.487617 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f606fbef-97b1-4229-a2cb-ea4229c09994 None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:27:50.514052 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:27:50.534789 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e170c8-ef03-4e51-83ed-687f59f51f0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:27:50.535858 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e170c8-ef03-4e51-83ed-687f59f51f0e None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:50.536352 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e170c8-ef03-4e51-83ed-687f59f51f0e None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:50.536837 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e170c8-ef03-4e51-83ed-687f59f51f0e None admin] PATH_INFO: `/v3/roles` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:50.537812 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e170c8-ef03-4e51-83ed-687f59f51f0e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:27:50.538320 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e170c8-ef03-4e51-83ed-687f59f51f0e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:27:50.539973 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e170c8-ef03-4e51-83ed-687f59f51f0e None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:27:50.552408 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 243/480] 10.222.0.67 () {56 vars in 1111 bytes} [Wed May 25 14:27:50 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:27:52.113527 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7464f40a-d353-4fc8-b99e-dc9905eb8b5d None None] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:52.113527 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7464f40a-d353-4fc8-b99e-dc9905eb8b5d None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:52.113527 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7464f40a-d353-4fc8-b99e-dc9905eb8b5d None None] PATH_INFO: `/` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:52.116629 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 238/481] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 14:27:52 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:27:52.134753 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8df05a-9928-4b84-9e9f-2b32fa88c2f4 None None] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:52.135425 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8df05a-9928-4b84-9e9f-2b32fa88c2f4 None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:52.135425 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8df05a-9928-4b84-9e9f-2b32fa88c2f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:52.156792 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.auth.core [None req-4a8df05a-9928-4b84-9e9f-2b32fa88c2f4 None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:27:52.158002 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-4a8df05a-9928-4b84-9e9f-2b32fa88c2f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:27:52.243491 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 244/482] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 14:27:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 14:27:52.279022 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7464f40a-d353-4fc8-b99e-dc9905eb8b5d None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:27:52.416411 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7464f40a-d353-4fc8-b99e-dc9905eb8b5d None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:27:52.469327 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214198fd-751c-47f0-85a9-25029e354942 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:27:52.470144 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214198fd-751c-47f0-85a9-25029e354942 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:52.470432 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214198fd-751c-47f0-85a9-25029e354942 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:52.470714 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214198fd-751c-47f0-85a9-25029e354942 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:52.472862 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:27:52.484917 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214198fd-751c-47f0-85a9-25029e354942 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:27:52.489990 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baad031-5021-4ec5-bf22-b940a87df9f8 None None] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:52.490283 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baad031-5021-4ec5-bf22-b940a87df9f8 None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:52.490833 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baad031-5021-4ec5-bf22-b940a87df9f8 None None] PATH_INFO: `/` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:52.492180 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 245/483] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 14:27:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:27:52.496277 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application [None req-214198fd-751c-47f0-85a9-25029e354942 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 25 14:27:52.496277 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:27:52.496277 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:27:52.496277 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:27:52.496277 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:27:52.496277 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:27:52.496277 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:27:52.496277 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:27:52.496277 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:27:52.496277 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:27:52.496277 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:27:52.496277 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:27:52.496277 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:27:52.496277 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:27:52.496277 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:27:52.496277 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:27:52.499211 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:27:52.499211 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:27:52.499211 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:27:52.499211 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:27:52.499211 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:27:52.499211 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:27:52.499211 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:27:52.499211 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:27:52.499211 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:27:52.499211 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:27:52.499211 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:27:52.499211 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application with Lock( May 25 14:27:52.499211 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:27:52.499211 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._enter() May 25 14:27:52.499211 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:27:52.499211 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:27:52.500757 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:27:52.500757 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.creator() May 25 14:27:52.500757 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:27:52.500757 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application created_value = creator( May 25 14:27:52.500757 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:27:52.500757 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:27:52.500757 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:27:52.500757 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:27:52.500757 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:27:52.500757 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:27:52.500757 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 25 14:27:52.500757 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:27:52.501535 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c14ef57-3d86-497f-a6ab-6379c7eda09d None None] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:52.501535 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c14ef57-3d86-497f-a6ab-6379c7eda09d None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:52.501535 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c14ef57-3d86-497f-a6ab-6379c7eda09d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:52.501761 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 239/484] 10.222.0.67 () {56 vars in 1102 bytes} [Wed May 25 14:27:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:27:52.507892 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214198fd-751c-47f0-85a9-25029e354942 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:27:52.525489 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.auth.core [None req-0c14ef57-3d86-497f-a6ab-6379c7eda09d None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:27:52.526664 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-0c14ef57-3d86-497f-a6ab-6379c7eda09d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:27:52.674303 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214198fd-751c-47f0-85a9-25029e354942 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:27:52.687121 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 246/485] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 14:27:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 14:27:52.730269 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c93a44-062c-415d-acd3-1534e6c28076 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:27:52.730946 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c93a44-062c-415d-acd3-1534e6c28076 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:52.731248 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c93a44-062c-415d-acd3-1534e6c28076 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:52.731523 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c93a44-062c-415d-acd3-1534e6c28076 None admin] PATH_INFO: `/v3/roles` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:52.732273 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c93a44-062c-415d-acd3-1534e6c28076 None admin] RBAC: Adding query filter params (name=service) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:27:52.732580 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c93a44-062c-415d-acd3-1534e6c28076 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:27:52.734516 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c93a44-062c-415d-acd3-1534e6c28076 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:27:52.742524 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c14ef57-3d86-497f-a6ab-6379c7eda09d None None] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:27:52.752204 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 240/486] 10.222.0.67 () {56 vars in 1103 bytes} [Wed May 25 14:27:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:27:52.757640 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c93a44-062c-415d-acd3-1534e6c28076 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:27:52.811693 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:27:52.828489 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:27:52.882265 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c14ef57-3d86-497f-a6ab-6379c7eda09d None None] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:27:52.887756 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c93a44-062c-415d-acd3-1534e6c28076 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:27:52.921967 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec66cb1-3f22-4222-b79b-18924eaa4c4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:27:52.923155 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec66cb1-3f22-4222-b79b-18924eaa4c4f None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:52.923616 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec66cb1-3f22-4222-b79b-18924eaa4c4f None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:52.923822 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e8ac00-8bf3-4576-9caa-0ea765889a6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:27:52.924242 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec66cb1-3f22-4222-b79b-18924eaa4c4f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:52.924822 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e8ac00-8bf3-4576-9caa-0ea765889a6a None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:52.925122 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e8ac00-8bf3-4576-9caa-0ea765889a6a None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:52.925456 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e8ac00-8bf3-4576-9caa-0ea765889a6a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:52.936877 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e8ac00-8bf3-4576-9caa-0ea765889a6a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:27:52.937305 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec66cb1-3f22-4222-b79b-18924eaa4c4f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:27:52.938523 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e8ac00-8bf3-4576-9caa-0ea765889a6a None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:27:52.946516 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application [None req-fec66cb1-3f22-4222-b79b-18924eaa4c4f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 25 14:27:52.946516 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:27:52.946516 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:27:52.946516 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:27:52.946516 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:27:52.946516 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:27:52.946516 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:27:52.946516 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:27:52.946516 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:27:52.946516 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:27:52.946516 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:27:52.946516 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:27:52.946516 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:27:52.946516 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:27:52.946516 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:27:52.946516 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:27:52.947729 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:27:52.947729 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:27:52.947729 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:27:52.947729 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:27:52.947729 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:27:52.947729 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:27:52.947729 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:27:52.947729 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:27:52.947729 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:27:52.947729 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:27:52.947729 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:27:52.947729 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application with Lock( May 25 14:27:52.947729 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:27:52.947729 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self._enter() May 25 14:27:52.947729 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:27:52.947729 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:27:52.948747 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:27:52.948747 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.creator() May 25 14:27:52.948747 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:27:52.948747 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application created_value = creator( May 25 14:27:52.948747 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:27:52.948747 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:27:52.948747 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:27:52.948747 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:27:52.948747 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:27:52.948747 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:27:52.948747 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 25 14:27:52.948747 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application May 25 14:27:52.951134 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 247/487] 10.222.0.67 () {56 vars in 1102 bytes} [Wed May 25 14:27:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:27:52.953222 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a174b78-52c5-492a-bbe1-e6a45f0413f9 None None] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:52.953736 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a174b78-52c5-492a-bbe1-e6a45f0413f9 None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:52.954226 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a174b78-52c5-492a-bbe1-e6a45f0413f9 None None] PATH_INFO: `/` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:52.959988 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 248/488] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 14:27:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:27:52.960128 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application [None req-84e8ac00-8bf3-4576-9caa-0ea765889a6a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:27:52.960128 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:27:52.960128 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:27:52.960128 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:27:52.960128 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:27:52.960128 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:27:52.960128 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:27:52.960128 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:27:52.960128 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:27:52.960128 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:27:52.960128 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:27:52.960128 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:27:52.960128 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 14:27:52.960128 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 14:27:52.960128 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 14:27:52.960937 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 14:27:52.960937 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:27:52.960937 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:27:52.960937 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:27:52.960937 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:27:52.960937 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:27:52.960937 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:27:52.960937 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:27:52.960937 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application with Lock( May 25 14:27:52.960937 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:27:52.960937 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._enter() May 25 14:27:52.960937 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:27:52.960937 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:27:52.960937 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:27:52.960937 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.creator() May 25 14:27:52.960937 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:27:52.960937 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application created_value = creator( May 25 14:27:52.961827 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 14:27:52.961827 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 14:27:52.961827 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:27:52.961827 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:27:52.961827 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 241/489] 10.222.0.67 () {56 vars in 1108 bytes} [Wed May 25 14:27:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 14:27:52.961827 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e8ac00-8bf3-4576-9caa-0ea765889a6a None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:27:52.964280 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e293444-85dc-4619-bb74-5d8ded11e84c None None] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:52.964815 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e293444-85dc-4619-bb74-5d8ded11e84c None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:52.965297 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e293444-85dc-4619-bb74-5d8ded11e84c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:52.984497 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.auth.core [None req-7e293444-85dc-4619-bb74-5d8ded11e84c None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:27:52.986098 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-7e293444-85dc-4619-bb74-5d8ded11e84c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:27:53.071041 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e8ac00-8bf3-4576-9caa-0ea765889a6a None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:27:53.071467 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 249/490] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 14:27:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 14:27:53.072752 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e293444-85dc-4619-bb74-5d8ded11e84c None None] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:27:53.077605 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:27:53.104516 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70159f06-2568-4b8c-8331-fbfe203111e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:27:53.105199 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70159f06-2568-4b8c-8331-fbfe203111e9 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:53.105485 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70159f06-2568-4b8c-8331-fbfe203111e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:53.105997 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70159f06-2568-4b8c-8331-fbfe203111e9 None admin] PATH_INFO: `/v3/roles` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:53.106510 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70159f06-2568-4b8c-8331-fbfe203111e9 None admin] RBAC: Adding query filter params (name=service) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:27:53.106821 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70159f06-2568-4b8c-8331-fbfe203111e9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:27:53.115026 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70159f06-2568-4b8c-8331-fbfe203111e9 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:27:53.117558 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 242/491] 10.222.0.67 () {56 vars in 1103 bytes} [Wed May 25 14:27:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:27:53.123209 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70159f06-2568-4b8c-8331-fbfe203111e9 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:27:53.132029 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:27:53.212831 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e293444-85dc-4619-bb74-5d8ded11e84c None None] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:27:53.234604 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70159f06-2568-4b8c-8331-fbfe203111e9 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:27:53.254780 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab66fd6f-d456-48e4-a897-a36a027493dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:27:53.255902 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab66fd6f-d456-48e4-a897-a36a027493dd None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:53.256481 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab66fd6f-d456-48e4-a897-a36a027493dd None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:53.256969 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab66fd6f-d456-48e4-a897-a36a027493dd None admin] PATH_INFO: `/v3/domains` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:53.257962 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab66fd6f-d456-48e4-a897-a36a027493dd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:27:53.258488 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab66fd6f-d456-48e4-a897-a36a027493dd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:27:53.260523 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab66fd6f-d456-48e4-a897-a36a027493dd None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:27:53.272257 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3630e56e-8d15-43a5-a19c-6315ea36cd7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:27:53.273078 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3630e56e-8d15-43a5-a19c-6315ea36cd7f None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:53.273367 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3630e56e-8d15-43a5-a19c-6315ea36cd7f None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:53.273648 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3630e56e-8d15-43a5-a19c-6315ea36cd7f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:53.276034 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 250/492] 10.222.0.67 () {56 vars in 1109 bytes} [Wed May 25 14:27:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:27:53.277328 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab66fd6f-d456-48e4-a897-a36a027493dd None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:27:53.286863 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3630e56e-8d15-43a5-a19c-6315ea36cd7f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:27:53.288432 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3630e56e-8d15-43a5-a19c-6315ea36cd7f None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:27:53.307376 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application [None req-3630e56e-8d15-43a5-a19c-6315ea36cd7f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:27:53.307376 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:27:53.307376 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:27:53.307376 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:27:53.307376 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:27:53.307376 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:27:53.307376 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:27:53.307376 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:27:53.307376 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:27:53.307376 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:27:53.307376 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:27:53.307376 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:27:53.307376 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 14:27:53.307376 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 14:27:53.307376 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 14:27:53.308315 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 14:27:53.308315 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:27:53.308315 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:27:53.308315 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:27:53.308315 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:27:53.308315 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:27:53.308315 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:27:53.308315 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:27:53.308315 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application with Lock( May 25 14:27:53.308315 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:27:53.308315 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._enter() May 25 14:27:53.308315 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:27:53.308315 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:27:53.308315 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:27:53.308315 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.creator() May 25 14:27:53.308315 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:27:53.308315 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application created_value = creator( May 25 14:27:53.309188 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 14:27:53.309188 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 14:27:53.309188 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:27:53.309188 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:27:53.313158 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 243/493] 10.222.0.67 () {56 vars in 1108 bytes} [Wed May 25 14:27:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 14:27:53.314027 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3630e56e-8d15-43a5-a19c-6315ea36cd7f None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:27:53.339741 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:27:53.391919 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:27:53.401626 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab66fd6f-d456-48e4-a897-a36a027493dd None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:27:53.422898 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3630e56e-8d15-43a5-a19c-6315ea36cd7f None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:27:53.438037 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc487f0-4a7f-4c88-9559-9db02bf7fefb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:27:53.439135 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc487f0-4a7f-4c88-9559-9db02bf7fefb None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:53.439616 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc487f0-4a7f-4c88-9559-9db02bf7fefb None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:53.440090 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc487f0-4a7f-4c88-9559-9db02bf7fefb None admin] PATH_INFO: `/v3/roles/service` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:53.451140 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc487f0-4a7f-4c88-9559-9db02bf7fefb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:27:53.460269 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02a4c8e-dda9-41a7-866d-d7350a200514 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:27:53.460490 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application [None req-cdc487f0-4a7f-4c88-9559-9db02bf7fefb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 25 14:27:53.460490 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:27:53.460490 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:27:53.460490 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:27:53.460490 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:27:53.460490 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:27:53.460490 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:27:53.460490 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:27:53.460490 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:27:53.460490 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:27:53.460490 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:27:53.460490 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:27:53.460490 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:27:53.460490 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:27:53.460490 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:27:53.460490 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:27:53.461495 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:27:53.461495 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:27:53.461495 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:27:53.461495 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:27:53.461495 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:27:53.461495 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:27:53.461495 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:27:53.461495 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:27:53.461495 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:27:53.461495 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:27:53.461495 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:27:53.461495 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application with Lock( May 25 14:27:53.461495 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:27:53.461495 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self._enter() May 25 14:27:53.461495 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:27:53.461495 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:27:53.462295 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:27:53.462295 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.creator() May 25 14:27:53.462295 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:27:53.462295 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application created_value = creator( May 25 14:27:53.462295 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:27:53.462295 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:27:53.462295 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:27:53.462295 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:27:53.462295 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:27:53.462295 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:27:53.462295 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 25 14:27:53.462295 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application May 25 14:27:53.462952 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02a4c8e-dda9-41a7-866d-d7350a200514 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:53.462952 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02a4c8e-dda9-41a7-866d-d7350a200514 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:53.462952 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02a4c8e-dda9-41a7-866d-d7350a200514 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:53.463162 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 251/494] 10.222.0.67 () {56 vars in 1102 bytes} [Wed May 25 14:27:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:27:53.463162 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc487f0-4a7f-4c88-9559-9db02bf7fefb None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:27:53.473466 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02a4c8e-dda9-41a7-866d-d7350a200514 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:27:53.474947 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02a4c8e-dda9-41a7-866d-d7350a200514 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:27:53.490718 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application [None req-e02a4c8e-dda9-41a7-866d-d7350a200514 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 25 14:27:53.490718 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:27:53.490718 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:27:53.490718 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:27:53.490718 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:27:53.490718 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:27:53.490718 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:27:53.490718 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:27:53.490718 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:27:53.490718 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:27:53.490718 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:27:53.490718 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:27:53.490718 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 14:27:53.490718 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 14:27:53.490718 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 14:27:53.490718 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 14:27:53.491843 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:27:53.491843 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:27:53.491843 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 14:27:53.491843 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 14:27:53.491843 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 14:27:53.491843 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 14:27:53.491843 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:27:53.491843 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:27:53.491843 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:27:53.491843 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:27:53.491843 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:27:53.491843 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application with Lock( May 25 14:27:53.491843 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:27:53.491843 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._enter() May 25 14:27:53.491843 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:27:53.491843 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:27:53.491843 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:27:53.491843 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.creator() May 25 14:27:53.492971 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:27:53.492971 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application created_value = creator( May 25 14:27:53.492971 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 14:27:53.492971 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 14:27:53.492971 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 14:27:53.492971 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 14:27:53.492971 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 14:27:53.492971 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 14:27:53.492971 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 25 14:27:53.492971 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:27:53.492971 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 244/495] 10.222.0.67 () {56 vars in 1093 bytes} [Wed May 25 14:27:53 2022] GET /identity/v3/users/nova => generated 82 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:27:53.493744 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8089373-8287-4901-bc2c-25525f841d13 None None] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:53.493744 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8089373-8287-4901-bc2c-25525f841d13 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:53.493744 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8089373-8287-4901-bc2c-25525f841d13 None None] PATH_INFO: `/` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:53.499052 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 245/496] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 14:27:53 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:27:53.499052 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17556e1f-b0e1-49b5-b3d3-016ed4e25973 None None] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:53.499052 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17556e1f-b0e1-49b5-b3d3-016ed4e25973 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:53.499052 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17556e1f-b0e1-49b5-b3d3-016ed4e25973 None None] PATH_INFO: `/` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:53.499052 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 246/497] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 14:27:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:27:53.499052 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17556e1f-b0e1-49b5-b3d3-016ed4e25973 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:27:53.573188 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc487f0-4a7f-4c88-9559-9db02bf7fefb None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:27:53.586035 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:27:53.605901 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17556e1f-b0e1-49b5-b3d3-016ed4e25973 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:27:53.606617 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1deeca-a0d2-4b5a-8078-844186155b34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:27:53.607320 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1deeca-a0d2-4b5a-8078-844186155b34 None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:53.607597 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1deeca-a0d2-4b5a-8078-844186155b34 None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:53.607871 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1deeca-a0d2-4b5a-8078-844186155b34 None admin] PATH_INFO: `/v3/domains` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:53.609114 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1deeca-a0d2-4b5a-8078-844186155b34 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:27:53.609417 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1deeca-a0d2-4b5a-8078-844186155b34 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:27:53.610799 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1deeca-a0d2-4b5a-8078-844186155b34 None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:27:53.622420 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 252/498] 10.222.0.67 () {56 vars in 1109 bytes} [Wed May 25 14:27:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:27:53.623229 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1deeca-a0d2-4b5a-8078-844186155b34 None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:27:53.639323 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:27:53.641552 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c92fb1-a990-4e90-9c98-223973692572 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:27:53.642215 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c92fb1-a990-4e90-9c98-223973692572 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:53.642502 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c92fb1-a990-4e90-9c98-223973692572 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:53.642772 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c92fb1-a990-4e90-9c98-223973692572 None admin] PATH_INFO: `/v3/roles` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:53.643547 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c92fb1-a990-4e90-9c98-223973692572 None admin] RBAC: Adding query filter params (name=service) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:27:53.643850 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c92fb1-a990-4e90-9c98-223973692572 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:27:53.645237 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c92fb1-a990-4e90-9c98-223973692572 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:27:53.653405 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 247/499] 10.222.0.67 () {56 vars in 1103 bytes} [Wed May 25 14:27:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:27:53.654488 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165e4341-8960-4520-8c21-8435ebc06d6a None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:53.654900 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165e4341-8960-4520-8c21-8435ebc06d6a None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:53.655355 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165e4341-8960-4520-8c21-8435ebc06d6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:53.671518 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-165e4341-8960-4520-8c21-8435ebc06d6a None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:27:53.672682 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-165e4341-8960-4520-8c21-8435ebc06d6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:27:53.727791 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1deeca-a0d2-4b5a-8078-844186155b34 None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:27:53.738850 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 248/500] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 14:27:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 14:27:53.740222 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb70c91-583d-41ec-98b5-2ccbb96f79f7 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:53.740522 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb70c91-583d-41ec-98b5-2ccbb96f79f7 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:53.740798 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb70c91-583d-41ec-98b5-2ccbb96f79f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:53.764144 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d18ca5-c1ab-418c-889a-93e46c4042ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:27:53.764866 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d18ca5-c1ab-418c-889a-93e46c4042ca None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:53.765152 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d18ca5-c1ab-418c-889a-93e46c4042ca None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:53.765427 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d18ca5-c1ab-418c-889a-93e46c4042ca None admin] PATH_INFO: `/v3/users` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:53.765731 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-adb70c91-583d-41ec-98b5-2ccbb96f79f7 None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:27:53.766263 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d18ca5-c1ab-418c-889a-93e46c4042ca None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:27:53.766578 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d18ca5-c1ab-418c-889a-93e46c4042ca None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:27:53.766922 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-adb70c91-583d-41ec-98b5-2ccbb96f79f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:27:53.768041 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d18ca5-c1ab-418c-889a-93e46c4042ca None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:27:53.804739 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 253/501] 10.222.0.67 () {56 vars in 1133 bytes} [Wed May 25 14:27:53 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:27:53.805547 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d18ca5-c1ab-418c-889a-93e46c4042ca None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:27:53.837958 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 249/502] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 14:27:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 14:27:53.837958 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb70c91-583d-41ec-98b5-2ccbb96f79f7 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:27:53.846117 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:27:53.885386 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:27:53.917764 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d18ca5-c1ab-418c-889a-93e46c4042ca None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:27:53.939574 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb70c91-583d-41ec-98b5-2ccbb96f79f7 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:27:53.951573 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64713067-d7bf-49ff-be31-22ae4c6fb233 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:27:53.952979 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64713067-d7bf-49ff-be31-22ae4c6fb233 None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:53.953271 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64713067-d7bf-49ff-be31-22ae4c6fb233 None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:53.953553 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64713067-d7bf-49ff-be31-22ae4c6fb233 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:53.960698 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64713067-d7bf-49ff-be31-22ae4c6fb233 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:27:53.962157 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64713067-d7bf-49ff-be31-22ae4c6fb233 None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:27:53.973243 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fd5f68-ffc0-4773-b16e-ebc9067bf481 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:27:53.974021 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fd5f68-ffc0-4773-b16e-ebc9067bf481 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:53.974302 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fd5f68-ffc0-4773-b16e-ebc9067bf481 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:53.974572 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fd5f68-ffc0-4773-b16e-ebc9067bf481 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:53.977977 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application [None req-64713067-d7bf-49ff-be31-22ae4c6fb233 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 25 14:27:53.977977 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:27:53.977977 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:27:53.977977 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:27:53.977977 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:27:53.977977 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:27:53.977977 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:27:53.977977 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:27:53.977977 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:27:53.977977 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:27:53.977977 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:27:53.977977 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:27:53.977977 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 14:27:53.977977 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 14:27:53.977977 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 14:27:53.977977 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 14:27:53.979065 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:27:53.979065 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:27:53.979065 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 14:27:53.979065 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 14:27:53.979065 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 14:27:53.979065 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 14:27:53.979065 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:27:53.979065 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:27:53.979065 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:27:53.979065 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:27:53.979065 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:27:53.979065 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application with Lock( May 25 14:27:53.979065 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:27:53.979065 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self._enter() May 25 14:27:53.979065 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:27:53.979065 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:27:53.979065 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:27:53.979065 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.creator() May 25 14:27:53.980025 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:27:53.980025 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application created_value = creator( May 25 14:27:53.980025 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 14:27:53.980025 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 14:27:53.980025 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 14:27:53.980025 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 14:27:53.980025 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 14:27:53.980025 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 14:27:53.980025 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 25 14:27:53.980025 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application May 25 14:27:53.980025 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 254/503] 10.222.0.67 () {56 vars in 1099 bytes} [Wed May 25 14:27:53 2022] GET /identity/v3/users/glance => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:27:53.980025 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64713067-d7bf-49ff-be31-22ae4c6fb233 None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:27:53.984546 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fd5f68-ffc0-4773-b16e-ebc9067bf481 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:27:53.985987 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fd5f68-ffc0-4773-b16e-ebc9067bf481 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:27:54.004055 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application [None req-e9fd5f68-ffc0-4773-b16e-ebc9067bf481 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:27:54.004055 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:27:54.004055 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:27:54.004055 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:27:54.004055 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:27:54.004055 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:27:54.004055 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:27:54.004055 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:27:54.004055 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:27:54.004055 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:27:54.004055 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:27:54.004055 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:27:54.004055 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 14:27:54.004055 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 14:27:54.004055 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 14:27:54.005175 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 14:27:54.005175 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:27:54.005175 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:27:54.005175 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:27:54.005175 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:27:54.005175 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:27:54.005175 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:27:54.005175 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:27:54.005175 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application with Lock( May 25 14:27:54.005175 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:27:54.005175 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._enter() May 25 14:27:54.005175 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:27:54.005175 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:27:54.005175 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:27:54.005175 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.creator() May 25 14:27:54.005175 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:27:54.005175 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application created_value = creator( May 25 14:27:54.006657 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 14:27:54.006657 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 14:27:54.006657 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:27:54.006657 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:27:54.006657 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 250/504] 10.222.0.67 () {56 vars in 1108 bytes} [Wed May 25 14:27:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:27:54.006657 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fd5f68-ffc0-4773-b16e-ebc9067bf481 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:27:54.065088 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:27:54.085970 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64713067-d7bf-49ff-be31-22ae4c6fb233 None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:27:54.109564 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fd5f68-ffc0-4773-b16e-ebc9067bf481 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:27:54.115254 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:27:54.120754 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea9a8c8-ad77-4511-a207-69ade13f03ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:27:54.121795 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea9a8c8-ad77-4511-a207-69ade13f03ca None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:54.122074 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea9a8c8-ad77-4511-a207-69ade13f03ca None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:54.122346 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea9a8c8-ad77-4511-a207-69ade13f03ca None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:54.132679 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea9a8c8-ad77-4511-a207-69ade13f03ca None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:27:54.134136 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea9a8c8-ad77-4511-a207-69ade13f03ca None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:27:54.144420 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a76ee95-8543-4d1f-ae5f-adfc62e247e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:27:54.145071 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a76ee95-8543-4d1f-ae5f-adfc62e247e0 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:54.145357 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a76ee95-8543-4d1f-ae5f-adfc62e247e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:54.145636 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a76ee95-8543-4d1f-ae5f-adfc62e247e0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:54.151828 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application [None req-aea9a8c8-ad77-4511-a207-69ade13f03ca None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:27:54.151828 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:27:54.151828 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:27:54.151828 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:27:54.151828 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:27:54.151828 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:27:54.151828 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:27:54.151828 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:27:54.151828 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:27:54.151828 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:27:54.151828 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:27:54.151828 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:27:54.151828 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 14:27:54.151828 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 14:27:54.151828 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 14:27:54.152718 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 14:27:54.152718 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:27:54.152718 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:27:54.152718 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:27:54.152718 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:27:54.152718 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:27:54.152718 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:27:54.152718 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:27:54.152718 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application with Lock( May 25 14:27:54.152718 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:27:54.152718 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self._enter() May 25 14:27:54.152718 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:27:54.152718 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:27:54.152718 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:27:54.152718 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.creator() May 25 14:27:54.152718 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:27:54.152718 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application created_value = creator( May 25 14:27:54.153609 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 14:27:54.153609 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 14:27:54.153609 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:27:54.153609 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application May 25 14:27:54.153609 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 255/505] 10.222.0.67 () {56 vars in 1108 bytes} [Wed May 25 14:27:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:27:54.154197 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea9a8c8-ad77-4511-a207-69ade13f03ca None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:27:54.213394 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a76ee95-8543-4d1f-ae5f-adfc62e247e0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:27:54.214867 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a76ee95-8543-4d1f-ae5f-adfc62e247e0 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:27:54.255993 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea9a8c8-ad77-4511-a207-69ade13f03ca None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:27:54.269337 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:27:54.289992 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb865016-6bd5-4a5b-8f46-9cf3ddc15db4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:27:54.290786 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb865016-6bd5-4a5b-8f46-9cf3ddc15db4 None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:54.291098 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb865016-6bd5-4a5b-8f46-9cf3ddc15db4 None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:54.291375 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb865016-6bd5-4a5b-8f46-9cf3ddc15db4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:54.301511 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb865016-6bd5-4a5b-8f46-9cf3ddc15db4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:27:54.309310 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application [None req-eb865016-6bd5-4a5b-8f46-9cf3ddc15db4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 25 14:27:54.309310 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:27:54.309310 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:27:54.309310 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:27:54.309310 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:27:54.309310 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:27:54.309310 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:27:54.309310 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:27:54.309310 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:27:54.309310 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:27:54.309310 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:27:54.309310 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:27:54.309310 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:27:54.309310 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:27:54.309310 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:27:54.309310 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:27:54.310331 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:27:54.310331 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:27:54.310331 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:27:54.310331 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:27:54.310331 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:27:54.310331 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:27:54.310331 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:27:54.310331 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:27:54.310331 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:27:54.310331 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:27:54.310331 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:27:54.310331 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application with Lock( May 25 14:27:54.310331 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:27:54.310331 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self._enter() May 25 14:27:54.310331 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:27:54.310331 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:27:54.311340 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:27:54.311340 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.creator() May 25 14:27:54.311340 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:27:54.311340 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application created_value = creator( May 25 14:27:54.311340 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:27:54.311340 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:27:54.311340 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:27:54.311340 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:27:54.311340 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:27:54.311340 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:27:54.311340 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 25 14:27:54.311340 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application May 25 14:27:54.311340 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 256/506] 10.222.0.67 () {56 vars in 1102 bytes} [Wed May 25 14:27:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:27:54.312042 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb865016-6bd5-4a5b-8f46-9cf3ddc15db4 None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:27:54.316004 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 251/507] 10.222.0.67 () {58 vars in 1282 bytes} [Wed May 25 14:27:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 14:27:54.316933 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a76ee95-8543-4d1f-ae5f-adfc62e247e0 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:27:54.356520 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:27:54.411406 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb865016-6bd5-4a5b-8f46-9cf3ddc15db4 None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:27:54.416407 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a76ee95-8543-4d1f-ae5f-adfc62e247e0 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:27:54.445048 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a80e435-a6ab-4682-b33e-3bc843460619 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:27:54.445710 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a80e435-a6ab-4682-b33e-3bc843460619 None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:54.445990 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a80e435-a6ab-4682-b33e-3bc843460619 None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:54.446261 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a80e435-a6ab-4682-b33e-3bc843460619 None admin] PATH_INFO: `/v3/users` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:54.447127 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a80e435-a6ab-4682-b33e-3bc843460619 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:27:54.447437 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a80e435-a6ab-4682-b33e-3bc843460619 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:27:54.448877 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a80e435-a6ab-4682-b33e-3bc843460619 None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:27:54.449805 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70edc8ea-bf05-499d-85c4-cfebf44b43ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:27:54.450456 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70edc8ea-bf05-499d-85c4-cfebf44b43ff None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:54.450731 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70edc8ea-bf05-499d-85c4-cfebf44b43ff None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:54.451010 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70edc8ea-bf05-499d-85c4-cfebf44b43ff None admin] PATH_INFO: `/v3/domains` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:54.451821 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70edc8ea-bf05-499d-85c4-cfebf44b43ff None admin] RBAC: Adding query filter params (name=Default) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:27:54.452133 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70edc8ea-bf05-499d-85c4-cfebf44b43ff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:27:54.453483 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70edc8ea-bf05-499d-85c4-cfebf44b43ff None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:27:54.464661 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 252/508] 10.222.0.67 () {56 vars in 1109 bytes} [Wed May 25 14:27:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:27:54.465448 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70edc8ea-bf05-499d-85c4-cfebf44b43ff None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:27:54.465932 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 257/509] 10.222.0.67 () {56 vars in 1137 bytes} [Wed May 25 14:27:54 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:27:54.466618 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a80e435-a6ab-4682-b33e-3bc843460619 None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:27:54.486058 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:27:54.569720 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70edc8ea-bf05-499d-85c4-cfebf44b43ff None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:27:54.572974 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a80e435-a6ab-4682-b33e-3bc843460619 None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:27:54.574468 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:27:54.602847 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d823d0b0-c2c4-4bbe-8a0a-f71db40572be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:27:54.603533 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d823d0b0-c2c4-4bbe-8a0a-f71db40572be None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:54.603818 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d823d0b0-c2c4-4bbe-8a0a-f71db40572be None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:54.604097 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d823d0b0-c2c4-4bbe-8a0a-f71db40572be None admin] PATH_INFO: `/v3/domains` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:54.604822 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d823d0b0-c2c4-4bbe-8a0a-f71db40572be None admin] RBAC: Adding query filter params (name=Default) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:27:54.605132 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d823d0b0-c2c4-4bbe-8a0a-f71db40572be None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:27:54.606515 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d823d0b0-c2c4-4bbe-8a0a-f71db40572be None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:27:54.608773 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d86a97f-e653-41db-93ee-aafe4e00690e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:27:54.609457 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d86a97f-e653-41db-93ee-aafe4e00690e None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:54.609743 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d86a97f-e653-41db-93ee-aafe4e00690e None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:54.610019 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d86a97f-e653-41db-93ee-aafe4e00690e None admin] PATH_INFO: `/v3/roles` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:54.610771 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d86a97f-e653-41db-93ee-aafe4e00690e None admin] RBAC: Adding query filter params (name=service) {{(pid=80474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:27:54.611116 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d86a97f-e653-41db-93ee-aafe4e00690e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:27:54.612483 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d86a97f-e653-41db-93ee-aafe4e00690e None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:27:54.618932 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 253/510] 10.222.0.67 () {56 vars in 1109 bytes} [Wed May 25 14:27:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:27:54.619744 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d823d0b0-c2c4-4bbe-8a0a-f71db40572be None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:27:54.620506 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 258/511] 10.222.0.67 () {56 vars in 1103 bytes} [Wed May 25 14:27:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:27:54.621380 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d86a97f-e653-41db-93ee-aafe4e00690e None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:27:54.696213 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:27:54.718923 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d823d0b0-c2c4-4bbe-8a0a-f71db40572be None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:27:54.719845 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d86a97f-e653-41db-93ee-aafe4e00690e None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:27:54.753880 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cc9f03-e5bb-406a-8fe7-886c0197ccda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:27:54.754666 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cc9f03-e5bb-406a-8fe7-886c0197ccda None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:54.754947 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cc9f03-e5bb-406a-8fe7-886c0197ccda None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:54.755261 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cc9f03-e5bb-406a-8fe7-886c0197ccda None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:54.755817 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccc27db-262d-4896-b9e8-aa3514799aa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:27:54.756607 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccc27db-262d-4896-b9e8-aa3514799aa9 None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:54.756890 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccc27db-262d-4896-b9e8-aa3514799aa9 None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:54.757166 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccc27db-262d-4896-b9e8-aa3514799aa9 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:54.765162 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccc27db-262d-4896-b9e8-aa3514799aa9 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:27:54.765660 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cc9f03-e5bb-406a-8fe7-886c0197ccda None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:27:54.766749 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccc27db-262d-4896-b9e8-aa3514799aa9 None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:27:54.767136 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cc9f03-e5bb-406a-8fe7-886c0197ccda None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:27:54.781182 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application [None req-9ccc27db-262d-4896-b9e8-aa3514799aa9 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 25 14:27:54.781182 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:27:54.781182 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:27:54.781182 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:27:54.781182 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:27:54.781182 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:27:54.781182 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:27:54.781182 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:27:54.781182 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:27:54.781182 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:27:54.781182 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:27:54.781182 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:27:54.781182 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 14:27:54.781182 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 14:27:54.781182 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 14:27:54.781182 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 14:27:54.782259 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:27:54.782259 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:27:54.782259 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 14:27:54.782259 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 14:27:54.782259 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 14:27:54.782259 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 14:27:54.782259 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:27:54.782259 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:27:54.782259 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:27:54.782259 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:27:54.782259 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:27:54.782259 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application with Lock( May 25 14:27:54.782259 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:27:54.782259 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self._enter() May 25 14:27:54.782259 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:27:54.782259 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:27:54.782259 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:27:54.782259 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.creator() May 25 14:27:54.783328 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:27:54.783328 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application created_value = creator( May 25 14:27:54.783328 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 14:27:54.783328 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 14:27:54.783328 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 14:27:54.783328 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 14:27:54.783328 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 14:27:54.783328 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 14:27:54.783328 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 25 14:27:54.783328 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application May 25 14:27:54.783328 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 259/512] 10.222.0.67 () {56 vars in 1099 bytes} [Wed May 25 14:27:54 2022] GET /identity/v3/users/cinder => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:27:54.784036 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccc27db-262d-4896-b9e8-aa3514799aa9 None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:27:54.784721 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application [None req-f5cc9f03-e5bb-406a-8fe7-886c0197ccda None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:27:54.784721 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:27:54.784721 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:27:54.784721 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:27:54.784721 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:27:54.784721 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:27:54.784721 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:27:54.784721 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:27:54.784721 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:27:54.784721 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:27:54.784721 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:27:54.784721 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:27:54.784721 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 14:27:54.784721 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 14:27:54.784721 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 14:27:54.785497 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 14:27:54.785497 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:27:54.785497 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:27:54.785497 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:27:54.785497 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:27:54.785497 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:27:54.785497 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:27:54.785497 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:27:54.785497 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application with Lock( May 25 14:27:54.785497 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:27:54.785497 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._enter() May 25 14:27:54.785497 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:27:54.785497 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:27:54.785497 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:27:54.785497 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.creator() May 25 14:27:54.785497 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:27:54.785497 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application created_value = creator( May 25 14:27:54.786393 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 14:27:54.786393 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 14:27:54.786393 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:27:54.786393 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:27:54.786393 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 254/513] 10.222.0.67 () {56 vars in 1108 bytes} [Wed May 25 14:27:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:27:54.786659 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cc9f03-e5bb-406a-8fe7-886c0197ccda None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:27:54.820578 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:27:54.891886 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cc9f03-e5bb-406a-8fe7-886c0197ccda None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:27:54.898402 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccc27db-262d-4896-b9e8-aa3514799aa9 None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:27:54.917763 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:27:54.926685 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d1044c-4a5e-4d98-b967-101d6fe6e40a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:27:54.927397 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d1044c-4a5e-4d98-b967-101d6fe6e40a None admin] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:54.927682 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d1044c-4a5e-4d98-b967-101d6fe6e40a None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:54.927959 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d1044c-4a5e-4d98-b967-101d6fe6e40a None admin] PATH_INFO: `/v3/users` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:54.928658 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d1044c-4a5e-4d98-b967-101d6fe6e40a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:27:54.930104 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d1044c-4a5e-4d98-b967-101d6fe6e40a None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:27:54.931895 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4756b734-a683-4fa2-89fe-eea807bcce77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:27:54.932542 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4756b734-a683-4fa2-89fe-eea807bcce77 None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:54.932835 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4756b734-a683-4fa2-89fe-eea807bcce77 None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:54.933114 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4756b734-a683-4fa2-89fe-eea807bcce77 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:54.954594 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 255/514] 10.222.0.67 () {60 vars in 1132 bytes} [Wed May 25 14:27:54 2022] POST /identity/v3/users => generated 247 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:27:54.954594 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d1044c-4a5e-4d98-b967-101d6fe6e40a None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:27:55.009856 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4756b734-a683-4fa2-89fe-eea807bcce77 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:27:55.011409 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4756b734-a683-4fa2-89fe-eea807bcce77 None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:27:55.040332 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:27:55.089416 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d1044c-4a5e-4d98-b967-101d6fe6e40a None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:27:55.128137 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c093db4e-681a-4d94-92c9-86b76c558a24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:27:55.128940 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c093db4e-681a-4d94-92c9-86b76c558a24 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:55.129282 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c093db4e-681a-4d94-92c9-86b76c558a24 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:55.129570 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c093db4e-681a-4d94-92c9-86b76c558a24 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:55.129915 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 260/515] 10.222.0.67 () {58 vars in 1282 bytes} [Wed May 25 14:27:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 14:27:55.130839 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4756b734-a683-4fa2-89fe-eea807bcce77 None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:27:55.146522 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c093db4e-681a-4d94-92c9-86b76c558a24 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:27:55.148059 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c093db4e-681a-4d94-92c9-86b76c558a24 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:27:55.166533 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application [None req-c093db4e-681a-4d94-92c9-86b76c558a24 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:27:55.166533 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:27:55.166533 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:27:55.166533 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:27:55.166533 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:27:55.166533 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:27:55.166533 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:27:55.166533 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:27:55.166533 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:27:55.166533 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:27:55.166533 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:27:55.166533 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:27:55.166533 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 14:27:55.166533 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 14:27:55.166533 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 14:27:55.167614 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 14:27:55.167614 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:27:55.167614 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:27:55.167614 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:27:55.167614 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:27:55.167614 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:27:55.167614 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:27:55.167614 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:27:55.167614 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application with Lock( May 25 14:27:55.167614 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:27:55.167614 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._enter() May 25 14:27:55.167614 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:27:55.167614 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:27:55.167614 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:27:55.167614 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.creator() May 25 14:27:55.167614 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:27:55.167614 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application created_value = creator( May 25 14:27:55.168757 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 14:27:55.168757 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 14:27:55.168757 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:27:55.168757 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:27:55.168757 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 256/516] 10.222.0.67 () {56 vars in 1108 bytes} [Wed May 25 14:27:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:27:55.168757 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c093db4e-681a-4d94-92c9-86b76c558a24 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:27:55.207345 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:27:55.249403 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4756b734-a683-4fa2-89fe-eea807bcce77 None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:27:55.274223 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:27:55.282005 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c093db4e-681a-4d94-92c9-86b76c558a24 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:27:55.286570 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da9fc81-2cdf-4c95-bfaa-9c4b6a87abab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:27:55.287382 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da9fc81-2cdf-4c95-bfaa-9c4b6a87abab None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:55.287765 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da9fc81-2cdf-4c95-bfaa-9c4b6a87abab None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:55.288138 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da9fc81-2cdf-4c95-bfaa-9c4b6a87abab None admin] PATH_INFO: `/v3/users` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:55.289083 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da9fc81-2cdf-4c95-bfaa-9c4b6a87abab None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:27:55.289520 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da9fc81-2cdf-4c95-bfaa-9c4b6a87abab None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:27:55.291110 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da9fc81-2cdf-4c95-bfaa-9c4b6a87abab None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:27:55.313954 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 261/517] 10.222.0.67 () {56 vars in 1137 bytes} [Wed May 25 14:27:55 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:27:55.313954 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da9fc81-2cdf-4c95-bfaa-9c4b6a87abab None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:27:55.323120 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4941395e-61d7-41e5-bb72-6668ab3b2401 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:27:55.323793 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4941395e-61d7-41e5-bb72-6668ab3b2401 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:55.324090 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4941395e-61d7-41e5-bb72-6668ab3b2401 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:55.324485 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4941395e-61d7-41e5-bb72-6668ab3b2401 None admin] PATH_INFO: `/v3/domains` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:55.325221 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4941395e-61d7-41e5-bb72-6668ab3b2401 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:27:55.325531 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4941395e-61d7-41e5-bb72-6668ab3b2401 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:27:55.328273 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4941395e-61d7-41e5-bb72-6668ab3b2401 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:27:55.345341 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 257/518] 10.222.0.67 () {56 vars in 1109 bytes} [Wed May 25 14:27:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:27:55.345341 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4941395e-61d7-41e5-bb72-6668ab3b2401 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:27:55.419195 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da9fc81-2cdf-4c95-bfaa-9c4b6a87abab None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:27:55.445211 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:27:55.452091 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4941395e-61d7-41e5-bb72-6668ab3b2401 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:27:55.454299 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d65d2c-053f-4990-88ed-45e7abe4ef7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:27:55.455869 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d65d2c-053f-4990-88ed-45e7abe4ef7d None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:55.456160 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d65d2c-053f-4990-88ed-45e7abe4ef7d None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:55.456443 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d65d2c-053f-4990-88ed-45e7abe4ef7d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:55.467283 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d65d2c-053f-4990-88ed-45e7abe4ef7d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:27:55.469382 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d65d2c-053f-4990-88ed-45e7abe4ef7d None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:27:55.487682 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60132cb6-7068-4f3a-b737-e90c8033e236 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:27:55.488343 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60132cb6-7068-4f3a-b737-e90c8033e236 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:55.488630 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60132cb6-7068-4f3a-b737-e90c8033e236 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:55.488913 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60132cb6-7068-4f3a-b737-e90c8033e236 None admin] PATH_INFO: `/v3/domains` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:55.489645 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60132cb6-7068-4f3a-b737-e90c8033e236 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:27:55.489956 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60132cb6-7068-4f3a-b737-e90c8033e236 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:27:55.491218 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application [None req-37d65d2c-053f-4990-88ed-45e7abe4ef7d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:27:55.491218 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:27:55.491218 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:27:55.491218 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:27:55.491218 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:27:55.491218 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:27:55.491218 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:27:55.491218 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:27:55.491218 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:27:55.491218 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:27:55.491218 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:27:55.491218 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:27:55.491218 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 14:27:55.491218 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 14:27:55.491218 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 14:27:55.492182 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 14:27:55.492182 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:27:55.492182 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:27:55.492182 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:27:55.492182 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:27:55.492182 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:27:55.492182 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:27:55.492182 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:27:55.492182 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application with Lock( May 25 14:27:55.492182 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:27:55.492182 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self._enter() May 25 14:27:55.492182 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:27:55.492182 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:27:55.492182 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:27:55.492182 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.creator() May 25 14:27:55.492182 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:27:55.492182 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application created_value = creator( May 25 14:27:55.493243 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 14:27:55.493243 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 14:27:55.493243 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:27:55.493243 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application May 25 14:27:55.493541 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60132cb6-7068-4f3a-b737-e90c8033e236 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:27:55.494549 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 262/519] 10.222.0.67 () {56 vars in 1108 bytes} [Wed May 25 14:27:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:27:55.495191 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d65d2c-053f-4990-88ed-45e7abe4ef7d None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:27:55.514870 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 258/520] 10.222.0.67 () {56 vars in 1109 bytes} [Wed May 25 14:27:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:27:55.516007 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60132cb6-7068-4f3a-b737-e90c8033e236 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:27:55.533719 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:27:55.605975 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d65d2c-053f-4990-88ed-45e7abe4ef7d None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:27:55.624103 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60132cb6-7068-4f3a-b737-e90c8033e236 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:27:55.644214 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec16c03-1eb2-4f2c-8324-793878602a69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:27:55.644984 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec16c03-1eb2-4f2c-8324-793878602a69 None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:55.645276 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec16c03-1eb2-4f2c-8324-793878602a69 None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:55.645561 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec16c03-1eb2-4f2c-8324-793878602a69 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:55.658813 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8863b710-7223-48c2-bee9-75325832596e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:27:55.659725 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8863b710-7223-48c2-bee9-75325832596e None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:55.660087 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8863b710-7223-48c2-bee9-75325832596e None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:55.660432 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8863b710-7223-48c2-bee9-75325832596e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:55.667569 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8863b710-7223-48c2-bee9-75325832596e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:27:55.669122 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8863b710-7223-48c2-bee9-75325832596e None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:27:55.684501 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application [None req-8863b710-7223-48c2-bee9-75325832596e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 14:27:55.684501 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:27:55.684501 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:27:55.684501 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:27:55.684501 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:27:55.684501 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:27:55.684501 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:27:55.684501 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:27:55.684501 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:27:55.684501 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:27:55.684501 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:27:55.684501 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:27:55.684501 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 14:27:55.684501 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 14:27:55.684501 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 14:27:55.685578 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 14:27:55.685578 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:27:55.685578 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:27:55.685578 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:27:55.685578 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:27:55.685578 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:27:55.685578 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:27:55.685578 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:27:55.685578 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application with Lock( May 25 14:27:55.685578 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:27:55.685578 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._enter() May 25 14:27:55.685578 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:27:55.685578 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:27:55.685578 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:27:55.685578 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.creator() May 25 14:27:55.685578 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:27:55.685578 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application created_value = creator( May 25 14:27:55.687208 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 14:27:55.687208 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 14:27:55.687208 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 14:27:55.687208 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 14:27:55.687208 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 14:27:55.687208 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 14:27:55.687208 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 14:27:55.687208 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:27:55.687208 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 259/521] 10.222.0.67 () {56 vars in 1111 bytes} [Wed May 25 14:27:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:27:55.687865 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8863b710-7223-48c2-bee9-75325832596e None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:27:55.706757 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:27:55.727995 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec16c03-1eb2-4f2c-8324-793878602a69 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:27:55.729576 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec16c03-1eb2-4f2c-8324-793878602a69 None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:27:55.765741 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:27:55.805711 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8863b710-7223-48c2-bee9-75325832596e None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:27:55.845506 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fa1678-a459-4e6e-964f-84c45d30a860 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:27:55.846259 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fa1678-a459-4e6e-964f-84c45d30a860 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:55.846662 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fa1678-a459-4e6e-964f-84c45d30a860 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:55.846861 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fa1678-a459-4e6e-964f-84c45d30a860 None admin] PATH_INFO: `/v3/domains` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:55.847638 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fa1678-a459-4e6e-964f-84c45d30a860 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:27:55.847936 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fa1678-a459-4e6e-964f-84c45d30a860 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:27:55.849475 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fa1678-a459-4e6e-964f-84c45d30a860 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:27:55.853806 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 263/522] 10.222.0.67 () {58 vars in 1282 bytes} [Wed May 25 14:27:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 14:27:55.855916 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec16c03-1eb2-4f2c-8324-793878602a69 None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:27:55.863971 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 260/523] 10.222.0.67 () {56 vars in 1109 bytes} [Wed May 25 14:27:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:27:55.864714 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fa1678-a459-4e6e-964f-84c45d30a860 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:27:55.946610 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:27:55.964357 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec16c03-1eb2-4f2c-8324-793878602a69 None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:27:55.972074 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fa1678-a459-4e6e-964f-84c45d30a860 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:27:56.004430 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558d2f5d-0fbc-46de-8470-f9d2a0cfaee4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:27:56.005238 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558d2f5d-0fbc-46de-8470-f9d2a0cfaee4 None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:56.005508 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558d2f5d-0fbc-46de-8470-f9d2a0cfaee4 None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:56.005786 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558d2f5d-0fbc-46de-8470-f9d2a0cfaee4 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:56.007175 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047d2180-3c29-4da1-9a19-5d04aac36d16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:27:56.007837 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047d2180-3c29-4da1-9a19-5d04aac36d16 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:56.007969 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:27:56.008120 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047d2180-3c29-4da1-9a19-5d04aac36d16 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:56.008392 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047d2180-3c29-4da1-9a19-5d04aac36d16 None admin] PATH_INFO: `/v3/projects` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:56.009213 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047d2180-3c29-4da1-9a19-5d04aac36d16 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:27:56.009507 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047d2180-3c29-4da1-9a19-5d04aac36d16 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:27:56.011022 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047d2180-3c29-4da1-9a19-5d04aac36d16 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:27:56.016032 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558d2f5d-0fbc-46de-8470-f9d2a0cfaee4 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:27:56.017472 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558d2f5d-0fbc-46de-8470-f9d2a0cfaee4 None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:27:56.034120 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 261/524] 10.222.0.67 () {56 vars in 1148 bytes} [Wed May 25 14:27:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:27:56.034120 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047d2180-3c29-4da1-9a19-5d04aac36d16 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:27:56.034369 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application [None req-558d2f5d-0fbc-46de-8470-f9d2a0cfaee4 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 25 14:27:56.034369 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:27:56.034369 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:27:56.034369 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:27:56.034369 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:27:56.034369 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:27:56.034369 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:27:56.034369 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:27:56.034369 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:27:56.034369 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:27:56.034369 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:27:56.034369 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:27:56.034369 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 14:27:56.034369 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 14:27:56.034369 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 14:27:56.034369 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 14:27:56.035831 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:27:56.035831 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:27:56.035831 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 14:27:56.035831 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 14:27:56.035831 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 14:27:56.035831 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 14:27:56.035831 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:27:56.035831 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:27:56.035831 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:27:56.035831 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:27:56.035831 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:27:56.035831 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application with Lock( May 25 14:27:56.035831 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:27:56.035831 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self._enter() May 25 14:27:56.035831 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:27:56.035831 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:27:56.035831 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:27:56.035831 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.creator() May 25 14:27:56.036772 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:27:56.036772 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application created_value = creator( May 25 14:27:56.036772 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 14:27:56.036772 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 14:27:56.036772 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 14:27:56.036772 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 14:27:56.036772 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 14:27:56.036772 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 14:27:56.036772 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 25 14:27:56.036772 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application May 25 14:27:56.036772 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 264/525] 10.222.0.67 () {56 vars in 1102 bytes} [Wed May 25 14:27:55 2022] GET /identity/v3/users/neutron => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:27:56.036772 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558d2f5d-0fbc-46de-8470-f9d2a0cfaee4 None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:27:56.147064 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047d2180-3c29-4da1-9a19-5d04aac36d16 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:27:56.149392 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558d2f5d-0fbc-46de-8470-f9d2a0cfaee4 None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:27:56.183913 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47db0c6c-e4d8-4aaa-b0ff-71ccd1deb522 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:27:56.185147 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47db0c6c-e4d8-4aaa-b0ff-71ccd1deb522 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:56.185751 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47db0c6c-e4d8-4aaa-b0ff-71ccd1deb522 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:56.186805 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47db0c6c-e4d8-4aaa-b0ff-71ccd1deb522 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:56.186919 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93348aba-f76c-4eed-abeb-c80de24edde8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:27:56.188078 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93348aba-f76c-4eed-abeb-c80de24edde8 None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:56.188362 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93348aba-f76c-4eed-abeb-c80de24edde8 None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:56.188637 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93348aba-f76c-4eed-abeb-c80de24edde8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:56.190980 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:27:56.195645 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93348aba-f76c-4eed-abeb-c80de24edde8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:27:56.197103 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93348aba-f76c-4eed-abeb-c80de24edde8 None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:27:56.200026 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47db0c6c-e4d8-4aaa-b0ff-71ccd1deb522 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:27:56.202306 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47db0c6c-e4d8-4aaa-b0ff-71ccd1deb522 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:27:56.212786 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application [None req-93348aba-f76c-4eed-abeb-c80de24edde8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 14:27:56.212786 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:27:56.212786 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:27:56.212786 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:27:56.212786 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:27:56.212786 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:27:56.212786 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:27:56.212786 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:27:56.212786 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:27:56.212786 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:27:56.212786 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:27:56.212786 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:27:56.212786 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 14:27:56.212786 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 14:27:56.212786 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 14:27:56.213796 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 14:27:56.213796 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:27:56.213796 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:27:56.213796 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:27:56.213796 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:27:56.213796 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:27:56.213796 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:27:56.213796 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:27:56.213796 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application with Lock( May 25 14:27:56.213796 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:27:56.213796 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self._enter() May 25 14:27:56.213796 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:27:56.213796 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:27:56.213796 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:27:56.213796 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.creator() May 25 14:27:56.213796 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:27:56.213796 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application created_value = creator( May 25 14:27:56.214672 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 14:27:56.214672 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 14:27:56.214672 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 14:27:56.214672 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 14:27:56.214672 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 14:27:56.214672 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 14:27:56.214672 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 14:27:56.214672 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application May 25 14:27:56.214672 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 265/526] 10.222.0.67 () {56 vars in 1111 bytes} [Wed May 25 14:27:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:27:56.215188 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93348aba-f76c-4eed-abeb-c80de24edde8 None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:27:56.225989 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application [None req-47db0c6c-e4d8-4aaa-b0ff-71ccd1deb522 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:27:56.225989 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:27:56.225989 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:27:56.225989 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:27:56.225989 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:27:56.225989 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:27:56.225989 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:27:56.225989 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:27:56.225989 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:27:56.225989 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:27:56.225989 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:27:56.225989 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:27:56.225989 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 14:27:56.225989 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 14:27:56.225989 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 14:27:56.226891 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 14:27:56.226891 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:27:56.226891 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:27:56.226891 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:27:56.226891 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:27:56.226891 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:27:56.226891 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:27:56.226891 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:27:56.226891 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application with Lock( May 25 14:27:56.226891 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:27:56.226891 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._enter() May 25 14:27:56.226891 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:27:56.226891 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:27:56.226891 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:27:56.226891 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.creator() May 25 14:27:56.226891 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:27:56.226891 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application created_value = creator( May 25 14:27:56.227784 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 14:27:56.227784 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 14:27:56.227784 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:27:56.227784 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:27:56.227784 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 262/527] 10.222.0.67 () {56 vars in 1108 bytes} [Wed May 25 14:27:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:27:56.228547 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47db0c6c-e4d8-4aaa-b0ff-71ccd1deb522 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:27:56.283021 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:27:56.332632 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93348aba-f76c-4eed-abeb-c80de24edde8 None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:27:56.339104 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47db0c6c-e4d8-4aaa-b0ff-71ccd1deb522 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:27:56.367675 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22f0c22-6e95-4f4d-956b-419944352044 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:27:56.368332 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22f0c22-6e95-4f4d-956b-419944352044 None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:56.368623 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22f0c22-6e95-4f4d-956b-419944352044 None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:56.368910 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22f0c22-6e95-4f4d-956b-419944352044 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:56.369749 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22f0c22-6e95-4f4d-956b-419944352044 None admin] RBAC: Adding query filter params (role.id=85be32e3c1ae4269b5456307e0827cc7, scope.project.id=bfe93ee8d32a441295efc0b885de4bd7, user.id=428ec99478284743943ed41e9d24a603) {{(pid=80474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:27:56.370064 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22f0c22-6e95-4f4d-956b-419944352044 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:27:56.371785 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22f0c22-6e95-4f4d-956b-419944352044 None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:27:56.387035 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb97b7d-5cf8-4435-8c39-5d639e828f7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:27:56.387256 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 266/528] 10.222.0.67 () {56 vars in 1374 bytes} [Wed May 25 14:27:56 2022] GET /identity/v3/role_assignments?user.id=428ec99478284743943ed41e9d24a603&scope.project.id=bfe93ee8d32a441295efc0b885de4bd7&role.id=85be32e3c1ae4269b5456307e0827cc7 => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:27:56.387348 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb97b7d-5cf8-4435-8c39-5d639e828f7e None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:56.387450 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22f0c22-6e95-4f4d-956b-419944352044 None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:27:56.387533 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb97b7d-5cf8-4435-8c39-5d639e828f7e None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:56.387533 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb97b7d-5cf8-4435-8c39-5d639e828f7e None admin] PATH_INFO: `/v3/users` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:56.387533 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb97b7d-5cf8-4435-8c39-5d639e828f7e None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:27:56.387533 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb97b7d-5cf8-4435-8c39-5d639e828f7e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:27:56.387533 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb97b7d-5cf8-4435-8c39-5d639e828f7e None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:27:56.429480 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 263/529] 10.222.0.67 () {56 vars in 1139 bytes} [Wed May 25 14:27:56 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:27:56.430439 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb97b7d-5cf8-4435-8c39-5d639e828f7e None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:27:56.502025 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:27:56.522921 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22f0c22-6e95-4f4d-956b-419944352044 None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:27:56.546278 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:27:56.568776 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4229312b-c61a-47db-8810-363e255334c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:27:56.569977 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4229312b-c61a-47db-8810-363e255334c7 None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:56.570498 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4229312b-c61a-47db-8810-363e255334c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:56.570980 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4229312b-c61a-47db-8810-363e255334c7 None admin] PATH_INFO: `/v3/projects` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:56.572038 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4229312b-c61a-47db-8810-363e255334c7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:27:56.572612 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4229312b-c61a-47db-8810-363e255334c7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:27:56.574403 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4229312b-c61a-47db-8810-363e255334c7 None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:27:56.580790 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb97b7d-5cf8-4435-8c39-5d639e828f7e None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:27:56.597625 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 267/530] 10.222.0.67 () {56 vars in 1148 bytes} [Wed May 25 14:27:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:27:56.601752 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4229312b-c61a-47db-8810-363e255334c7 None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:27:56.633604 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0237c815-7fd5-4085-85b6-82bce5ad198f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:27:56.634781 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0237c815-7fd5-4085-85b6-82bce5ad198f None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:56.635527 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0237c815-7fd5-4085-85b6-82bce5ad198f None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:56.635965 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0237c815-7fd5-4085-85b6-82bce5ad198f None admin] PATH_INFO: `/v3/domains` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:56.637522 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0237c815-7fd5-4085-85b6-82bce5ad198f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:27:56.637984 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0237c815-7fd5-4085-85b6-82bce5ad198f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:27:56.639880 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0237c815-7fd5-4085-85b6-82bce5ad198f None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:27:56.656658 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 264/531] 10.222.0.67 () {56 vars in 1109 bytes} [Wed May 25 14:27:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:27:56.657770 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0237c815-7fd5-4085-85b6-82bce5ad198f None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:27:56.710445 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4229312b-c61a-47db-8810-363e255334c7 None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:27:56.755779 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8902b98a-5835-400b-a25a-832861af2fa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:27:56.757639 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8902b98a-5835-400b-a25a-832861af2fa4 None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:56.758143 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8902b98a-5835-400b-a25a-832861af2fa4 None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:56.758607 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8902b98a-5835-400b-a25a-832861af2fa4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:56.788287 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0237c815-7fd5-4085-85b6-82bce5ad198f None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:27:56.797077 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:27:56.827256 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa2dd4c-f503-4aea-8b8d-439222b40e4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:27:56.830407 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:27:56.831184 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa2dd4c-f503-4aea-8b8d-439222b40e4d None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:56.831184 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa2dd4c-f503-4aea-8b8d-439222b40e4d None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:56.831436 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa2dd4c-f503-4aea-8b8d-439222b40e4d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:56.832580 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa2dd4c-f503-4aea-8b8d-439222b40e4d None admin] RBAC: Adding query filter params (role.id=85be32e3c1ae4269b5456307e0827cc7, scope.project.id=bfe93ee8d32a441295efc0b885de4bd7, user.id=b5e4d67668ce40509e057f4f4c994521) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:27:56.832896 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa2dd4c-f503-4aea-8b8d-439222b40e4d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:27:56.834363 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa2dd4c-f503-4aea-8b8d-439222b40e4d None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:27:56.847430 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 265/532] 10.222.0.67 () {56 vars in 1374 bytes} [Wed May 25 14:27:56 2022] GET /identity/v3/role_assignments?user.id=b5e4d67668ce40509e057f4f4c994521&scope.project.id=bfe93ee8d32a441295efc0b885de4bd7&role.id=85be32e3c1ae4269b5456307e0827cc7 => generated 259 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:27:56.849192 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa2dd4c-f503-4aea-8b8d-439222b40e4d None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:27:56.859581 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8902b98a-5835-400b-a25a-832861af2fa4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:27:56.861163 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8902b98a-5835-400b-a25a-832861af2fa4 None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:27:56.993263 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa2dd4c-f503-4aea-8b8d-439222b40e4d None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:27:57.033552 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 268/533] 10.222.0.67 () {58 vars in 1282 bytes} [Wed May 25 14:27:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 14:27:57.039299 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8902b98a-5835-400b-a25a-832861af2fa4 None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:27:57.042431 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea0f436-2c50-4425-a767-8d253a822894 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:27:57.044675 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea0f436-2c50-4425-a767-8d253a822894 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:57.045169 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea0f436-2c50-4425-a767-8d253a822894 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:57.046221 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea0f436-2c50-4425-a767-8d253a822894 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:57.055169 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea0f436-2c50-4425-a767-8d253a822894 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:27:57.057007 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea0f436-2c50-4425-a767-8d253a822894 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:27:57.078234 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application [None req-aea0f436-2c50-4425-a767-8d253a822894 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 14:27:57.078234 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:27:57.078234 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:27:57.078234 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:27:57.078234 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:27:57.078234 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:27:57.078234 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:27:57.078234 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:27:57.078234 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:27:57.078234 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:27:57.078234 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:27:57.078234 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:27:57.078234 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 14:27:57.078234 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 14:27:57.078234 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 14:27:57.079199 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 14:27:57.079199 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:27:57.079199 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:27:57.079199 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:27:57.079199 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:27:57.079199 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:27:57.079199 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:27:57.079199 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:27:57.079199 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application with Lock( May 25 14:27:57.079199 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:27:57.079199 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._enter() May 25 14:27:57.079199 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:27:57.079199 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:27:57.079199 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:27:57.079199 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.creator() May 25 14:27:57.079199 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:27:57.079199 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application created_value = creator( May 25 14:27:57.080084 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 14:27:57.080084 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 14:27:57.080084 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 14:27:57.080084 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 14:27:57.080084 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 14:27:57.080084 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 14:27:57.080084 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 14:27:57.080084 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:27:57.084665 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 266/534] 10.222.0.67 () {56 vars in 1111 bytes} [Wed May 25 14:27:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:27:57.089854 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea0f436-2c50-4425-a767-8d253a822894 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:27:57.137420 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:27:57.163144 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:27:57.226460 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea0f436-2c50-4425-a767-8d253a822894 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:27:57.228012 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8902b98a-5835-400b-a25a-832861af2fa4 None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:27:57.266945 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c8eb02-3355-44db-ab17-d49a144d2a83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:27:57.267694 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c8eb02-3355-44db-ab17-d49a144d2a83 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:57.267912 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c8eb02-3355-44db-ab17-d49a144d2a83 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:57.268200 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c8eb02-3355-44db-ab17-d49a144d2a83 None admin] PATH_INFO: `/v3/projects` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:57.268976 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c8eb02-3355-44db-ab17-d49a144d2a83 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:27:57.269281 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c8eb02-3355-44db-ab17-d49a144d2a83 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:27:57.270712 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c8eb02-3355-44db-ab17-d49a144d2a83 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:27:57.273048 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4185336-ff5f-4560-8a9a-1a9948b8dd79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:27:57.274482 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4185336-ff5f-4560-8a9a-1a9948b8dd79 None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:57.274979 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4185336-ff5f-4560-8a9a-1a9948b8dd79 None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:57.275481 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4185336-ff5f-4560-8a9a-1a9948b8dd79 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:57.284259 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 267/535] 10.222.0.67 () {56 vars in 1148 bytes} [Wed May 25 14:27:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:27:57.285972 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62da8e00-2f2c-46ac-b6a3-ce6e091cb428 None None] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:57.286263 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62da8e00-2f2c-46ac-b6a3-ce6e091cb428 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:57.286539 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62da8e00-2f2c-46ac-b6a3-ce6e091cb428 None None] PATH_INFO: `/` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:57.289995 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4185336-ff5f-4560-8a9a-1a9948b8dd79 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:27:57.291211 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 268/536] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 14:27:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:27:57.292190 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62da8e00-2f2c-46ac-b6a3-ce6e091cb428 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:27:57.292429 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4185336-ff5f-4560-8a9a-1a9948b8dd79 None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:27:57.315915 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application [None req-c4185336-ff5f-4560-8a9a-1a9948b8dd79 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:27:57.315915 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:27:57.315915 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:27:57.315915 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:27:57.315915 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:27:57.315915 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:27:57.315915 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:27:57.315915 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:27:57.315915 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:27:57.315915 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:27:57.315915 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:27:57.315915 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:27:57.315915 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 14:27:57.315915 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 14:27:57.315915 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 14:27:57.316918 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 14:27:57.316918 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:27:57.316918 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:27:57.316918 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:27:57.316918 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:27:57.316918 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:27:57.316918 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:27:57.316918 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:27:57.316918 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application with Lock( May 25 14:27:57.316918 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:27:57.316918 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self._enter() May 25 14:27:57.316918 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:27:57.316918 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:27:57.316918 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:27:57.316918 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.creator() May 25 14:27:57.316918 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:27:57.316918 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application created_value = creator( May 25 14:27:57.317806 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 14:27:57.317806 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 14:27:57.317806 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:27:57.317806 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application May 25 14:27:57.320511 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 269/537] 10.222.0.67 () {56 vars in 1108 bytes} [Wed May 25 14:27:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:27:57.322645 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2a512a-2a63-44a3-9baa-1823690c90be None None] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:57.323116 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2a512a-2a63-44a3-9baa-1823690c90be None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:57.323829 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2a512a-2a63-44a3-9baa-1823690c90be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:57.347510 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.auth.core [None req-9e2a512a-2a63-44a3-9baa-1823690c90be None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:27:57.348697 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-9e2a512a-2a63-44a3-9baa-1823690c90be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:27:57.412887 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:27:57.425422 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62da8e00-2f2c-46ac-b6a3-ce6e091cb428 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:27:57.441358 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 270/538] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 14:27:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 14:27:57.441358 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2a512a-2a63-44a3-9baa-1823690c90be None None] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:27:57.480006 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44695095-1440-4c70-87c7-896113706aef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:27:57.480744 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44695095-1440-4c70-87c7-896113706aef None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:57.481143 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44695095-1440-4c70-87c7-896113706aef None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:57.481676 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44695095-1440-4c70-87c7-896113706aef None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:57.482606 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44695095-1440-4c70-87c7-896113706aef None admin] RBAC: Adding query filter params (role.id=85be32e3c1ae4269b5456307e0827cc7, scope.project.id=bfe93ee8d32a441295efc0b885de4bd7, user.id=6e462acc9da84a61bb23998dd54e1858) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:27:57.483305 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44695095-1440-4c70-87c7-896113706aef None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:27:57.484651 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44695095-1440-4c70-87c7-896113706aef None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:27:57.490909 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 269/539] 10.222.0.67 () {56 vars in 1374 bytes} [Wed May 25 14:27:57 2022] GET /identity/v3/role_assignments?user.id=6e462acc9da84a61bb23998dd54e1858&scope.project.id=bfe93ee8d32a441295efc0b885de4bd7&role.id=85be32e3c1ae4269b5456307e0827cc7 => generated 259 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:27:57.492076 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44695095-1440-4c70-87c7-896113706aef None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:27:57.541474 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:27:57.612195 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44695095-1440-4c70-87c7-896113706aef None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:27:57.615185 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2a512a-2a63-44a3-9baa-1823690c90be None None] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:27:57.649640 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f781a3b-9a3e-40f0-8983-42e8a785986b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:27:57.650668 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f781a3b-9a3e-40f0-8983-42e8a785986b None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:57.651082 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f781a3b-9a3e-40f0-8983-42e8a785986b None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:57.651450 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f781a3b-9a3e-40f0-8983-42e8a785986b None admin] PATH_INFO: `/v3/roles/service` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:57.664132 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f781a3b-9a3e-40f0-8983-42e8a785986b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:27:57.672946 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application [None req-8f781a3b-9a3e-40f0-8983-42e8a785986b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 25 14:27:57.672946 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:27:57.672946 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:27:57.672946 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:27:57.672946 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:27:57.672946 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:27:57.672946 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:27:57.672946 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:27:57.672946 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:27:57.672946 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:27:57.672946 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:27:57.672946 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:27:57.672946 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:27:57.672946 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:27:57.672946 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:27:57.672946 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:27:57.674130 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:27:57.674130 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:27:57.674130 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:27:57.674130 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:27:57.674130 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:27:57.674130 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:27:57.674130 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:27:57.674130 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:27:57.674130 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:27:57.674130 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:27:57.674130 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:27:57.674130 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application with Lock( May 25 14:27:57.674130 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:27:57.674130 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._enter() May 25 14:27:57.674130 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:27:57.674130 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:27:57.675168 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:27:57.675168 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.creator() May 25 14:27:57.675168 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:27:57.675168 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application created_value = creator( May 25 14:27:57.675168 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:27:57.675168 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:27:57.675168 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:27:57.675168 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:27:57.675168 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:27:57.675168 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:27:57.675168 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 25 14:27:57.675168 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:27:57.677308 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 270/540] 10.222.0.67 () {56 vars in 1102 bytes} [Wed May 25 14:27:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:27:57.683278 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f781a3b-9a3e-40f0-8983-42e8a785986b None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:27:57.706123 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc78e95-aadf-4fbc-beaf-e3471f53ff73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:27:57.706802 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc78e95-aadf-4fbc-beaf-e3471f53ff73 None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:57.707107 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc78e95-aadf-4fbc-beaf-e3471f53ff73 None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:57.707380 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc78e95-aadf-4fbc-beaf-e3471f53ff73 None admin] PATH_INFO: `/v3/domains` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:57.708124 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc78e95-aadf-4fbc-beaf-e3471f53ff73 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:27:57.710641 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc78e95-aadf-4fbc-beaf-e3471f53ff73 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:27:57.712754 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc78e95-aadf-4fbc-beaf-e3471f53ff73 None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:27:57.719943 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:27:57.738161 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 271/541] 10.222.0.67 () {56 vars in 1109 bytes} [Wed May 25 14:27:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:27:57.744122 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc78e95-aadf-4fbc-beaf-e3471f53ff73 None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:27:57.822823 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f781a3b-9a3e-40f0-8983-42e8a785986b None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:27:57.861219 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54155fee-a3a5-4b4d-9095-b80ac545fb1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:27:57.861892 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54155fee-a3a5-4b4d-9095-b80ac545fb1c None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:57.862173 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54155fee-a3a5-4b4d-9095-b80ac545fb1c None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:57.862447 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54155fee-a3a5-4b4d-9095-b80ac545fb1c None admin] PATH_INFO: `/v3/roles` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:57.863234 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54155fee-a3a5-4b4d-9095-b80ac545fb1c None admin] RBAC: Adding query filter params (name=service) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:27:57.863540 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54155fee-a3a5-4b4d-9095-b80ac545fb1c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:27:57.864914 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54155fee-a3a5-4b4d-9095-b80ac545fb1c None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:27:57.873853 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 271/542] 10.222.0.67 () {56 vars in 1103 bytes} [Wed May 25 14:27:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:27:57.879950 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54155fee-a3a5-4b4d-9095-b80ac545fb1c None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:27:57.893089 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc78e95-aadf-4fbc-beaf-e3471f53ff73 None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:27:57.915151 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:27:57.932695 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6779f423-4045-4320-99be-de5adb0f911d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:27:57.933827 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6779f423-4045-4320-99be-de5adb0f911d None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:57.934415 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6779f423-4045-4320-99be-de5adb0f911d None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:57.939487 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6779f423-4045-4320-99be-de5adb0f911d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:57.947202 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6779f423-4045-4320-99be-de5adb0f911d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:27:57.948956 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6779f423-4045-4320-99be-de5adb0f911d None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:27:57.964496 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application [None req-6779f423-4045-4320-99be-de5adb0f911d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 14:27:57.964496 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:27:57.964496 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:27:57.964496 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:27:57.964496 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:27:57.964496 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:27:57.964496 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:27:57.964496 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:27:57.964496 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:27:57.964496 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:27:57.964496 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:27:57.964496 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:27:57.964496 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 14:27:57.964496 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 14:27:57.964496 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 14:27:57.965381 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 14:27:57.965381 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:27:57.965381 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:27:57.965381 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:27:57.965381 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:27:57.965381 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:27:57.965381 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:27:57.965381 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:27:57.965381 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application with Lock( May 25 14:27:57.965381 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:27:57.965381 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self._enter() May 25 14:27:57.965381 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:27:57.965381 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:27:57.965381 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:27:57.965381 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.creator() May 25 14:27:57.965381 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:27:57.965381 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application created_value = creator( May 25 14:27:57.966247 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 14:27:57.966247 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 14:27:57.966247 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 14:27:57.966247 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 14:27:57.966247 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 14:27:57.966247 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 14:27:57.966247 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 14:27:57.966247 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application May 25 14:27:57.968695 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 272/543] 10.222.0.67 () {56 vars in 1111 bytes} [Wed May 25 14:27:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 14:27:57.974347 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6779f423-4045-4320-99be-de5adb0f911d None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:27:58.053057 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:27:58.084211 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6779f423-4045-4320-99be-de5adb0f911d None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:27:58.117267 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54155fee-a3a5-4b4d-9095-b80ac545fb1c None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:27:58.122725 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8dd774-8bcd-4824-9351-9b8e01533656 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:27:58.124002 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8dd774-8bcd-4824-9351-9b8e01533656 None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:58.124576 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8dd774-8bcd-4824-9351-9b8e01533656 None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:58.125061 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8dd774-8bcd-4824-9351-9b8e01533656 None admin] PATH_INFO: `/v3/projects` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:58.126059 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8dd774-8bcd-4824-9351-9b8e01533656 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:27:58.126613 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8dd774-8bcd-4824-9351-9b8e01533656 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:27:58.128393 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8dd774-8bcd-4824-9351-9b8e01533656 None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:27:58.142261 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 273/544] 10.222.0.67 () {56 vars in 1148 bytes} [Wed May 25 14:27:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:27:58.148255 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8dd774-8bcd-4824-9351-9b8e01533656 None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:27:58.194415 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:27:58.207716 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a92d293-ac0a-42f8-9b12-d2bb7fe41837 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:27:58.208544 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a92d293-ac0a-42f8-9b12-d2bb7fe41837 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:58.208816 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a92d293-ac0a-42f8-9b12-d2bb7fe41837 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:58.209159 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a92d293-ac0a-42f8-9b12-d2bb7fe41837 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:58.236142 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a92d293-ac0a-42f8-9b12-d2bb7fe41837 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:27:58.237610 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a92d293-ac0a-42f8-9b12-d2bb7fe41837 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:27:58.266945 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8dd774-8bcd-4824-9351-9b8e01533656 None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:27:58.280203 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application [None req-9a92d293-ac0a-42f8-9b12-d2bb7fe41837 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:27:58.280203 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:27:58.280203 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:27:58.280203 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:27:58.280203 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:27:58.280203 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:27:58.280203 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:27:58.280203 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:27:58.280203 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:27:58.280203 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:27:58.280203 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:27:58.280203 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:27:58.280203 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 14:27:58.280203 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 14:27:58.280203 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 14:27:58.281103 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 14:27:58.281103 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:27:58.281103 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:27:58.281103 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:27:58.281103 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:27:58.281103 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:27:58.281103 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:27:58.281103 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:27:58.281103 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application with Lock( May 25 14:27:58.281103 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:27:58.281103 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._enter() May 25 14:27:58.281103 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:27:58.281103 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:27:58.281103 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:27:58.281103 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.creator() May 25 14:27:58.281103 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:27:58.281103 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application created_value = creator( May 25 14:27:58.281955 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 14:27:58.281955 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 14:27:58.281955 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:27:58.281955 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:27:58.281955 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 272/545] 10.222.0.67 () {56 vars in 1108 bytes} [Wed May 25 14:27:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 402 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:27:58.287910 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a92d293-ac0a-42f8-9b12-d2bb7fe41837 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:27:58.305777 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37ae7d7-f4f5-48b7-9b1d-1270b61c499b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:27:58.307241 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37ae7d7-f4f5-48b7-9b1d-1270b61c499b None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:58.307735 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37ae7d7-f4f5-48b7-9b1d-1270b61c499b None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:58.308241 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37ae7d7-f4f5-48b7-9b1d-1270b61c499b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:58.309290 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37ae7d7-f4f5-48b7-9b1d-1270b61c499b None admin] RBAC: Adding query filter params (role.id=85be32e3c1ae4269b5456307e0827cc7, scope.project.id=bfe93ee8d32a441295efc0b885de4bd7, user.id=b68eed985c7b49839bcdd173186ad4ba) {{(pid=80474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:27:58.309810 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37ae7d7-f4f5-48b7-9b1d-1270b61c499b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:27:58.312061 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37ae7d7-f4f5-48b7-9b1d-1270b61c499b None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:27:58.318930 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 274/546] 10.222.0.67 () {56 vars in 1374 bytes} [Wed May 25 14:27:58 2022] GET /identity/v3/role_assignments?user.id=b68eed985c7b49839bcdd173186ad4ba&scope.project.id=bfe93ee8d32a441295efc0b885de4bd7&role.id=85be32e3c1ae4269b5456307e0827cc7 => generated 259 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:27:58.468930 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a92d293-ac0a-42f8-9b12-d2bb7fe41837 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:27:58.497120 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:27:58.505288 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65569313-48aa-4b1f-8c0e-a4ad2da1aff2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:27:58.506494 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65569313-48aa-4b1f-8c0e-a4ad2da1aff2 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:58.507198 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65569313-48aa-4b1f-8c0e-a4ad2da1aff2 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:58.507768 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65569313-48aa-4b1f-8c0e-a4ad2da1aff2 None admin] PATH_INFO: `/v3/domains` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:58.508546 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65569313-48aa-4b1f-8c0e-a4ad2da1aff2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:27:58.509277 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65569313-48aa-4b1f-8c0e-a4ad2da1aff2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:27:58.510696 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65569313-48aa-4b1f-8c0e-a4ad2da1aff2 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:27:58.523623 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 273/547] 10.222.0.67 () {56 vars in 1109 bytes} [Wed May 25 14:27:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:27:58.529056 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37ae7d7-f4f5-48b7-9b1d-1270b61c499b None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:27:58.655582 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37ae7d7-f4f5-48b7-9b1d-1270b61c499b None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:27:58.659339 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:27:58.691793 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fa9ead-5d33-45d5-8059-ebfa62c1ecba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:27:58.692594 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fa9ead-5d33-45d5-8059-ebfa62c1ecba None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:58.692883 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fa9ead-5d33-45d5-8059-ebfa62c1ecba None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:58.693162 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fa9ead-5d33-45d5-8059-ebfa62c1ecba None admin] PATH_INFO: `/v3/users/swift` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:58.700450 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fa9ead-5d33-45d5-8059-ebfa62c1ecba None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:27:58.702644 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fa9ead-5d33-45d5-8059-ebfa62c1ecba None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:27:58.717261 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application [None req-e5fa9ead-5d33-45d5-8059-ebfa62c1ecba None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 25 14:27:58.717261 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:27:58.717261 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:27:58.717261 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:27:58.717261 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:27:58.717261 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:27:58.717261 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:27:58.717261 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:27:58.717261 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:27:58.717261 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:27:58.717261 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:27:58.717261 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:27:58.717261 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 14:27:58.717261 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 14:27:58.717261 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 14:27:58.717261 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 14:27:58.718780 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:27:58.718780 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:27:58.718780 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 14:27:58.718780 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 14:27:58.718780 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 14:27:58.718780 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 14:27:58.718780 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:27:58.718780 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:27:58.718780 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:27:58.718780 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:27:58.718780 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:27:58.718780 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application with Lock( May 25 14:27:58.718780 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:27:58.718780 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self._enter() May 25 14:27:58.718780 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:27:58.718780 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:27:58.718780 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:27:58.718780 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.creator() May 25 14:27:58.720342 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:27:58.720342 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application created_value = creator( May 25 14:27:58.720342 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 14:27:58.720342 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 14:27:58.720342 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 14:27:58.720342 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 14:27:58.720342 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 14:27:58.720342 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 14:27:58.720342 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 25 14:27:58.720342 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application May 25 14:27:58.720342 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 275/548] 10.222.0.67 () {56 vars in 1096 bytes} [Wed May 25 14:27:58 2022] GET /identity/v3/users/swift => generated 83 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:27:58.724153 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65569313-48aa-4b1f-8c0e-a4ad2da1aff2 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:27:58.882156 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65569313-48aa-4b1f-8c0e-a4ad2da1aff2 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:27:58.927458 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083fa68f-98f1-4573-9e0b-74b045662780 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:27:58.928135 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083fa68f-98f1-4573-9e0b-74b045662780 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:58.928418 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083fa68f-98f1-4573-9e0b-74b045662780 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:58.928693 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083fa68f-98f1-4573-9e0b-74b045662780 None admin] PATH_INFO: `/v3/users` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:58.929535 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083fa68f-98f1-4573-9e0b-74b045662780 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:27:58.929845 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083fa68f-98f1-4573-9e0b-74b045662780 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:27:58.931317 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083fa68f-98f1-4573-9e0b-74b045662780 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:27:58.966725 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 274/549] 10.222.0.67 () {56 vars in 1135 bytes} [Wed May 25 14:27:58 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:27:58.973083 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fa9ead-5d33-45d5-8059-ebfa62c1ecba None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:27:59.119400 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fa9ead-5d33-45d5-8059-ebfa62c1ecba None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:27:59.159890 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877f5437-423f-4147-b46d-977bfbb93922 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:27:59.160544 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877f5437-423f-4147-b46d-977bfbb93922 None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:59.160827 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877f5437-423f-4147-b46d-977bfbb93922 None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:59.161100 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877f5437-423f-4147-b46d-977bfbb93922 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:59.194660 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:27:59.197271 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f20e5a-1196-466f-99db-3745225a584a None None] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:59.197801 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f20e5a-1196-466f-99db-3745225a584a None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:59.198285 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f20e5a-1196-466f-99db-3745225a584a None None] PATH_INFO: `/` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:59.202585 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 275/550] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 14:27:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:27:59.208485 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42b0d45-71bd-4107-bdf3-4213dca55855 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:59.209036 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42b0d45-71bd-4107-bdf3-4213dca55855 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:59.209531 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42b0d45-71bd-4107-bdf3-4213dca55855 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:59.227233 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-b42b0d45-71bd-4107-bdf3-4213dca55855 None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:27:59.229657 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-b42b0d45-71bd-4107-bdf3-4213dca55855 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:27:59.257005 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877f5437-423f-4147-b46d-977bfbb93922 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:27:59.258493 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877f5437-423f-4147-b46d-977bfbb93922 None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:27:59.280763 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:27:59.309040 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 276/551] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 14:27:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 14:27:59.333349 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42b0d45-71bd-4107-bdf3-4213dca55855 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:27:59.414023 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 276/552] 10.222.0.67 () {58 vars in 1282 bytes} [Wed May 25 14:27:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 441 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 14:27:59.419688 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877f5437-423f-4147-b46d-977bfbb93922 None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:27:59.512202 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:27:59.560497 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42b0d45-71bd-4107-bdf3-4213dca55855 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:27:59.590728 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877f5437-423f-4147-b46d-977bfbb93922 None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:27:59.605150 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7dea9d-1a5e-46e8-adc1-e49242322133 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:27:59.605948 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7dea9d-1a5e-46e8-adc1-e49242322133 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:59.606227 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7dea9d-1a5e-46e8-adc1-e49242322133 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:59.606498 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7dea9d-1a5e-46e8-adc1-e49242322133 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:59.619892 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7dea9d-1a5e-46e8-adc1-e49242322133 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:27:59.628598 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application [None req-7b7dea9d-1a5e-46e8-adc1-e49242322133 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 25 14:27:59.628598 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:27:59.628598 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:27:59.628598 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:27:59.628598 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:27:59.628598 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:27:59.628598 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:27:59.628598 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:27:59.628598 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:27:59.628598 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:27:59.628598 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:27:59.628598 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:27:59.628598 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:27:59.628598 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:27:59.628598 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:27:59.628598 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:27:59.629667 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:27:59.629667 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:27:59.629667 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:27:59.629667 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:27:59.629667 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:27:59.629667 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:27:59.629667 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:27:59.629667 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:27:59.629667 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:27:59.629667 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:27:59.629667 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:27:59.629667 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application with Lock( May 25 14:27:59.629667 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:27:59.629667 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._enter() May 25 14:27:59.629667 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:27:59.629667 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:27:59.630922 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:27:59.630922 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.creator() May 25 14:27:59.630922 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:27:59.630922 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application created_value = creator( May 25 14:27:59.630922 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:27:59.630922 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:27:59.630922 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:27:59.630922 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:27:59.630922 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:27:59.630922 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:27:59.630922 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 25 14:27:59.630922 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:27:59.630922 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 277/553] 10.222.0.67 () {56 vars in 1102 bytes} [Wed May 25 14:27:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 298 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 14:27:59.631681 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2bcc0d-ad54-497b-b39a-f823d28251a3 None None] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:59.631681 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2bcc0d-ad54-497b-b39a-f823d28251a3 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:59.631937 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2bcc0d-ad54-497b-b39a-f823d28251a3 None None] PATH_INFO: `/` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:59.633528 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 278/554] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 14:27:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:27:59.638603 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9bf5f6-74c5-4b1e-84e4-4788406c794c None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:59.639067 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9bf5f6-74c5-4b1e-84e4-4788406c794c None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:59.639385 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9bf5f6-74c5-4b1e-84e4-4788406c794c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:59.651039 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e628527a-d3a0-41bc-a2e1-992fdc922609 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:27:59.651973 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e628527a-d3a0-41bc-a2e1-992fdc922609 None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:59.652381 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e628527a-d3a0-41bc-a2e1-992fdc922609 None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:59.652761 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e628527a-d3a0-41bc-a2e1-992fdc922609 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:59.659561 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-ad9bf5f6-74c5-4b1e-84e4-4788406c794c None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:27:59.661237 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-ad9bf5f6-74c5-4b1e-84e4-4788406c794c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:27:59.663904 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e628527a-d3a0-41bc-a2e1-992fdc922609 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:27:59.665460 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e628527a-d3a0-41bc-a2e1-992fdc922609 None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:27:59.685268 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application [None req-e628527a-d3a0-41bc-a2e1-992fdc922609 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:27:59.685268 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:27:59.685268 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:27:59.685268 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:27:59.685268 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:27:59.685268 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:27:59.685268 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:27:59.685268 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:27:59.685268 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:27:59.685268 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:27:59.685268 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:27:59.685268 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:27:59.685268 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 14:27:59.685268 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 14:27:59.685268 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 14:27:59.687054 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 14:27:59.687054 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:27:59.687054 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:27:59.687054 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:27:59.687054 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:27:59.687054 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:27:59.687054 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:27:59.687054 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:27:59.687054 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application with Lock( May 25 14:27:59.687054 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:27:59.687054 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self._enter() May 25 14:27:59.687054 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:27:59.687054 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:27:59.687054 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:27:59.687054 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.creator() May 25 14:27:59.687054 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:27:59.687054 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application created_value = creator( May 25 14:27:59.688842 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 14:27:59.688842 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 14:27:59.688842 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:27:59.688842 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application May 25 14:27:59.690108 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 277/555] 10.222.0.67 () {56 vars in 1108 bytes} [Wed May 25 14:27:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 14:27:59.693740 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e628527a-d3a0-41bc-a2e1-992fdc922609 None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:27:59.696636 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:27:59.753211 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 279/556] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 14:27:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 14:27:59.754075 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9bf5f6-74c5-4b1e-84e4-4788406c794c None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:27:59.834888 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e628527a-d3a0-41bc-a2e1-992fdc922609 None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:27:59.867673 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:27:59.886101 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9bf5f6-74c5-4b1e-84e4-4788406c794c None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:27:59.888654 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de4e694-58ae-4f39-93f5-6efb6840414c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:27:59.889844 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de4e694-58ae-4f39-93f5-6efb6840414c None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:59.890282 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de4e694-58ae-4f39-93f5-6efb6840414c None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:59.890731 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de4e694-58ae-4f39-93f5-6efb6840414c None admin] PATH_INFO: `/v3/roles` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:59.891684 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de4e694-58ae-4f39-93f5-6efb6840414c None admin] RBAC: Adding query filter params (name=service) {{(pid=80474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:27:59.892196 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de4e694-58ae-4f39-93f5-6efb6840414c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:27:59.893795 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de4e694-58ae-4f39-93f5-6efb6840414c None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:27:59.903171 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 278/557] 10.222.0.67 () {56 vars in 1103 bytes} [Wed May 25 14:27:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:27:59.904335 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de4e694-58ae-4f39-93f5-6efb6840414c None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:27:59.928390 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ccfa25-7fc7-43ae-aef2-83143584eb80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:27:59.929054 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ccfa25-7fc7-43ae-aef2-83143584eb80 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:59.929362 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ccfa25-7fc7-43ae-aef2-83143584eb80 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:59.929634 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ccfa25-7fc7-43ae-aef2-83143584eb80 None admin] PATH_INFO: `/v3/domains` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:59.931037 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ccfa25-7fc7-43ae-aef2-83143584eb80 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:27:59.931352 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ccfa25-7fc7-43ae-aef2-83143584eb80 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:27:59.932995 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ccfa25-7fc7-43ae-aef2-83143584eb80 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:27:59.949001 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 280/558] 10.222.0.67 () {56 vars in 1109 bytes} [Wed May 25 14:27:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:27:59.949904 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ccfa25-7fc7-43ae-aef2-83143584eb80 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:27:59.992688 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:00.025789 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de4e694-58ae-4f39-93f5-6efb6840414c None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:00.063386 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2daa34f-85ee-4d88-847e-8498c2f9fdc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:00.064546 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2daa34f-85ee-4d88-847e-8498c2f9fdc5 None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:00.065046 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2daa34f-85ee-4d88-847e-8498c2f9fdc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:00.065536 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2daa34f-85ee-4d88-847e-8498c2f9fdc5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:00.076827 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2daa34f-85ee-4d88-847e-8498c2f9fdc5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:28:00.085477 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application [None req-e2daa34f-85ee-4d88-847e-8498c2f9fdc5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 25 14:28:00.085477 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:28:00.085477 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:28:00.085477 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:28:00.085477 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:28:00.085477 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:28:00.085477 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:28:00.085477 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:28:00.085477 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:28:00.085477 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:28:00.085477 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:28:00.085477 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:28:00.085477 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:28:00.085477 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:28:00.085477 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:28:00.085477 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:28:00.086856 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:28:00.086856 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:28:00.086856 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:28:00.086856 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:28:00.086856 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:28:00.086856 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:28:00.086856 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:28:00.086856 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:28:00.086856 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:28:00.086856 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:28:00.086856 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:28:00.086856 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application with Lock( May 25 14:28:00.086856 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:28:00.086856 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self._enter() May 25 14:28:00.086856 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:28:00.086856 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:28:00.087735 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:28:00.087735 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.creator() May 25 14:28:00.087735 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:28:00.087735 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application created_value = creator( May 25 14:28:00.087735 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:28:00.087735 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:28:00.087735 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:28:00.087735 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:28:00.087735 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:28:00.087735 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:28:00.087735 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 25 14:28:00.087735 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application May 25 14:28:00.090108 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 279/559] 10.222.0.67 () {56 vars in 1102 bytes} [Wed May 25 14:27:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:28:00.094933 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ccfa25-7fc7-43ae-aef2-83143584eb80 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:00.096121 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2daa34f-85ee-4d88-847e-8498c2f9fdc5 None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:00.144888 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7ced68-dafb-40c1-91d9-8b701b3e261b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:00.146116 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7ced68-dafb-40c1-91d9-8b701b3e261b None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:00.146610 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7ced68-dafb-40c1-91d9-8b701b3e261b None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:00.147152 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7ced68-dafb-40c1-91d9-8b701b3e261b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:00.147933 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:00.161138 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7ced68-dafb-40c1-91d9-8b701b3e261b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:00.163277 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7ced68-dafb-40c1-91d9-8b701b3e261b None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:00.183758 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application [None req-ed7ced68-dafb-40c1-91d9-8b701b3e261b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:28:00.183758 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:28:00.183758 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:28:00.183758 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:28:00.183758 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:28:00.183758 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:28:00.183758 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:28:00.183758 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:28:00.183758 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:28:00.183758 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:28:00.183758 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:28:00.183758 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:28:00.183758 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 14:28:00.183758 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 14:28:00.183758 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 14:28:00.184805 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 14:28:00.184805 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:28:00.184805 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:28:00.184805 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:28:00.184805 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:28:00.184805 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:28:00.184805 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:28:00.184805 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:28:00.184805 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application with Lock( May 25 14:28:00.184805 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:28:00.184805 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._enter() May 25 14:28:00.184805 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:28:00.184805 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:28:00.184805 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:28:00.184805 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.creator() May 25 14:28:00.184805 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:28:00.184805 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application created_value = creator( May 25 14:28:00.185713 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 14:28:00.185713 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 14:28:00.185713 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:28:00.185713 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:28:00.188868 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 281/560] 10.222.0.67 () {56 vars in 1108 bytes} [Wed May 25 14:27:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:28:00.189967 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7ced68-dafb-40c1-91d9-8b701b3e261b None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:00.225340 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2daa34f-85ee-4d88-847e-8498c2f9fdc5 None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:00.271885 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ce1525-76b0-4d1b-800e-60ce4fe96015 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:00.272692 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ce1525-76b0-4d1b-800e-60ce4fe96015 None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:00.272978 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ce1525-76b0-4d1b-800e-60ce4fe96015 None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:00.273256 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ce1525-76b0-4d1b-800e-60ce4fe96015 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:00.283329 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ce1525-76b0-4d1b-800e-60ce4fe96015 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:00.284849 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ce1525-76b0-4d1b-800e-60ce4fe96015 None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:00.287025 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:00.307844 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application [None req-46ce1525-76b0-4d1b-800e-60ce4fe96015 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 14:28:00.307844 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:28:00.307844 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:28:00.307844 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:28:00.307844 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:28:00.307844 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:28:00.307844 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:28:00.307844 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:28:00.307844 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:28:00.307844 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:28:00.307844 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:28:00.307844 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:28:00.307844 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 14:28:00.307844 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 14:28:00.307844 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 14:28:00.308838 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 14:28:00.308838 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:28:00.308838 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:28:00.308838 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:28:00.308838 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:28:00.308838 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:28:00.308838 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:28:00.308838 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:28:00.308838 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application with Lock( May 25 14:28:00.308838 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:28:00.308838 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self._enter() May 25 14:28:00.308838 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:28:00.308838 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:28:00.308838 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:28:00.308838 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.creator() May 25 14:28:00.308838 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:28:00.308838 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application created_value = creator( May 25 14:28:00.309778 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 14:28:00.309778 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 14:28:00.309778 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 14:28:00.309778 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 14:28:00.309778 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 14:28:00.309778 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 14:28:00.309778 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 14:28:00.309778 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application May 25 14:28:00.313653 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 280/561] 10.222.0.67 () {56 vars in 1111 bytes} [Wed May 25 14:28:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:28:00.314889 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ce1525-76b0-4d1b-800e-60ce4fe96015 None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:00.320634 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7ced68-dafb-40c1-91d9-8b701b3e261b None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:00.358556 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163739c5-e040-403e-b312-38450d91e29f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:00.359182 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163739c5-e040-403e-b312-38450d91e29f None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:00.359600 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163739c5-e040-403e-b312-38450d91e29f None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:00.359885 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163739c5-e040-403e-b312-38450d91e29f None admin] PATH_INFO: `/v3/roles` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:00.360641 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163739c5-e040-403e-b312-38450d91e29f None admin] RBAC: Adding query filter params (name=service) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:28:00.360953 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163739c5-e040-403e-b312-38450d91e29f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:00.362348 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163739c5-e040-403e-b312-38450d91e29f None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:00.375821 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 282/562] 10.222.0.67 () {56 vars in 1103 bytes} [Wed May 25 14:28:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:28:00.375821 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764c3704-0fdc-4f3d-80e1-50cd40b8097c None None] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:00.375821 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764c3704-0fdc-4f3d-80e1-50cd40b8097c None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:00.375821 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764c3704-0fdc-4f3d-80e1-50cd40b8097c None None] PATH_INFO: `/` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:00.375821 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 283/563] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 14:28:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:28:00.375821 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764c3704-0fdc-4f3d-80e1-50cd40b8097c None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:00.439304 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:00.443129 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ce1525-76b0-4d1b-800e-60ce4fe96015 None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:00.481471 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c3e99e-dd35-49da-8fa6-cad7beec1427 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:00.482093 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c3e99e-dd35-49da-8fa6-cad7beec1427 None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:00.482382 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c3e99e-dd35-49da-8fa6-cad7beec1427 None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:00.482861 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c3e99e-dd35-49da-8fa6-cad7beec1427 None admin] PATH_INFO: `/v3/domains` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:00.483465 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c3e99e-dd35-49da-8fa6-cad7beec1427 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:28:00.483770 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c3e99e-dd35-49da-8fa6-cad7beec1427 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:00.485155 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c3e99e-dd35-49da-8fa6-cad7beec1427 None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:00.486799 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764c3704-0fdc-4f3d-80e1-50cd40b8097c None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:00.502467 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 281/564] 10.222.0.67 () {56 vars in 1109 bytes} [Wed May 25 14:28:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:28:00.502467 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c3e99e-dd35-49da-8fa6-cad7beec1427 None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:00.527927 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0848aa-a4b9-4995-94a2-e2ea833785db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:00.528625 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0848aa-a4b9-4995-94a2-e2ea833785db None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:00.528912 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0848aa-a4b9-4995-94a2-e2ea833785db None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:00.529192 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0848aa-a4b9-4995-94a2-e2ea833785db None admin] PATH_INFO: `/v3/projects` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:00.530010 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0848aa-a4b9-4995-94a2-e2ea833785db None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:28:00.530317 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0848aa-a4b9-4995-94a2-e2ea833785db None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:00.531791 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0848aa-a4b9-4995-94a2-e2ea833785db None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:00.541428 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:00.550416 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 284/565] 10.222.0.67 () {56 vars in 1148 bytes} [Wed May 25 14:28:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:28:00.551862 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b928e5b-e3a3-487b-a99a-794382072f62 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:00.552181 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b928e5b-e3a3-487b-a99a-794382072f62 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:00.552478 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b928e5b-e3a3-487b-a99a-794382072f62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:00.570544 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-5b928e5b-e3a3-487b-a99a-794382072f62 None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:28:00.571770 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-5b928e5b-e3a3-487b-a99a-794382072f62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:28:00.615411 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c3e99e-dd35-49da-8fa6-cad7beec1427 None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:00.643626 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 285/566] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 14:28:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 14:28:00.651208 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4620ad2-8792-4464-8e65-afeeb12a6754 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:00.652120 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4620ad2-8792-4464-8e65-afeeb12a6754 None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:00.652406 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b928e5b-e3a3-487b-a99a-794382072f62 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:00.652528 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4620ad2-8792-4464-8e65-afeeb12a6754 None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:00.652797 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4620ad2-8792-4464-8e65-afeeb12a6754 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:00.664416 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4620ad2-8792-4464-8e65-afeeb12a6754 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:00.666347 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4620ad2-8792-4464-8e65-afeeb12a6754 None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:00.686446 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application [None req-f4620ad2-8792-4464-8e65-afeeb12a6754 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:28:00.686446 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:28:00.686446 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:28:00.686446 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:28:00.686446 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:28:00.686446 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:28:00.686446 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:28:00.686446 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:28:00.686446 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:28:00.686446 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:28:00.686446 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:28:00.686446 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:28:00.686446 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 14:28:00.686446 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 14:28:00.686446 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 14:28:00.687465 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 14:28:00.687465 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:28:00.687465 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:28:00.687465 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:28:00.687465 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:28:00.687465 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:28:00.687465 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:28:00.687465 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:28:00.687465 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application with Lock( May 25 14:28:00.687465 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:28:00.687465 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self._enter() May 25 14:28:00.687465 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:28:00.687465 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:28:00.687465 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:28:00.687465 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.creator() May 25 14:28:00.687465 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:28:00.687465 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application created_value = creator( May 25 14:28:00.688395 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 14:28:00.688395 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 14:28:00.688395 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:28:00.688395 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application May 25 14:28:00.692527 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 282/567] 10.222.0.67 () {56 vars in 1108 bytes} [Wed May 25 14:28:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:28:00.693358 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4620ad2-8792-4464-8e65-afeeb12a6754 None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:00.706745 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:00.780825 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b928e5b-e3a3-487b-a99a-794382072f62 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:00.804402 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4620ad2-8792-4464-8e65-afeeb12a6754 None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:00.809190 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:00.815683 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb821f9-0423-4c0a-afdf-86ffe7d3295d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:00.816483 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb821f9-0423-4c0a-afdf-86ffe7d3295d None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:00.816762 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb821f9-0423-4c0a-afdf-86ffe7d3295d None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:00.817036 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb821f9-0423-4c0a-afdf-86ffe7d3295d None admin] PATH_INFO: `/v3/users/nova` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:00.828013 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb821f9-0423-4c0a-afdf-86ffe7d3295d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:00.830279 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb821f9-0423-4c0a-afdf-86ffe7d3295d None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:00.843816 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0509b63a-1479-47c3-86a1-b7cb6b5bf937 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:00.844478 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0509b63a-1479-47c3-86a1-b7cb6b5bf937 None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:00.844764 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0509b63a-1479-47c3-86a1-b7cb6b5bf937 None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:00.845143 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0509b63a-1479-47c3-86a1-b7cb6b5bf937 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:00.845918 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application [None req-0eb821f9-0423-4c0a-afdf-86ffe7d3295d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 25 14:28:00.845918 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:28:00.845918 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:28:00.845918 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:28:00.845918 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:28:00.845918 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:28:00.845918 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:28:00.845918 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:28:00.845918 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:28:00.845918 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:28:00.845918 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:28:00.845918 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:28:00.845918 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 14:28:00.845918 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 14:28:00.845918 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 14:28:00.845918 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 14:28:00.846845 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:28:00.846845 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:28:00.846845 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 14:28:00.846845 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 14:28:00.846845 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 14:28:00.846845 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 14:28:00.846845 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:28:00.846845 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:28:00.846845 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:28:00.846845 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:28:00.846845 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:28:00.846845 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application with Lock( May 25 14:28:00.846845 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:28:00.846845 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._enter() May 25 14:28:00.846845 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:28:00.846845 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:28:00.846845 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:28:00.846845 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.creator() May 25 14:28:00.848756 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:28:00.848756 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application created_value = creator( May 25 14:28:00.848756 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 14:28:00.848756 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 14:28:00.848756 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 14:28:00.848756 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 14:28:00.848756 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 14:28:00.848756 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 14:28:00.848756 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 25 14:28:00.848756 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:28:00.849316 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0509b63a-1479-47c3-86a1-b7cb6b5bf937 None admin] RBAC: Adding query filter params (role.id=85be32e3c1ae4269b5456307e0827cc7, scope.project.id=bfe93ee8d32a441295efc0b885de4bd7, user.id=dbe9e38881834198842a476889678096) {{(pid=80474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:28:00.849316 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0509b63a-1479-47c3-86a1-b7cb6b5bf937 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:00.849463 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 286/568] 10.222.0.67 () {56 vars in 1093 bytes} [Wed May 25 14:28:00 2022] GET /identity/v3/users/nova => generated 82 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:28:00.849463 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb821f9-0423-4c0a-afdf-86ffe7d3295d None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:00.851674 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0509b63a-1479-47c3-86a1-b7cb6b5bf937 None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:00.857972 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 283/569] 10.222.0.67 () {56 vars in 1374 bytes} [Wed May 25 14:28:00 2022] GET /identity/v3/role_assignments?user.id=dbe9e38881834198842a476889678096&scope.project.id=bfe93ee8d32a441295efc0b885de4bd7&role.id=85be32e3c1ae4269b5456307e0827cc7 => generated 259 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:28:00.859717 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0509b63a-1479-47c3-86a1-b7cb6b5bf937 None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:00.951612 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:00.964274 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb821f9-0423-4c0a-afdf-86ffe7d3295d None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:00.982050 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0509b63a-1479-47c3-86a1-b7cb6b5bf937 None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:01.004095 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9a26ba-b410-48d4-9c14-5fb7120f56f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:01.005384 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9a26ba-b410-48d4-9c14-5fb7120f56f9 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:01.005919 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9a26ba-b410-48d4-9c14-5fb7120f56f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:01.006281 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9a26ba-b410-48d4-9c14-5fb7120f56f9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:01.019365 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9a26ba-b410-48d4-9c14-5fb7120f56f9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:28:01.024398 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967ce924-9b3b-40c6-b31e-6b8977d417c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:01.025086 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967ce924-9b3b-40c6-b31e-6b8977d417c7 None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:01.025376 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967ce924-9b3b-40c6-b31e-6b8977d417c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:01.025659 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967ce924-9b3b-40c6-b31e-6b8977d417c7 None admin] PATH_INFO: `/v3/domains` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:01.026407 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967ce924-9b3b-40c6-b31e-6b8977d417c7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:28:01.026722 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967ce924-9b3b-40c6-b31e-6b8977d417c7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:01.027163 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application [None req-6b9a26ba-b410-48d4-9c14-5fb7120f56f9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 25 14:28:01.027163 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:28:01.027163 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:28:01.027163 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:28:01.027163 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:28:01.027163 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:28:01.027163 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:28:01.027163 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:28:01.027163 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:28:01.027163 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:28:01.027163 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:28:01.027163 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:28:01.027163 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:28:01.027163 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:28:01.027163 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:28:01.027163 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:28:01.028096 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:28:01.028096 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:28:01.028096 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:28:01.028096 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:28:01.028096 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:28:01.028096 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:28:01.028096 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:28:01.028096 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:28:01.028096 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:28:01.028096 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:28:01.028096 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:28:01.028096 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application with Lock( May 25 14:28:01.028096 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:28:01.028096 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._enter() May 25 14:28:01.028096 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:28:01.028096 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:28:01.034623 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:28:01.034623 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.creator() May 25 14:28:01.034623 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:28:01.034623 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application created_value = creator( May 25 14:28:01.034623 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:28:01.034623 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:28:01.034623 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:28:01.034623 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:28:01.034623 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:28:01.034623 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:28:01.034623 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 25 14:28:01.034623 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:28:01.035344 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967ce924-9b3b-40c6-b31e-6b8977d417c7 None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:01.035422 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 287/570] 10.222.0.67 () {56 vars in 1102 bytes} [Wed May 25 14:28:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:28:01.035422 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9a26ba-b410-48d4-9c14-5fb7120f56f9 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:01.049974 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 284/571] 10.222.0.67 () {56 vars in 1109 bytes} [Wed May 25 14:28:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:28:01.051206 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d763cb0-8662-4e39-b75f-efbaf3c68168 None None] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:01.051497 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d763cb0-8662-4e39-b75f-efbaf3c68168 None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:01.051773 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d763cb0-8662-4e39-b75f-efbaf3c68168 None None] PATH_INFO: `/` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:01.052995 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 285/572] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 14:28:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:28:01.053678 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d763cb0-8662-4e39-b75f-efbaf3c68168 None None] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:01.097434 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:01.178138 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9a26ba-b410-48d4-9c14-5fb7120f56f9 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:01.213166 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d763cb0-8662-4e39-b75f-efbaf3c68168 None None] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:01.230379 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8678aba9-30e2-4619-ad17-9b4944e380e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:01.231426 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8678aba9-30e2-4619-ad17-9b4944e380e5 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:01.231901 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8678aba9-30e2-4619-ad17-9b4944e380e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:01.232374 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8678aba9-30e2-4619-ad17-9b4944e380e5 None admin] PATH_INFO: `/v3/users` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:01.234413 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8678aba9-30e2-4619-ad17-9b4944e380e5 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:28:01.234950 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8678aba9-30e2-4619-ad17-9b4944e380e5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:01.237537 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8678aba9-30e2-4619-ad17-9b4944e380e5 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:01.265488 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 288/573] 10.222.0.67 () {56 vars in 1133 bytes} [Wed May 25 14:28:01 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:28:01.266638 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8678aba9-30e2-4619-ad17-9b4944e380e5 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:01.272846 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7cdcce-4011-45a9-968c-8944af551f21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:01.274214 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7cdcce-4011-45a9-968c-8944af551f21 None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:01.274771 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7cdcce-4011-45a9-968c-8944af551f21 None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:01.275213 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7cdcce-4011-45a9-968c-8944af551f21 None admin] PATH_INFO: `/v3/roles` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:01.276512 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7cdcce-4011-45a9-968c-8944af551f21 None admin] RBAC: Adding query filter params (name=service) {{(pid=80474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:28:01.277020 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7cdcce-4011-45a9-968c-8944af551f21 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:01.279391 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7cdcce-4011-45a9-968c-8944af551f21 None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:01.282147 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:01.295375 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 286/574] 10.222.0.67 () {56 vars in 1103 bytes} [Wed May 25 14:28:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:28:01.304899 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295a434c-dcda-4434-a33b-a387f25d18d4 None None] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:01.305314 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295a434c-dcda-4434-a33b-a387f25d18d4 None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:01.305793 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295a434c-dcda-4434-a33b-a387f25d18d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:01.331911 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.auth.core [None req-295a434c-dcda-4434-a33b-a387f25d18d4 None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:28:01.333851 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-295a434c-dcda-4434-a33b-a387f25d18d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:28:01.433565 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8678aba9-30e2-4619-ad17-9b4944e380e5 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:01.447179 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 287/575] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 14:28:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 14:28:01.447179 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295a434c-dcda-4434-a33b-a387f25d18d4 None None] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:01.457462 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:01.485246 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64f84c2-3b83-4942-8ca1-b41df9d2db11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:01.486067 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64f84c2-3b83-4942-8ca1-b41df9d2db11 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:01.486356 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64f84c2-3b83-4942-8ca1-b41df9d2db11 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:01.486627 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64f84c2-3b83-4942-8ca1-b41df9d2db11 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:01.499059 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64f84c2-3b83-4942-8ca1-b41df9d2db11 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:01.501098 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64f84c2-3b83-4942-8ca1-b41df9d2db11 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:01.518231 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application [None req-f64f84c2-3b83-4942-8ca1-b41df9d2db11 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 25 14:28:01.518231 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:28:01.518231 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:28:01.518231 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:28:01.518231 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:28:01.518231 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:28:01.518231 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:28:01.518231 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:28:01.518231 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:28:01.518231 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:28:01.518231 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:28:01.518231 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:28:01.518231 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 14:28:01.518231 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 14:28:01.518231 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 14:28:01.518231 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 14:28:01.519396 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:28:01.519396 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:28:01.519396 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 14:28:01.519396 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 14:28:01.519396 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 14:28:01.519396 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 14:28:01.519396 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:28:01.519396 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:28:01.519396 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:28:01.519396 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:28:01.519396 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:28:01.519396 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application with Lock( May 25 14:28:01.519396 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:28:01.519396 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._enter() May 25 14:28:01.519396 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:28:01.519396 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:28:01.519396 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:28:01.519396 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.creator() May 25 14:28:01.520421 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:28:01.520421 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application created_value = creator( May 25 14:28:01.520421 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 14:28:01.520421 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 14:28:01.520421 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 14:28:01.520421 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 14:28:01.520421 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 14:28:01.520421 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 14:28:01.520421 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 25 14:28:01.520421 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:28:01.520421 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 289/576] 10.222.0.67 () {56 vars in 1099 bytes} [Wed May 25 14:28:01 2022] GET /identity/v3/users/glance => generated 84 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:28:01.520421 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64f84c2-3b83-4942-8ca1-b41df9d2db11 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:01.567703 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295a434c-dcda-4434-a33b-a387f25d18d4 None None] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:01.597380 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:01.608886 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d6a1ad-4340-4f91-97c2-ac0b43ed02ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:01.609879 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d6a1ad-4340-4f91-97c2-ac0b43ed02ef None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:01.610235 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d6a1ad-4340-4f91-97c2-ac0b43ed02ef None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:01.610684 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d6a1ad-4340-4f91-97c2-ac0b43ed02ef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:01.621910 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d6a1ad-4340-4f91-97c2-ac0b43ed02ef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:01.623821 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d6a1ad-4340-4f91-97c2-ac0b43ed02ef None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:01.628989 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64f84c2-3b83-4942-8ca1-b41df9d2db11 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:01.643897 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application [None req-f3d6a1ad-4340-4f91-97c2-ac0b43ed02ef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:28:01.643897 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:28:01.643897 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:28:01.643897 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:28:01.643897 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:28:01.643897 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:28:01.643897 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:28:01.643897 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:28:01.643897 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:28:01.643897 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:28:01.643897 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:28:01.643897 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:28:01.643897 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 14:28:01.643897 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 14:28:01.643897 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 14:28:01.645000 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 14:28:01.645000 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:28:01.645000 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:28:01.645000 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:28:01.645000 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:28:01.645000 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:28:01.645000 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:28:01.645000 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:28:01.645000 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application with Lock( May 25 14:28:01.645000 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:28:01.645000 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self._enter() May 25 14:28:01.645000 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:28:01.645000 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:28:01.645000 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:28:01.645000 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.creator() May 25 14:28:01.645000 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:28:01.645000 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application created_value = creator( May 25 14:28:01.650354 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 14:28:01.650354 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 14:28:01.650354 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:28:01.650354 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application May 25 14:28:01.650354 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 288/577] 10.222.0.67 () {56 vars in 1108 bytes} [Wed May 25 14:28:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:28:01.650354 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d6a1ad-4340-4f91-97c2-ac0b43ed02ef None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:01.670950 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278ffe4a-b443-4047-9f04-ce44d2826577 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:01.671947 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278ffe4a-b443-4047-9f04-ce44d2826577 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:01.672296 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278ffe4a-b443-4047-9f04-ce44d2826577 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:01.672634 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278ffe4a-b443-4047-9f04-ce44d2826577 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:01.683291 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278ffe4a-b443-4047-9f04-ce44d2826577 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:01.684886 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278ffe4a-b443-4047-9f04-ce44d2826577 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:01.702933 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application [None req-278ffe4a-b443-4047-9f04-ce44d2826577 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:28:01.702933 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:28:01.702933 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:28:01.702933 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:28:01.702933 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:28:01.702933 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:28:01.702933 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:28:01.702933 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:28:01.702933 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:28:01.702933 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:28:01.702933 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:28:01.702933 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:28:01.702933 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 14:28:01.702933 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 14:28:01.702933 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 14:28:01.704063 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 14:28:01.704063 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:28:01.704063 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:28:01.704063 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:28:01.704063 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:28:01.704063 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:28:01.704063 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:28:01.704063 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:28:01.704063 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application with Lock( May 25 14:28:01.704063 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:28:01.704063 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._enter() May 25 14:28:01.704063 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:28:01.704063 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:28:01.704063 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:28:01.704063 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.creator() May 25 14:28:01.704063 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:28:01.704063 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application created_value = creator( May 25 14:28:01.705160 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 14:28:01.705160 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 14:28:01.705160 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:28:01.705160 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:28:01.710157 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 290/578] 10.222.0.67 () {56 vars in 1108 bytes} [Wed May 25 14:28:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:28:01.710157 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278ffe4a-b443-4047-9f04-ce44d2826577 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:01.732010 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:01.767409 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d6a1ad-4340-4f91-97c2-ac0b43ed02ef None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:01.803776 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa32364-cde4-47de-9ffb-7ce12c95f75f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:01.804723 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa32364-cde4-47de-9ffb-7ce12c95f75f None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:01.805010 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa32364-cde4-47de-9ffb-7ce12c95f75f None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:01.805382 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa32364-cde4-47de-9ffb-7ce12c95f75f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:01.814980 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278ffe4a-b443-4047-9f04-ce44d2826577 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:01.815700 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa32364-cde4-47de-9ffb-7ce12c95f75f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:28:01.824067 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application [None req-0aa32364-cde4-47de-9ffb-7ce12c95f75f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 25 14:28:01.824067 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:28:01.824067 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:28:01.824067 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:28:01.824067 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:28:01.824067 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:28:01.824067 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:28:01.824067 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:28:01.824067 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:28:01.824067 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:28:01.824067 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:28:01.824067 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:28:01.824067 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:28:01.824067 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:28:01.824067 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:28:01.824067 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:28:01.825016 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:28:01.825016 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:28:01.825016 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:28:01.825016 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:28:01.825016 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:28:01.825016 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:28:01.825016 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:28:01.825016 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:28:01.825016 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:28:01.825016 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:28:01.825016 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:28:01.825016 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application with Lock( May 25 14:28:01.825016 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:28:01.825016 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self._enter() May 25 14:28:01.825016 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:28:01.825016 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:28:01.825884 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:28:01.825884 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.creator() May 25 14:28:01.825884 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:28:01.825884 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application created_value = creator( May 25 14:28:01.825884 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:28:01.825884 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:28:01.825884 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:28:01.825884 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:28:01.825884 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:28:01.825884 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:28:01.825884 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 25 14:28:01.825884 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application May 25 14:28:01.830634 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 289/579] 10.222.0.67 () {56 vars in 1102 bytes} [Wed May 25 14:28:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:28:01.831582 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa32364-cde4-47de-9ffb-7ce12c95f75f None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:01.857747 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f30c9a-89dd-41a1-9653-b33ff55d6859 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:01.858716 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f30c9a-89dd-41a1-9653-b33ff55d6859 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:01.859228 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f30c9a-89dd-41a1-9653-b33ff55d6859 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:01.859711 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f30c9a-89dd-41a1-9653-b33ff55d6859 None admin] PATH_INFO: `/v3/users` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:01.860750 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f30c9a-89dd-41a1-9653-b33ff55d6859 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:28:01.861244 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f30c9a-89dd-41a1-9653-b33ff55d6859 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:01.862845 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f30c9a-89dd-41a1-9653-b33ff55d6859 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:01.872786 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:01.882004 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 291/580] 10.222.0.67 () {56 vars in 1137 bytes} [Wed May 25 14:28:01 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:28:01.883016 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f30c9a-89dd-41a1-9653-b33ff55d6859 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:01.944923 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa32364-cde4-47de-9ffb-7ce12c95f75f None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:01.966049 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:01.984064 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758fa5e2-3f5e-4832-ab6a-de9f45c70365 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:01.984738 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758fa5e2-3f5e-4832-ab6a-de9f45c70365 None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:01.985020 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758fa5e2-3f5e-4832-ab6a-de9f45c70365 None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:01.985290 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758fa5e2-3f5e-4832-ab6a-de9f45c70365 None admin] PATH_INFO: `/v3/domains` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:01.986021 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758fa5e2-3f5e-4832-ab6a-de9f45c70365 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:28:01.986326 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758fa5e2-3f5e-4832-ab6a-de9f45c70365 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:01.987726 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758fa5e2-3f5e-4832-ab6a-de9f45c70365 None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:01.991257 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f30c9a-89dd-41a1-9653-b33ff55d6859 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:02.000649 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 290/581] 10.222.0.67 () {56 vars in 1109 bytes} [Wed May 25 14:28:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:28:02.004663 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758fa5e2-3f5e-4832-ab6a-de9f45c70365 None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:02.028348 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f718f3-48dc-4b8d-a1ee-1b2c3c1718c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:02.028942 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f718f3-48dc-4b8d-a1ee-1b2c3c1718c6 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:02.029224 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f718f3-48dc-4b8d-a1ee-1b2c3c1718c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:02.029495 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f718f3-48dc-4b8d-a1ee-1b2c3c1718c6 None admin] PATH_INFO: `/v3/domains` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:02.030538 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f718f3-48dc-4b8d-a1ee-1b2c3c1718c6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:28:02.030970 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f718f3-48dc-4b8d-a1ee-1b2c3c1718c6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:02.032362 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f718f3-48dc-4b8d-a1ee-1b2c3c1718c6 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:02.047108 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 292/582] 10.222.0.67 () {56 vars in 1109 bytes} [Wed May 25 14:28:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:28:02.047108 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f718f3-48dc-4b8d-a1ee-1b2c3c1718c6 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:02.118125 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:02.122363 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758fa5e2-3f5e-4832-ab6a-de9f45c70365 None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:02.160691 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f718f3-48dc-4b8d-a1ee-1b2c3c1718c6 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:02.163848 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5b5ed8-e24c-44a7-8bfa-7d2dfd94c278 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:02.164617 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5b5ed8-e24c-44a7-8bfa-7d2dfd94c278 None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:02.165001 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5b5ed8-e24c-44a7-8bfa-7d2dfd94c278 None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:02.165395 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5b5ed8-e24c-44a7-8bfa-7d2dfd94c278 None admin] PATH_INFO: `/v3/roles` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:02.166244 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5b5ed8-e24c-44a7-8bfa-7d2dfd94c278 None admin] RBAC: Adding query filter params (name=service) {{(pid=80474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:28:02.166652 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5b5ed8-e24c-44a7-8bfa-7d2dfd94c278 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:02.168162 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5b5ed8-e24c-44a7-8bfa-7d2dfd94c278 None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:02.182685 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 291/583] 10.222.0.67 () {56 vars in 1103 bytes} [Wed May 25 14:28:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:28:02.182685 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5b5ed8-e24c-44a7-8bfa-7d2dfd94c278 None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:02.207691 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fbd379-39e9-4eb1-9869-4ba2518516e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:02.208563 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fbd379-39e9-4eb1-9869-4ba2518516e2 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:02.208913 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fbd379-39e9-4eb1-9869-4ba2518516e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:02.209278 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fbd379-39e9-4eb1-9869-4ba2518516e2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:02.218201 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:02.223154 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fbd379-39e9-4eb1-9869-4ba2518516e2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:02.224792 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fbd379-39e9-4eb1-9869-4ba2518516e2 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:02.243605 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application [None req-32fbd379-39e9-4eb1-9869-4ba2518516e2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:28:02.243605 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:28:02.243605 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:28:02.243605 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:28:02.243605 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:28:02.243605 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:28:02.243605 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:28:02.243605 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:28:02.243605 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:28:02.243605 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:28:02.243605 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:28:02.243605 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:28:02.243605 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 14:28:02.243605 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 14:28:02.243605 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 14:28:02.244529 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 14:28:02.244529 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:28:02.244529 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:28:02.244529 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:28:02.244529 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:28:02.244529 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:28:02.244529 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:28:02.244529 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:28:02.244529 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application with Lock( May 25 14:28:02.244529 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:28:02.244529 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._enter() May 25 14:28:02.244529 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:28:02.244529 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:28:02.244529 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:28:02.244529 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.creator() May 25 14:28:02.244529 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:28:02.244529 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application created_value = creator( May 25 14:28:02.245475 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 14:28:02.245475 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 14:28:02.245475 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:28:02.245475 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:28:02.245475 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 293/584] 10.222.0.67 () {56 vars in 1108 bytes} [Wed May 25 14:28:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:28:02.245764 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fbd379-39e9-4eb1-9869-4ba2518516e2 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:02.285033 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5b5ed8-e24c-44a7-8bfa-7d2dfd94c278 None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:02.318449 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2de5bf-9f3c-4029-8a64-081204295505 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:02.319563 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2de5bf-9f3c-4029-8a64-081204295505 None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:02.320053 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2de5bf-9f3c-4029-8a64-081204295505 None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:02.320522 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2de5bf-9f3c-4029-8a64-081204295505 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:02.328186 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2de5bf-9f3c-4029-8a64-081204295505 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:02.329955 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2de5bf-9f3c-4029-8a64-081204295505 None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:02.344484 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application [None req-1c2de5bf-9f3c-4029-8a64-081204295505 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 14:28:02.344484 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:28:02.344484 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:28:02.344484 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:28:02.344484 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:28:02.344484 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:28:02.344484 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:28:02.344484 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:28:02.344484 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:28:02.344484 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:28:02.344484 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:28:02.344484 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:28:02.344484 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 14:28:02.344484 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 14:28:02.344484 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 14:28:02.345403 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 14:28:02.345403 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:28:02.345403 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:28:02.345403 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:28:02.345403 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:28:02.345403 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:28:02.345403 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:28:02.345403 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:28:02.345403 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application with Lock( May 25 14:28:02.345403 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:28:02.345403 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self._enter() May 25 14:28:02.345403 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:28:02.345403 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:28:02.345403 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:28:02.345403 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.creator() May 25 14:28:02.345403 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:28:02.345403 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application created_value = creator( May 25 14:28:02.346310 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 14:28:02.346310 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 14:28:02.346310 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 14:28:02.346310 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 14:28:02.346310 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 14:28:02.346310 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 14:28:02.346310 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 14:28:02.346310 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application May 25 14:28:02.350308 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 292/585] 10.222.0.67 () {56 vars in 1111 bytes} [Wed May 25 14:28:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:28:02.351151 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2de5bf-9f3c-4029-8a64-081204295505 None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:02.352292 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fbd379-39e9-4eb1-9869-4ba2518516e2 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:02.375378 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:02.391096 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74caa546-70a2-4a02-b959-185be721231c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:02.391891 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74caa546-70a2-4a02-b959-185be721231c None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:02.392175 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74caa546-70a2-4a02-b959-185be721231c None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:02.392451 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74caa546-70a2-4a02-b959-185be721231c None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:02.400374 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74caa546-70a2-4a02-b959-185be721231c None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:02.402041 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74caa546-70a2-4a02-b959-185be721231c None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:02.416927 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application [None req-74caa546-70a2-4a02-b959-185be721231c None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 25 14:28:02.416927 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:28:02.416927 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:28:02.416927 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:28:02.416927 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:28:02.416927 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:28:02.416927 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:28:02.416927 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:28:02.416927 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:28:02.416927 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:28:02.416927 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:28:02.416927 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:28:02.416927 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 14:28:02.416927 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 14:28:02.416927 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 14:28:02.416927 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 14:28:02.417900 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:28:02.417900 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:28:02.417900 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 14:28:02.417900 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 14:28:02.417900 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 14:28:02.417900 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 14:28:02.417900 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:28:02.417900 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:28:02.417900 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:28:02.417900 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:28:02.417900 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:28:02.417900 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application with Lock( May 25 14:28:02.417900 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:28:02.417900 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._enter() May 25 14:28:02.417900 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:28:02.417900 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:28:02.417900 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:28:02.417900 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.creator() May 25 14:28:02.418850 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:28:02.418850 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application created_value = creator( May 25 14:28:02.418850 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 14:28:02.418850 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 14:28:02.418850 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 14:28:02.418850 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 14:28:02.418850 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 14:28:02.418850 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 14:28:02.418850 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 25 14:28:02.418850 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:28:02.418850 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 294/586] 10.222.0.67 () {56 vars in 1099 bytes} [Wed May 25 14:28:02 2022] GET /identity/v3/users/cinder => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:28:02.418850 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74caa546-70a2-4a02-b959-185be721231c None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:02.459232 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2de5bf-9f3c-4029-8a64-081204295505 None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:02.471559 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:02.498041 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c5a2ca-cc37-4dc0-9293-13ec458a12d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:02.499432 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c5a2ca-cc37-4dc0-9293-13ec458a12d6 None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:02.499718 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c5a2ca-cc37-4dc0-9293-13ec458a12d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:02.499990 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c5a2ca-cc37-4dc0-9293-13ec458a12d6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:02.510295 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c5a2ca-cc37-4dc0-9293-13ec458a12d6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:02.511770 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c5a2ca-cc37-4dc0-9293-13ec458a12d6 None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:02.524438 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74caa546-70a2-4a02-b959-185be721231c None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:02.530378 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application [None req-21c5a2ca-cc37-4dc0-9293-13ec458a12d6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:28:02.530378 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:28:02.530378 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:28:02.530378 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:28:02.530378 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:28:02.530378 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:28:02.530378 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:28:02.530378 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:28:02.530378 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:28:02.530378 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:28:02.530378 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:28:02.530378 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:28:02.530378 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 14:28:02.530378 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 14:28:02.530378 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 14:28:02.531293 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 14:28:02.531293 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:28:02.531293 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:28:02.531293 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:28:02.531293 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:28:02.531293 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:28:02.531293 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:28:02.531293 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:28:02.531293 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application with Lock( May 25 14:28:02.531293 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:28:02.531293 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self._enter() May 25 14:28:02.531293 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:28:02.531293 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:28:02.531293 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:28:02.531293 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.creator() May 25 14:28:02.531293 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:28:02.531293 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application created_value = creator( May 25 14:28:02.537109 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 14:28:02.537109 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 14:28:02.537109 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:28:02.537109 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application May 25 14:28:02.537109 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 293/587] 10.222.0.67 () {56 vars in 1108 bytes} [Wed May 25 14:28:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:28:02.537109 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c5a2ca-cc37-4dc0-9293-13ec458a12d6 None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:02.567783 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34cd481-f402-43f4-b24b-839c879c3c73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:02.568444 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34cd481-f402-43f4-b24b-839c879c3c73 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:02.568772 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34cd481-f402-43f4-b24b-839c879c3c73 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:02.569013 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34cd481-f402-43f4-b24b-839c879c3c73 None admin] PATH_INFO: `/v3/domains` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:02.569742 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34cd481-f402-43f4-b24b-839c879c3c73 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:28:02.570049 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34cd481-f402-43f4-b24b-839c879c3c73 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:02.571471 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34cd481-f402-43f4-b24b-839c879c3c73 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:02.584482 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 295/588] 10.222.0.67 () {56 vars in 1109 bytes} [Wed May 25 14:28:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:28:02.585301 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34cd481-f402-43f4-b24b-839c879c3c73 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:02.611610 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:02.646963 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c5a2ca-cc37-4dc0-9293-13ec458a12d6 None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:02.689333 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a17d8e-8064-42ea-bdea-c30409901bb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:02.689825 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34cd481-f402-43f4-b24b-839c879c3c73 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:02.690002 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a17d8e-8064-42ea-bdea-c30409901bb6 None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:02.690283 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a17d8e-8064-42ea-bdea-c30409901bb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:02.690564 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a17d8e-8064-42ea-bdea-c30409901bb6 None admin] PATH_INFO: `/v3/projects` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:02.691398 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a17d8e-8064-42ea-bdea-c30409901bb6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:28:02.691713 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a17d8e-8064-42ea-bdea-c30409901bb6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:02.693167 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a17d8e-8064-42ea-bdea-c30409901bb6 None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:02.701095 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:02.706640 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 294/589] 10.222.0.67 () {56 vars in 1148 bytes} [Wed May 25 14:28:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:28:02.707506 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a17d8e-8064-42ea-bdea-c30409901bb6 None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:02.731794 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22242117-e6f0-4790-af85-b996cbd6632a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:02.732390 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22242117-e6f0-4790-af85-b996cbd6632a None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:02.732678 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22242117-e6f0-4790-af85-b996cbd6632a None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:02.733013 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22242117-e6f0-4790-af85-b996cbd6632a None admin] PATH_INFO: `/v3/users` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:02.733962 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22242117-e6f0-4790-af85-b996cbd6632a None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:28:02.734406 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22242117-e6f0-4790-af85-b996cbd6632a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:02.735743 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22242117-e6f0-4790-af85-b996cbd6632a None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:02.759367 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 296/590] 10.222.0.67 () {56 vars in 1137 bytes} [Wed May 25 14:28:02 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:28:02.759367 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22242117-e6f0-4790-af85-b996cbd6632a None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:02.817784 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a17d8e-8064-42ea-bdea-c30409901bb6 None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:02.849035 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:02.854527 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34959a7b-3909-4e27-aaae-4ecbd03b8359 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:02.855233 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34959a7b-3909-4e27-aaae-4ecbd03b8359 None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:02.855524 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34959a7b-3909-4e27-aaae-4ecbd03b8359 None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:02.855801 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34959a7b-3909-4e27-aaae-4ecbd03b8359 None admin] PATH_INFO: `/v3/domains` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:02.856549 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34959a7b-3909-4e27-aaae-4ecbd03b8359 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:28:02.856845 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34959a7b-3909-4e27-aaae-4ecbd03b8359 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:02.858840 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34959a7b-3909-4e27-aaae-4ecbd03b8359 None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:02.870822 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 295/591] 10.222.0.67 () {56 vars in 1109 bytes} [Wed May 25 14:28:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:28:02.872015 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34959a7b-3909-4e27-aaae-4ecbd03b8359 None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:02.879712 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22242117-e6f0-4790-af85-b996cbd6632a None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:02.919809 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c50dd4-4168-4e14-8d73-4f5c8b50e6bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:02.921188 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c50dd4-4168-4e14-8d73-4f5c8b50e6bd None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:02.921468 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c50dd4-4168-4e14-8d73-4f5c8b50e6bd None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:02.921809 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c50dd4-4168-4e14-8d73-4f5c8b50e6bd None admin] PATH_INFO: `/v3/projects/service` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:02.930388 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c50dd4-4168-4e14-8d73-4f5c8b50e6bd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:02.931936 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c50dd4-4168-4e14-8d73-4f5c8b50e6bd None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:02.947825 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application [None req-55c50dd4-4168-4e14-8d73-4f5c8b50e6bd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 14:28:02.947825 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:28:02.947825 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:28:02.947825 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:28:02.947825 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:28:02.947825 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:28:02.947825 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:28:02.947825 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:28:02.947825 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:28:02.947825 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:28:02.947825 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:28:02.947825 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:28:02.947825 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 14:28:02.947825 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 14:28:02.947825 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 14:28:02.949001 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 14:28:02.949001 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:28:02.949001 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:28:02.949001 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:28:02.949001 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:28:02.949001 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:28:02.949001 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:28:02.949001 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:28:02.949001 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application with Lock( May 25 14:28:02.949001 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:28:02.949001 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._enter() May 25 14:28:02.949001 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:28:02.949001 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:28:02.949001 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:28:02.949001 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.creator() May 25 14:28:02.949001 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:28:02.949001 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application created_value = creator( May 25 14:28:02.950265 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 14:28:02.950265 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 14:28:02.950265 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 14:28:02.950265 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 14:28:02.950265 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 14:28:02.950265 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 14:28:02.950265 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 14:28:02.950265 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:28:02.950265 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 297/592] 10.222.0.67 () {56 vars in 1111 bytes} [Wed May 25 14:28:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:28:02.950778 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c50dd4-4168-4e14-8d73-4f5c8b50e6bd None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:02.986042 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:02.991252 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34959a7b-3909-4e27-aaae-4ecbd03b8359 None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:03.029491 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce834de9-c5ec-47be-8ccf-84746fc1a4cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:03.031142 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce834de9-c5ec-47be-8ccf-84746fc1a4cc None admin] REQUEST_METHOD: `PUT` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:03.031497 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce834de9-c5ec-47be-8ccf-84746fc1a4cc None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:03.031849 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce834de9-c5ec-47be-8ccf-84746fc1a4cc None admin] PATH_INFO: `/v3/projects/bfe93ee8d32a441295efc0b885de4bd7/users/428ec99478284743943ed41e9d24a603/roles/85be32e3c1ae4269b5456307e0827cc7` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:03.047165 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce834de9-c5ec-47be-8ccf-84746fc1a4cc None admin] RBAC: Authorizing `identity:create_grant(project_id=bfe93ee8d32a441295efc0b885de4bd7, user_id=428ec99478284743943ed41e9d24a603, role_id=85be32e3c1ae4269b5456307e0827cc7)` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:03.048616 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce834de9-c5ec-47be-8ccf-84746fc1a4cc None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:03.062845 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 296/593] 10.222.0.67 () {58 vars in 1439 bytes} [Wed May 25 14:28:02 2022] PUT /identity/v3/projects/bfe93ee8d32a441295efc0b885de4bd7/users/428ec99478284743943ed41e9d24a603/roles/85be32e3c1ae4269b5456307e0827cc7 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:28:03.063750 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce834de9-c5ec-47be-8ccf-84746fc1a4cc None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:03.076006 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c50dd4-4168-4e14-8d73-4f5c8b50e6bd None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:03.119707 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb68e809-3a5d-43a2-a892-86545aa7bb99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:03.120249 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb68e809-3a5d-43a2-a892-86545aa7bb99 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:03.120535 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb68e809-3a5d-43a2-a892-86545aa7bb99 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:03.120812 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb68e809-3a5d-43a2-a892-86545aa7bb99 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:03.122423 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:03.136219 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb68e809-3a5d-43a2-a892-86545aa7bb99 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:03.137734 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb68e809-3a5d-43a2-a892-86545aa7bb99 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:03.157138 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application [None req-fb68e809-3a5d-43a2-a892-86545aa7bb99 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:28:03.157138 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:28:03.157138 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:28:03.157138 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:28:03.157138 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:28:03.157138 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:28:03.157138 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:28:03.157138 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:28:03.157138 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:28:03.157138 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:28:03.157138 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:28:03.157138 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:28:03.157138 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 14:28:03.157138 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 14:28:03.157138 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 14:28:03.158349 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 14:28:03.158349 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:28:03.158349 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:28:03.158349 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:28:03.158349 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:28:03.158349 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:28:03.158349 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:28:03.158349 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:28:03.158349 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application with Lock( May 25 14:28:03.158349 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:28:03.158349 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._enter() May 25 14:28:03.158349 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:28:03.158349 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:28:03.158349 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:28:03.158349 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.creator() May 25 14:28:03.158349 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:28:03.158349 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application created_value = creator( May 25 14:28:03.159415 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 14:28:03.159415 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 14:28:03.159415 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:28:03.159415 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:28:03.159415 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 298/594] 10.222.0.67 () {56 vars in 1108 bytes} [Wed May 25 14:28:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:28:03.159933 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb68e809-3a5d-43a2-a892-86545aa7bb99 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:03.200954 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce834de9-c5ec-47be-8ccf-84746fc1a4cc None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:03.243678 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416467c3-8fd5-4663-bbbe-33f0d26208bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:03.244492 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416467c3-8fd5-4663-bbbe-33f0d26208bf None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:03.244777 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416467c3-8fd5-4663-bbbe-33f0d26208bf None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:03.245050 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416467c3-8fd5-4663-bbbe-33f0d26208bf None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:03.254052 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:03.255388 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416467c3-8fd5-4663-bbbe-33f0d26208bf None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:03.258082 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416467c3-8fd5-4663-bbbe-33f0d26208bf None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:03.276194 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb68e809-3a5d-43a2-a892-86545aa7bb99 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:03.276402 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application [None req-416467c3-8fd5-4663-bbbe-33f0d26208bf None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 25 14:28:03.276402 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:28:03.276402 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:28:03.276402 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:28:03.276402 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:28:03.276402 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:28:03.276402 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:28:03.276402 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:28:03.276402 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:28:03.276402 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:28:03.276402 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:28:03.276402 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:28:03.276402 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 14:28:03.276402 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 14:28:03.276402 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 14:28:03.276402 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 14:28:03.277317 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:28:03.277317 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:28:03.277317 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 14:28:03.277317 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 14:28:03.277317 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 14:28:03.277317 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 14:28:03.277317 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:28:03.277317 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:28:03.277317 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:28:03.277317 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:28:03.277317 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:28:03.277317 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application with Lock( May 25 14:28:03.277317 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:28:03.277317 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self._enter() May 25 14:28:03.277317 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:28:03.277317 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:28:03.277317 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:28:03.277317 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.creator() May 25 14:28:03.278262 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:28:03.278262 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application created_value = creator( May 25 14:28:03.278262 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 14:28:03.278262 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 14:28:03.278262 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 14:28:03.278262 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 14:28:03.278262 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 14:28:03.278262 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 14:28:03.278262 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 25 14:28:03.278262 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application May 25 14:28:03.279275 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 297/595] 10.222.0.67 () {56 vars in 1102 bytes} [Wed May 25 14:28:03 2022] GET /identity/v3/users/neutron => generated 85 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:28:03.280866 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0d6d0a-2f7f-49bf-9bae-ffae1bab5b9c None None] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:03.280988 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0d6d0a-2f7f-49bf-9bae-ffae1bab5b9c None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:03.281252 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0d6d0a-2f7f-49bf-9bae-ffae1bab5b9c None None] PATH_INFO: `/` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:03.282705 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 298/596] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 14:28:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:28:03.285653 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0d6d0a-2f7f-49bf-9bae-ffae1bab5b9c None None] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:03.316215 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862e3df0-131b-4595-9fec-8ed0cbfba4f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:03.316877 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862e3df0-131b-4595-9fec-8ed0cbfba4f5 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:03.317160 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862e3df0-131b-4595-9fec-8ed0cbfba4f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:03.317436 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862e3df0-131b-4595-9fec-8ed0cbfba4f5 None admin] PATH_INFO: `/v3/projects` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:03.318229 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862e3df0-131b-4595-9fec-8ed0cbfba4f5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:28:03.318536 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862e3df0-131b-4595-9fec-8ed0cbfba4f5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:03.319995 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862e3df0-131b-4595-9fec-8ed0cbfba4f5 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:03.337864 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 299/597] 10.222.0.67 () {56 vars in 1148 bytes} [Wed May 25 14:28:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:28:03.337864 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862e3df0-131b-4595-9fec-8ed0cbfba4f5 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:03.401352 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0d6d0a-2f7f-49bf-9bae-ffae1bab5b9c None None] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:03.402871 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:03.438307 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04465d75-79a9-4fbf-9b95-f8c32c1e879c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:03.438975 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04465d75-79a9-4fbf-9b95-f8c32c1e879c None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:03.439289 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04465d75-79a9-4fbf-9b95-f8c32c1e879c None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:03.439500 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862e3df0-131b-4595-9fec-8ed0cbfba4f5 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:03.439604 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04465d75-79a9-4fbf-9b95-f8c32c1e879c None admin] PATH_INFO: `/v3/domains` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:03.440295 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04465d75-79a9-4fbf-9b95-f8c32c1e879c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:28:03.440604 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04465d75-79a9-4fbf-9b95-f8c32c1e879c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:03.441988 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04465d75-79a9-4fbf-9b95-f8c32c1e879c None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:03.454384 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 299/598] 10.222.0.67 () {56 vars in 1109 bytes} [Wed May 25 14:28:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:28:03.455771 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee98ffc6-95f3-4559-899c-c0fd53957e45 None None] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:03.456064 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee98ffc6-95f3-4559-899c-c0fd53957e45 None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:03.456343 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee98ffc6-95f3-4559-899c-c0fd53957e45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:03.474263 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.auth.core [None req-ee98ffc6-95f3-4559-899c-c0fd53957e45 None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:28:03.475508 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-ee98ffc6-95f3-4559-899c-c0fd53957e45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:28:03.480463 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e52a4f1-b906-4607-b236-71c44244c562 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:03.481143 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e52a4f1-b906-4607-b236-71c44244c562 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:03.481455 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e52a4f1-b906-4607-b236-71c44244c562 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:03.481707 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e52a4f1-b906-4607-b236-71c44244c562 None admin] PATH_INFO: `/v3/users` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:03.482551 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e52a4f1-b906-4607-b236-71c44244c562 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:28:03.482896 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e52a4f1-b906-4607-b236-71c44244c562 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:03.484451 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e52a4f1-b906-4607-b236-71c44244c562 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:03.494576 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:03.505152 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 300/599] 10.222.0.67 () {56 vars in 1139 bytes} [Wed May 25 14:28:03 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:28:03.505775 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e52a4f1-b906-4607-b236-71c44244c562 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:03.555156 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 300/600] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 14:28:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 14:28:03.555156 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee98ffc6-95f3-4559-899c-c0fd53957e45 None None] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:03.615760 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e52a4f1-b906-4607-b236-71c44244c562 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:03.653248 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dec3a3e-8465-4d67-ae82-3d3f203baf2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:03.654144 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dec3a3e-8465-4d67-ae82-3d3f203baf2c None admin] REQUEST_METHOD: `PUT` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:03.654432 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dec3a3e-8465-4d67-ae82-3d3f203baf2c None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:03.654744 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dec3a3e-8465-4d67-ae82-3d3f203baf2c None admin] PATH_INFO: `/v3/projects/bfe93ee8d32a441295efc0b885de4bd7/users/b5e4d67668ce40509e057f4f4c994521/roles/85be32e3c1ae4269b5456307e0827cc7` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:03.656000 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:03.666088 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee98ffc6-95f3-4559-899c-c0fd53957e45 None None] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:03.670145 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dec3a3e-8465-4d67-ae82-3d3f203baf2c None admin] RBAC: Authorizing `identity:create_grant(project_id=bfe93ee8d32a441295efc0b885de4bd7, user_id=b5e4d67668ce40509e057f4f4c994521, role_id=85be32e3c1ae4269b5456307e0827cc7)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:03.671694 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dec3a3e-8465-4d67-ae82-3d3f203baf2c None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:03.695023 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 301/601] 10.222.0.67 () {58 vars in 1439 bytes} [Wed May 25 14:28:03 2022] PUT /identity/v3/projects/bfe93ee8d32a441295efc0b885de4bd7/users/b5e4d67668ce40509e057f4f4c994521/roles/85be32e3c1ae4269b5456307e0827cc7 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:28:03.695023 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dec3a3e-8465-4d67-ae82-3d3f203baf2c None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:03.723785 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9d7494-c144-4857-8f20-04f1863b0707 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:03.724657 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9d7494-c144-4857-8f20-04f1863b0707 None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:03.724940 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9d7494-c144-4857-8f20-04f1863b0707 None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:03.725211 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9d7494-c144-4857-8f20-04f1863b0707 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:03.736298 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9d7494-c144-4857-8f20-04f1863b0707 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:03.737881 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9d7494-c144-4857-8f20-04f1863b0707 None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:03.755337 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application [None req-7b9d7494-c144-4857-8f20-04f1863b0707 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 14:28:03.755337 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:28:03.755337 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:28:03.755337 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:28:03.755337 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:28:03.755337 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:28:03.755337 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:28:03.755337 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:28:03.755337 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:28:03.755337 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:28:03.755337 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:28:03.755337 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:28:03.755337 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 14:28:03.755337 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 14:28:03.755337 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 14:28:03.756361 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 14:28:03.756361 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:28:03.756361 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:28:03.756361 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:28:03.756361 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:28:03.756361 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:28:03.756361 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:28:03.756361 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:28:03.756361 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application with Lock( May 25 14:28:03.756361 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:28:03.756361 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self._enter() May 25 14:28:03.756361 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:28:03.756361 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:28:03.756361 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:28:03.756361 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.creator() May 25 14:28:03.756361 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:28:03.756361 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application created_value = creator( May 25 14:28:03.757286 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 14:28:03.757286 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 14:28:03.757286 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 14:28:03.757286 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 14:28:03.757286 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 14:28:03.757286 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 14:28:03.757286 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 14:28:03.757286 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application May 25 14:28:03.761723 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 301/602] 10.222.0.67 () {56 vars in 1111 bytes} [Wed May 25 14:28:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:28:03.762766 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:03.763715 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9d7494-c144-4857-8f20-04f1863b0707 None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:03.831970 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dec3a3e-8465-4d67-ae82-3d3f203baf2c None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:03.883835 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178f1ecb-8150-48ad-b824-2a7175cd4318 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:03.884891 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178f1ecb-8150-48ad-b824-2a7175cd4318 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:03.885332 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178f1ecb-8150-48ad-b824-2a7175cd4318 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:03.885778 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178f1ecb-8150-48ad-b824-2a7175cd4318 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:03.903164 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178f1ecb-8150-48ad-b824-2a7175cd4318 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:03.905548 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178f1ecb-8150-48ad-b824-2a7175cd4318 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:03.909927 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9d7494-c144-4857-8f20-04f1863b0707 None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:03.926011 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application [None req-178f1ecb-8150-48ad-b824-2a7175cd4318 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:28:03.926011 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:28:03.926011 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:28:03.926011 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:28:03.926011 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:28:03.926011 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:28:03.926011 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:28:03.926011 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:28:03.926011 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:28:03.926011 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:28:03.926011 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:28:03.926011 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:28:03.926011 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 14:28:03.926011 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 14:28:03.926011 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 14:28:03.927224 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 14:28:03.927224 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:28:03.927224 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:28:03.927224 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:28:03.927224 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:28:03.927224 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:28:03.927224 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:28:03.927224 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:28:03.927224 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application with Lock( May 25 14:28:03.927224 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:28:03.927224 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._enter() May 25 14:28:03.927224 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:28:03.927224 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:28:03.927224 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:28:03.927224 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.creator() May 25 14:28:03.927224 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:28:03.927224 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application created_value = creator( May 25 14:28:03.928277 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 14:28:03.928277 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 14:28:03.928277 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:28:03.928277 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:28:03.929812 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 302/603] 10.222.0.67 () {56 vars in 1108 bytes} [Wed May 25 14:28:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:28:03.930744 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178f1ecb-8150-48ad-b824-2a7175cd4318 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:03.952758 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18803b65-41d0-4f38-9062-c7de34e303b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:03.953729 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18803b65-41d0-4f38-9062-c7de34e303b6 None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:03.954112 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18803b65-41d0-4f38-9062-c7de34e303b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:03.954491 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18803b65-41d0-4f38-9062-c7de34e303b6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:03.965924 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18803b65-41d0-4f38-9062-c7de34e303b6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:28:03.975339 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application [None req-18803b65-41d0-4f38-9062-c7de34e303b6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 25 14:28:03.975339 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:28:03.975339 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:28:03.975339 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:28:03.975339 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:28:03.975339 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:28:03.975339 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:28:03.975339 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:28:03.975339 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:28:03.975339 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:28:03.975339 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:28:03.975339 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:28:03.975339 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:28:03.975339 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:28:03.975339 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:28:03.975339 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:28:03.976509 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:28:03.976509 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:28:03.976509 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:28:03.976509 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:28:03.976509 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:28:03.976509 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:28:03.976509 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:28:03.976509 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:28:03.976509 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:28:03.976509 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:28:03.976509 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:28:03.976509 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application with Lock( May 25 14:28:03.976509 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:28:03.976509 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self._enter() May 25 14:28:03.976509 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:28:03.976509 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:28:03.977560 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:28:03.977560 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.creator() May 25 14:28:03.977560 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:28:03.977560 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application created_value = creator( May 25 14:28:03.977560 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:28:03.977560 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:28:03.977560 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:28:03.977560 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:28:03.977560 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:28:03.977560 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:28:03.977560 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 25 14:28:03.977560 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application May 25 14:28:03.980777 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 302/604] 10.222.0.67 () {56 vars in 1102 bytes} [Wed May 25 14:28:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:28:03.980777 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18803b65-41d0-4f38-9062-c7de34e303b6 None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:03.996649 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:04.057561 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:04.062412 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178f1ecb-8150-48ad-b824-2a7175cd4318 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:04.096056 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18803b65-41d0-4f38-9062-c7de34e303b6 None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:04.112617 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c119f4-8eda-43c4-8775-e4a24f5da7ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:04.113831 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c119f4-8eda-43c4-8775-e4a24f5da7ea None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:04.114702 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c119f4-8eda-43c4-8775-e4a24f5da7ea None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:04.115236 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c119f4-8eda-43c4-8775-e4a24f5da7ea None admin] PATH_INFO: `/v3/projects` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:04.116283 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c119f4-8eda-43c4-8775-e4a24f5da7ea None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:28:04.116811 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c119f4-8eda-43c4-8775-e4a24f5da7ea None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:04.119469 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c119f4-8eda-43c4-8775-e4a24f5da7ea None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:04.132551 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812edcc6-e0bc-4249-abce-b537069c02f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:04.133092 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812edcc6-e0bc-4249-abce-b537069c02f4 None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:04.133383 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812edcc6-e0bc-4249-abce-b537069c02f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:04.133660 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812edcc6-e0bc-4249-abce-b537069c02f4 None admin] PATH_INFO: `/v3/domains` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:04.134447 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812edcc6-e0bc-4249-abce-b537069c02f4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:28:04.134706 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812edcc6-e0bc-4249-abce-b537069c02f4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:04.136305 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812edcc6-e0bc-4249-abce-b537069c02f4 None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:04.137782 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 303/605] 10.222.0.67 () {56 vars in 1148 bytes} [Wed May 25 14:28:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:28:04.140028 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c119f4-8eda-43c4-8775-e4a24f5da7ea None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:04.153748 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 303/606] 10.222.0.67 () {56 vars in 1109 bytes} [Wed May 25 14:28:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:28:04.155537 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812edcc6-e0bc-4249-abce-b537069c02f4 None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:04.246705 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:04.260277 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c119f4-8eda-43c4-8775-e4a24f5da7ea None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:04.282631 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812edcc6-e0bc-4249-abce-b537069c02f4 None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:04.300126 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8a9b2c-0dae-459c-ac29-06dbfd2418a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:04.300811 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8a9b2c-0dae-459c-ac29-06dbfd2418a2 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:04.301105 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8a9b2c-0dae-459c-ac29-06dbfd2418a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:04.301393 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8a9b2c-0dae-459c-ac29-06dbfd2418a2 None admin] PATH_INFO: `/v3/roles` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:04.302159 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8a9b2c-0dae-459c-ac29-06dbfd2418a2 None admin] RBAC: Adding query filter params (name=service) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:28:04.302477 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8a9b2c-0dae-459c-ac29-06dbfd2418a2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:04.303908 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8a9b2c-0dae-459c-ac29-06dbfd2418a2 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:04.313191 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 304/607] 10.222.0.67 () {56 vars in 1103 bytes} [Wed May 25 14:28:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:28:04.314011 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8a9b2c-0dae-459c-ac29-06dbfd2418a2 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:04.319729 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c71a282-59dd-4c5c-962d-0923997349be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:04.320622 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c71a282-59dd-4c5c-962d-0923997349be None admin] REQUEST_METHOD: `PUT` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:04.320906 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c71a282-59dd-4c5c-962d-0923997349be None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:04.321184 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c71a282-59dd-4c5c-962d-0923997349be None admin] PATH_INFO: `/v3/projects/bfe93ee8d32a441295efc0b885de4bd7/users/6e462acc9da84a61bb23998dd54e1858/roles/85be32e3c1ae4269b5456307e0827cc7` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:04.336789 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c71a282-59dd-4c5c-962d-0923997349be None admin] RBAC: Authorizing `identity:create_grant(project_id=bfe93ee8d32a441295efc0b885de4bd7, user_id=6e462acc9da84a61bb23998dd54e1858, role_id=85be32e3c1ae4269b5456307e0827cc7)` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:04.338247 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c71a282-59dd-4c5c-962d-0923997349be None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:04.345560 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:04.356698 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 304/608] 10.222.0.67 () {58 vars in 1439 bytes} [Wed May 25 14:28:04 2022] PUT /identity/v3/projects/bfe93ee8d32a441295efc0b885de4bd7/users/6e462acc9da84a61bb23998dd54e1858/roles/85be32e3c1ae4269b5456307e0827cc7 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:28:04.357402 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c71a282-59dd-4c5c-962d-0923997349be None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:04.450497 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8a9b2c-0dae-459c-ac29-06dbfd2418a2 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:04.476780 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c71a282-59dd-4c5c-962d-0923997349be None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:04.504292 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50697b2-7b33-4282-97c5-407abf463c83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:04.506256 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:04.506854 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50697b2-7b33-4282-97c5-407abf463c83 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:04.507386 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50697b2-7b33-4282-97c5-407abf463c83 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:04.507905 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50697b2-7b33-4282-97c5-407abf463c83 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:04.516197 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50697b2-7b33-4282-97c5-407abf463c83 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:04.518113 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50697b2-7b33-4282-97c5-407abf463c83 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:04.522296 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8f1699-a69b-4984-ae44-d741fce974e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:04.523243 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8f1699-a69b-4984-ae44-d741fce974e2 None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:04.523530 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8f1699-a69b-4984-ae44-d741fce974e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:04.523860 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8f1699-a69b-4984-ae44-d741fce974e2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:04.535203 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application [None req-b50697b2-7b33-4282-97c5-407abf463c83 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 14:28:04.535203 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:28:04.535203 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:28:04.535203 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:28:04.535203 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:28:04.535203 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:28:04.535203 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:28:04.535203 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:28:04.535203 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:28:04.535203 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:28:04.535203 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:28:04.535203 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:28:04.535203 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 14:28:04.535203 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 14:28:04.535203 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 14:28:04.536221 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 14:28:04.536221 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:28:04.536221 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:28:04.536221 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:28:04.536221 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:28:04.536221 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:28:04.536221 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:28:04.536221 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:28:04.536221 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application with Lock( May 25 14:28:04.536221 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:28:04.536221 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._enter() May 25 14:28:04.536221 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:28:04.536221 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:28:04.536221 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:28:04.536221 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.creator() May 25 14:28:04.536221 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:28:04.536221 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application created_value = creator( May 25 14:28:04.537129 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 14:28:04.537129 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 14:28:04.537129 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 14:28:04.537129 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 14:28:04.537129 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 14:28:04.537129 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 14:28:04.537129 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 14:28:04.537129 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:28:04.537575 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8f1699-a69b-4984-ae44-d741fce974e2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:04.537649 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8f1699-a69b-4984-ae44-d741fce974e2 None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:04.540137 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 305/609] 10.222.0.67 () {56 vars in 1111 bytes} [Wed May 25 14:28:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:28:04.548241 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50697b2-7b33-4282-97c5-407abf463c83 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:04.565918 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application [None req-2c8f1699-a69b-4984-ae44-d741fce974e2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:28:04.565918 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:28:04.565918 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:28:04.565918 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:28:04.565918 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:28:04.565918 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:28:04.565918 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:28:04.565918 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:28:04.565918 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:28:04.565918 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:28:04.565918 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:28:04.565918 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:28:04.565918 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 14:28:04.565918 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 14:28:04.565918 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 14:28:04.566885 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 14:28:04.566885 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:28:04.566885 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:28:04.566885 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:28:04.566885 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:28:04.566885 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:28:04.566885 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:28:04.566885 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:28:04.566885 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application with Lock( May 25 14:28:04.566885 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:28:04.566885 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self._enter() May 25 14:28:04.566885 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:28:04.566885 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:28:04.566885 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:28:04.566885 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.creator() May 25 14:28:04.566885 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:28:04.566885 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application created_value = creator( May 25 14:28:04.567871 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 14:28:04.567871 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 14:28:04.567871 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:28:04.567871 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application May 25 14:28:04.569946 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 305/610] 10.222.0.67 () {56 vars in 1108 bytes} [Wed May 25 14:28:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:28:04.574127 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8f1699-a69b-4984-ae44-d741fce974e2 None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:04.687472 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:04.722226 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50697b2-7b33-4282-97c5-407abf463c83 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:04.742541 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8f1699-a69b-4984-ae44-d741fce974e2 None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:04.772640 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4e9b88-fb1f-4796-8996-21348ebb018a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:04.773307 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4e9b88-fb1f-4796-8996-21348ebb018a None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:04.773591 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4e9b88-fb1f-4796-8996-21348ebb018a None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:04.773869 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4e9b88-fb1f-4796-8996-21348ebb018a None admin] PATH_INFO: `/v3/projects` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:04.774666 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4e9b88-fb1f-4796-8996-21348ebb018a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:28:04.774979 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4e9b88-fb1f-4796-8996-21348ebb018a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:04.776475 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4e9b88-fb1f-4796-8996-21348ebb018a None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:04.788777 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b696230d-9d1b-4416-b727-34cd3c1df8e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:04.789644 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 306/611] 10.222.0.67 () {56 vars in 1148 bytes} [Wed May 25 14:28:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:28:04.789929 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b696230d-9d1b-4416-b727-34cd3c1df8e4 None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:04.790224 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b696230d-9d1b-4416-b727-34cd3c1df8e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:04.790607 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b696230d-9d1b-4416-b727-34cd3c1df8e4 None admin] PATH_INFO: `/v3/domains` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:04.795056 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b696230d-9d1b-4416-b727-34cd3c1df8e4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:28:04.795056 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b696230d-9d1b-4416-b727-34cd3c1df8e4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:04.795056 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b696230d-9d1b-4416-b727-34cd3c1df8e4 None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:04.797139 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4e9b88-fb1f-4796-8996-21348ebb018a None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:04.806256 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 306/612] 10.222.0.67 () {56 vars in 1109 bytes} [Wed May 25 14:28:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:28:04.813463 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b696230d-9d1b-4416-b727-34cd3c1df8e4 None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:04.886464 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:05.018842 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b696230d-9d1b-4416-b727-34cd3c1df8e4 None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:05.019242 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4e9b88-fb1f-4796-8996-21348ebb018a None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:05.063069 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162222b4-58b8-4b90-b9cf-cb2e00e9cb83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:05.063069 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162222b4-58b8-4b90-b9cf-cb2e00e9cb83 None admin] REQUEST_METHOD: `PUT` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:05.063069 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162222b4-58b8-4b90-b9cf-cb2e00e9cb83 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:05.063069 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162222b4-58b8-4b90-b9cf-cb2e00e9cb83 None admin] PATH_INFO: `/v3/projects/bfe93ee8d32a441295efc0b885de4bd7/users/b68eed985c7b49839bcdd173186ad4ba/roles/85be32e3c1ae4269b5456307e0827cc7` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:05.079531 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162222b4-58b8-4b90-b9cf-cb2e00e9cb83 None admin] RBAC: Authorizing `identity:create_grant(project_id=bfe93ee8d32a441295efc0b885de4bd7, user_id=b68eed985c7b49839bcdd173186ad4ba, role_id=85be32e3c1ae4269b5456307e0827cc7)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:05.081540 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d21b0d-4fe3-44e7-ae1b-dc5fe18fffca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:05.081717 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162222b4-58b8-4b90-b9cf-cb2e00e9cb83 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:05.082526 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d21b0d-4fe3-44e7-ae1b-dc5fe18fffca None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:05.082906 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d21b0d-4fe3-44e7-ae1b-dc5fe18fffca None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:05.083308 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d21b0d-4fe3-44e7-ae1b-dc5fe18fffca None admin] PATH_INFO: `/v3/users/swift` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:05.087412 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:05.093142 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d21b0d-4fe3-44e7-ae1b-dc5fe18fffca None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:05.094977 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d21b0d-4fe3-44e7-ae1b-dc5fe18fffca None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:05.100656 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 307/613] 10.222.0.67 () {58 vars in 1439 bytes} [Wed May 25 14:28:04 2022] PUT /identity/v3/projects/bfe93ee8d32a441295efc0b885de4bd7/users/b68eed985c7b49839bcdd173186ad4ba/roles/85be32e3c1ae4269b5456307e0827cc7 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:28:05.111763 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application [None req-f0d21b0d-4fe3-44e7-ae1b-dc5fe18fffca None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 25 14:28:05.111763 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:28:05.111763 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:28:05.111763 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:28:05.111763 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:28:05.111763 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:28:05.111763 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:28:05.111763 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:28:05.111763 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:28:05.111763 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:28:05.111763 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:28:05.111763 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:28:05.111763 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 14:28:05.111763 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 14:28:05.111763 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 14:28:05.111763 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 14:28:05.113005 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:28:05.113005 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:28:05.113005 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 14:28:05.113005 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 14:28:05.113005 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 14:28:05.113005 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 14:28:05.113005 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:28:05.113005 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:28:05.113005 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:28:05.113005 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:28:05.113005 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:28:05.113005 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application with Lock( May 25 14:28:05.113005 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:28:05.113005 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self._enter() May 25 14:28:05.113005 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:28:05.113005 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:28:05.113005 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:28:05.113005 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.creator() May 25 14:28:05.114230 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:28:05.114230 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application created_value = creator( May 25 14:28:05.114230 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 14:28:05.114230 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 14:28:05.114230 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 14:28:05.114230 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 14:28:05.114230 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 14:28:05.114230 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 14:28:05.114230 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 25 14:28:05.114230 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application May 25 14:28:05.116105 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 307/614] 10.222.0.67 () {56 vars in 1096 bytes} [Wed May 25 14:28:04 2022] GET /identity/v3/users/swift => generated 83 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:28:05.122108 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162222b4-58b8-4b90-b9cf-cb2e00e9cb83 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:05.249053 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162222b4-58b8-4b90-b9cf-cb2e00e9cb83 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:05.294657 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd73a241-df99-4eba-b7a0-b6c5d61c56d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:05.295324 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd73a241-df99-4eba-b7a0-b6c5d61c56d0 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:05.296157 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd73a241-df99-4eba-b7a0-b6c5d61c56d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:05.296436 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd73a241-df99-4eba-b7a0-b6c5d61c56d0 None admin] PATH_INFO: `/v3/users` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:05.297296 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd73a241-df99-4eba-b7a0-b6c5d61c56d0 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:28:05.297607 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd73a241-df99-4eba-b7a0-b6c5d61c56d0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:05.299091 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd73a241-df99-4eba-b7a0-b6c5d61c56d0 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:05.325961 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 308/615] 10.222.0.67 () {56 vars in 1135 bytes} [Wed May 25 14:28:05 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:28:05.331711 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d21b0d-4fe3-44e7-ae1b-dc5fe18fffca None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:05.470921 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:05.479190 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d21b0d-4fe3-44e7-ae1b-dc5fe18fffca None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:05.528682 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849b5f51-dc83-40ab-a7e0-6055d63c6809 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:05.529493 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849b5f51-dc83-40ab-a7e0-6055d63c6809 None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:05.529925 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849b5f51-dc83-40ab-a7e0-6055d63c6809 None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:05.530334 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849b5f51-dc83-40ab-a7e0-6055d63c6809 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:05.539505 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a439b61d-f229-4600-9112-04cdabaf4adb None None] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:05.539998 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a439b61d-f229-4600-9112-04cdabaf4adb None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:05.540077 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a439b61d-f229-4600-9112-04cdabaf4adb None None] PATH_INFO: `/` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:05.542035 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 309/616] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 14:28:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:28:05.549384 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849b5f51-dc83-40ab-a7e0-6055d63c6809 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:05.549632 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125ce2a5-a692-4383-bcba-14fa0409c05b None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:05.549901 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125ce2a5-a692-4383-bcba-14fa0409c05b None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:05.550178 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125ce2a5-a692-4383-bcba-14fa0409c05b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:05.550822 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849b5f51-dc83-40ab-a7e0-6055d63c6809 None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:05.569641 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-125ce2a5-a692-4383-bcba-14fa0409c05b None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:28:05.570817 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-125ce2a5-a692-4383-bcba-14fa0409c05b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:28:05.576279 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application [None req-849b5f51-dc83-40ab-a7e0-6055d63c6809 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:28:05.576279 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:28:05.576279 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:28:05.576279 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:28:05.576279 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:28:05.576279 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:28:05.576279 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:28:05.576279 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:28:05.576279 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:28:05.576279 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:28:05.576279 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:28:05.576279 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:28:05.576279 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 14:28:05.576279 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 14:28:05.576279 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 14:28:05.577396 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 14:28:05.577396 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:28:05.577396 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:28:05.577396 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:28:05.577396 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:28:05.577396 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:28:05.577396 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:28:05.577396 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:28:05.577396 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application with Lock( May 25 14:28:05.577396 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:28:05.577396 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self._enter() May 25 14:28:05.577396 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:28:05.577396 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:28:05.577396 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:28:05.577396 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.creator() May 25 14:28:05.577396 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:28:05.577396 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application created_value = creator( May 25 14:28:05.578313 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 14:28:05.578313 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 14:28:05.578313 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:28:05.578313 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application May 25 14:28:05.581877 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 308/617] 10.222.0.67 () {56 vars in 1108 bytes} [Wed May 25 14:28:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:28:05.584035 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849b5f51-dc83-40ab-a7e0-6055d63c6809 None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:05.646493 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:05.679218 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 310/618] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 14:28:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 14:28:05.703132 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849b5f51-dc83-40ab-a7e0-6055d63c6809 None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:05.721245 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125ce2a5-a692-4383-bcba-14fa0409c05b None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:05.738431 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990c00fe-14c8-4688-b285-62ea3f5c4e92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:05.738801 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990c00fe-14c8-4688-b285-62ea3f5c4e92 None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:05.739128 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990c00fe-14c8-4688-b285-62ea3f5c4e92 None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:05.739406 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990c00fe-14c8-4688-b285-62ea3f5c4e92 None admin] PATH_INFO: `/v3/domains` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:05.740135 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990c00fe-14c8-4688-b285-62ea3f5c4e92 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:28:05.740441 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990c00fe-14c8-4688-b285-62ea3f5c4e92 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:05.741824 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990c00fe-14c8-4688-b285-62ea3f5c4e92 None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:05.755154 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 309/619] 10.222.0.67 () {56 vars in 1109 bytes} [Wed May 25 14:28:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:28:05.760086 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990c00fe-14c8-4688-b285-62ea3f5c4e92 None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:05.795403 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:05.879005 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990c00fe-14c8-4688-b285-62ea3f5c4e92 None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:05.923847 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dfe3ec-9017-4c8a-9612-80d8fae68abb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:05.924650 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dfe3ec-9017-4c8a-9612-80d8fae68abb None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:05.924933 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dfe3ec-9017-4c8a-9612-80d8fae68abb None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:05.925210 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dfe3ec-9017-4c8a-9612-80d8fae68abb None admin] PATH_INFO: `/v3/projects/service` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:05.944829 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57dfe3ec-9017-4c8a-9612-80d8fae68abb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:05.946299 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57dfe3ec-9017-4c8a-9612-80d8fae68abb None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:05.965570 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application [None req-57dfe3ec-9017-4c8a-9612-80d8fae68abb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 14:28:05.965570 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:28:05.965570 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:28:05.965570 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:28:05.965570 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:28:05.965570 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:28:05.965570 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:28:05.965570 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:28:05.965570 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:28:05.965570 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:28:05.965570 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:28:05.965570 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:28:05.965570 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 14:28:05.965570 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 14:28:05.965570 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 14:28:05.966560 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 14:28:05.966560 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:28:05.966560 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:28:05.966560 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:28:05.966560 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:28:05.966560 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:28:05.966560 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:28:05.966560 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:28:05.966560 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application with Lock( May 25 14:28:05.966560 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:28:05.966560 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self._enter() May 25 14:28:05.966560 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:28:05.966560 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:28:05.966560 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:28:05.966560 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.creator() May 25 14:28:05.966560 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:28:05.966560 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application created_value = creator( May 25 14:28:05.968595 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 14:28:05.968595 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 14:28:05.968595 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 14:28:05.968595 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 14:28:05.968595 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 14:28:05.968595 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 14:28:05.968595 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 14:28:05.968595 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application May 25 14:28:05.968595 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 310/620] 10.222.0.67 () {56 vars in 1111 bytes} [Wed May 25 14:28:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:28:05.971549 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125ce2a5-a692-4383-bcba-14fa0409c05b None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:05.973741 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dfe3ec-9017-4c8a-9612-80d8fae68abb None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:06.051671 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f162f745-5793-43e2-979e-c41ee993cc72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:06.052517 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f162f745-5793-43e2-979e-c41ee993cc72 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:06.052801 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f162f745-5793-43e2-979e-c41ee993cc72 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:06.053074 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f162f745-5793-43e2-979e-c41ee993cc72 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:06.076963 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f162f745-5793-43e2-979e-c41ee993cc72 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:28:06.092764 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application [None req-f162f745-5793-43e2-979e-c41ee993cc72 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 25 14:28:06.092764 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:28:06.092764 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:28:06.092764 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:28:06.092764 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:28:06.092764 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:28:06.092764 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:28:06.092764 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:28:06.092764 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:28:06.092764 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:28:06.092764 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:28:06.092764 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:28:06.092764 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:28:06.092764 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:28:06.092764 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:28:06.092764 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:28:06.093704 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:28:06.093704 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:28:06.093704 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:28:06.093704 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:28:06.093704 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:28:06.093704 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:28:06.093704 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:28:06.093704 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:28:06.093704 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:28:06.093704 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:28:06.093704 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:28:06.093704 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application with Lock( May 25 14:28:06.093704 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:28:06.093704 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._enter() May 25 14:28:06.093704 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:28:06.093704 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:28:06.095516 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:28:06.095516 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.creator() May 25 14:28:06.095516 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:28:06.095516 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application created_value = creator( May 25 14:28:06.095516 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:28:06.095516 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:28:06.095516 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:28:06.095516 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:28:06.095516 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:28:06.095516 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:28:06.095516 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 25 14:28:06.095516 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:28:06.098369 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 311/621] 10.222.0.67 () {56 vars in 1102 bytes} [Wed May 25 14:28:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 374 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 14:28:06.100512 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f162f745-5793-43e2-979e-c41ee993cc72 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:06.107330 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:06.173592 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:06.177459 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dfe3ec-9017-4c8a-9612-80d8fae68abb None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:06.257236 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2ee1be-c072-4166-acde-8615bb1ccde1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:06.258645 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2ee1be-c072-4166-acde-8615bb1ccde1 None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:06.259145 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2ee1be-c072-4166-acde-8615bb1ccde1 None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:06.259422 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2ee1be-c072-4166-acde-8615bb1ccde1 None admin] PATH_INFO: `/v3/projects` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:06.261347 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2ee1be-c072-4166-acde-8615bb1ccde1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:28:06.262447 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2ee1be-c072-4166-acde-8615bb1ccde1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:06.263914 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2ee1be-c072-4166-acde-8615bb1ccde1 None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:06.268012 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f162f745-5793-43e2-979e-c41ee993cc72 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:06.293027 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 311/622] 10.222.0.67 () {56 vars in 1148 bytes} [Wed May 25 14:28:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:28:06.300809 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2ee1be-c072-4166-acde-8615bb1ccde1 None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:06.312930 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf89027-078a-4873-b924-491ede130955 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:06.313598 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf89027-078a-4873-b924-491ede130955 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:06.313881 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf89027-078a-4873-b924-491ede130955 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:06.314160 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf89027-078a-4873-b924-491ede130955 None admin] PATH_INFO: `/v3/roles` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:06.315903 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf89027-078a-4873-b924-491ede130955 None admin] RBAC: Adding query filter params (name=service) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:28:06.316216 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf89027-078a-4873-b924-491ede130955 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:06.317602 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf89027-078a-4873-b924-491ede130955 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:06.327888 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 312/623] 10.222.0.67 () {56 vars in 1103 bytes} [Wed May 25 14:28:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:28:06.333168 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf89027-078a-4873-b924-491ede130955 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:06.452170 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf89027-078a-4873-b924-491ede130955 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:06.454205 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:06.500551 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b565a44b-3120-4f0b-aebb-28160dd20c64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:06.501559 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b565a44b-3120-4f0b-aebb-28160dd20c64 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:06.501937 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b565a44b-3120-4f0b-aebb-28160dd20c64 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:06.502346 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b565a44b-3120-4f0b-aebb-28160dd20c64 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:06.504796 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2ee1be-c072-4166-acde-8615bb1ccde1 None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:06.513526 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b565a44b-3120-4f0b-aebb-28160dd20c64 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:06.515960 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b565a44b-3120-4f0b-aebb-28160dd20c64 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:06.531965 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:06.536125 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application [None req-b565a44b-3120-4f0b-aebb-28160dd20c64 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:28:06.536125 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:28:06.536125 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:28:06.536125 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:28:06.536125 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:28:06.536125 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:28:06.536125 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:28:06.536125 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:28:06.536125 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:28:06.536125 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:28:06.536125 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:28:06.536125 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:28:06.536125 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 14:28:06.536125 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 14:28:06.536125 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 14:28:06.538948 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 14:28:06.538948 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:28:06.538948 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:28:06.538948 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:28:06.538948 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:28:06.538948 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:28:06.538948 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:28:06.538948 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:28:06.538948 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application with Lock( May 25 14:28:06.538948 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:28:06.538948 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._enter() May 25 14:28:06.538948 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:28:06.538948 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:28:06.538948 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:28:06.538948 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.creator() May 25 14:28:06.538948 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:28:06.538948 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application created_value = creator( May 25 14:28:06.540474 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 14:28:06.540474 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 14:28:06.540474 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:28:06.540474 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:28:06.540474 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 313/624] 10.222.0.67 () {56 vars in 1108 bytes} [Wed May 25 14:28:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:28:06.540474 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbec337-7364-4413-9fb5-a495b65af71b None None] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:06.540474 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbec337-7364-4413-9fb5-a495b65af71b None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:06.540474 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbec337-7364-4413-9fb5-a495b65af71b None None] PATH_INFO: `/` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:06.543111 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 314/625] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 14:28:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:28:06.543434 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbec337-7364-4413-9fb5-a495b65af71b None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:06.546271 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a09ff0d-68eb-47f1-8317-4c358a285cbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:06.547360 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a09ff0d-68eb-47f1-8317-4c358a285cbd None admin] REQUEST_METHOD: `PUT` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:06.547652 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a09ff0d-68eb-47f1-8317-4c358a285cbd None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:06.548777 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a09ff0d-68eb-47f1-8317-4c358a285cbd None admin] PATH_INFO: `/v3/projects/bfe93ee8d32a441295efc0b885de4bd7/users/dbe9e38881834198842a476889678096/roles/85be32e3c1ae4269b5456307e0827cc7` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:06.564220 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a09ff0d-68eb-47f1-8317-4c358a285cbd None admin] RBAC: Authorizing `identity:create_grant(project_id=bfe93ee8d32a441295efc0b885de4bd7, user_id=dbe9e38881834198842a476889678096, role_id=85be32e3c1ae4269b5456307e0827cc7)` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:06.565680 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a09ff0d-68eb-47f1-8317-4c358a285cbd None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:06.581013 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 312/626] 10.222.0.67 () {58 vars in 1439 bytes} [Wed May 25 14:28:06 2022] PUT /identity/v3/projects/bfe93ee8d32a441295efc0b885de4bd7/users/dbe9e38881834198842a476889678096/roles/85be32e3c1ae4269b5456307e0827cc7 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 14:28:06.582290 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daabcee-8755-4a53-9ee2-6e8892ea42c0 None None] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:06.582583 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daabcee-8755-4a53-9ee2-6e8892ea42c0 None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:06.582862 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daabcee-8755-4a53-9ee2-6e8892ea42c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:06.603715 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.auth.core [None req-3daabcee-8755-4a53-9ee2-6e8892ea42c0 None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:28:06.605312 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-3daabcee-8755-4a53-9ee2-6e8892ea42c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:28:06.692488 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 313/627] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 14:28:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 14:28:06.720853 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3daabcee-8755-4a53-9ee2-6e8892ea42c0 None None] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:06.750243 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbec337-7364-4413-9fb5-a495b65af71b None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:06.810205 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d4cabb-9f85-40ca-ad23-d7f2b5ddd8ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:06.811109 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d4cabb-9f85-40ca-ad23-d7f2b5ddd8ef None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:06.811558 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d4cabb-9f85-40ca-ad23-d7f2b5ddd8ef None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:06.811886 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d4cabb-9f85-40ca-ad23-d7f2b5ddd8ef None admin] PATH_INFO: `/v3/domains` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:06.812655 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d4cabb-9f85-40ca-ad23-d7f2b5ddd8ef None admin] RBAC: Adding query filter params (name=Default) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:28:06.812967 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d4cabb-9f85-40ca-ad23-d7f2b5ddd8ef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:06.814405 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d4cabb-9f85-40ca-ad23-d7f2b5ddd8ef None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:06.829935 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 315/628] 10.222.0.67 () {56 vars in 1109 bytes} [Wed May 25 14:28:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:28:06.841168 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d4cabb-9f85-40ca-ad23-d7f2b5ddd8ef None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:06.863353 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:06.893254 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3daabcee-8755-4a53-9ee2-6e8892ea42c0 None None] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:06.901090 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:06.970322 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d4cabb-9f85-40ca-ad23-d7f2b5ddd8ef None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:06.983268 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10a00c7-af02-4bd6-81ec-141212e5682c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:06.984198 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10a00c7-af02-4bd6-81ec-141212e5682c None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:06.984420 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10a00c7-af02-4bd6-81ec-141212e5682c None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:06.984707 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10a00c7-af02-4bd6-81ec-141212e5682c None admin] PATH_INFO: `/v3/roles/service` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:07.013530 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4c2b83-fdcd-4e4e-9cbf-cfcd71455533 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:07.015402 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4c2b83-fdcd-4e4e-9cbf-cfcd71455533 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:07.015893 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4c2b83-fdcd-4e4e-9cbf-cfcd71455533 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:07.016345 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4c2b83-fdcd-4e4e-9cbf-cfcd71455533 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:07.020055 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10a00c7-af02-4bd6-81ec-141212e5682c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:28:07.024664 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4c2b83-fdcd-4e4e-9cbf-cfcd71455533 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:07.026365 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4c2b83-fdcd-4e4e-9cbf-cfcd71455533 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:07.034027 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application [None req-a10a00c7-af02-4bd6-81ec-141212e5682c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 25 14:28:07.034027 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:28:07.034027 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:28:07.034027 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:28:07.034027 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:28:07.034027 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:28:07.034027 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:28:07.034027 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:28:07.034027 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:28:07.034027 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:28:07.034027 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:28:07.034027 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:28:07.034027 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:28:07.034027 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:28:07.034027 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:28:07.034027 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:28:07.035095 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:28:07.035095 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:28:07.035095 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:28:07.035095 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:28:07.035095 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:28:07.035095 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:28:07.035095 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:28:07.035095 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:28:07.035095 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:28:07.035095 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:28:07.035095 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:28:07.035095 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application with Lock( May 25 14:28:07.035095 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:28:07.035095 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self._enter() May 25 14:28:07.035095 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:28:07.035095 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:28:07.040668 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:28:07.040668 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.creator() May 25 14:28:07.040668 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:28:07.040668 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application created_value = creator( May 25 14:28:07.040668 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:28:07.040668 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:28:07.040668 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:28:07.040668 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:28:07.040668 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:28:07.040668 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:28:07.040668 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 25 14:28:07.040668 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application May 25 14:28:07.040668 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 314/629] 10.222.0.67 () {56 vars in 1102 bytes} [Wed May 25 14:28:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 316 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 14:28:07.050050 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application [None req-fd4c2b83-fdcd-4e4e-9cbf-cfcd71455533 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 25 14:28:07.050050 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:28:07.050050 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:28:07.050050 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:28:07.050050 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:28:07.050050 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:28:07.050050 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:28:07.050050 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:28:07.050050 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:28:07.050050 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:28:07.050050 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:28:07.050050 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:28:07.050050 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 14:28:07.050050 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 14:28:07.050050 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 14:28:07.050050 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 14:28:07.051447 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:28:07.051447 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:28:07.051447 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 14:28:07.051447 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 14:28:07.051447 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 14:28:07.051447 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 14:28:07.051447 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:28:07.051447 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:28:07.051447 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:28:07.051447 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:28:07.051447 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:28:07.051447 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application with Lock( May 25 14:28:07.051447 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:28:07.051447 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._enter() May 25 14:28:07.051447 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:28:07.051447 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:28:07.051447 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:28:07.051447 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.creator() May 25 14:28:07.052579 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:28:07.052579 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application created_value = creator( May 25 14:28:07.052579 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 14:28:07.052579 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 14:28:07.052579 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 14:28:07.052579 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 14:28:07.052579 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 14:28:07.052579 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 14:28:07.052579 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 25 14:28:07.052579 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:28:07.053141 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10a00c7-af02-4bd6-81ec-141212e5682c None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:07.054769 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 316/630] 10.222.0.67 () {56 vars in 1093 bytes} [Wed May 25 14:28:06 2022] GET /identity/v3/users/nova => generated 82 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:28:07.062743 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4c2b83-fdcd-4e4e-9cbf-cfcd71455533 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:07.211079 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10a00c7-af02-4bd6-81ec-141212e5682c None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:07.215397 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:07.248208 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4c2b83-fdcd-4e4e-9cbf-cfcd71455533 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:07.253886 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd20e36-013b-4faf-92b8-3705189c221a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:07.254571 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd20e36-013b-4faf-92b8-3705189c221a None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:07.254860 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd20e36-013b-4faf-92b8-3705189c221a None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:07.255175 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd20e36-013b-4faf-92b8-3705189c221a None admin] PATH_INFO: `/v3/roles` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:07.255946 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd20e36-013b-4faf-92b8-3705189c221a None admin] RBAC: Adding query filter params (name=service) {{(pid=80474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:28:07.256261 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd20e36-013b-4faf-92b8-3705189c221a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:07.257961 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd20e36-013b-4faf-92b8-3705189c221a None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:07.268910 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 315/631] 10.222.0.67 () {56 vars in 1103 bytes} [Wed May 25 14:28:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:28:07.270351 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e19984d-2335-459c-b88c-1c630034fc6e None None] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:07.270642 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e19984d-2335-459c-b88c-1c630034fc6e None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:07.270926 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e19984d-2335-459c-b88c-1c630034fc6e None None] PATH_INFO: `/` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:07.272476 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 316/632] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 14:28:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:28:07.275378 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e19984d-2335-459c-b88c-1c630034fc6e None None] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:07.298724 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673c0a81-df64-4da1-8cd0-ab8e50676013 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:07.299523 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673c0a81-df64-4da1-8cd0-ab8e50676013 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:07.299905 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673c0a81-df64-4da1-8cd0-ab8e50676013 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:07.300255 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673c0a81-df64-4da1-8cd0-ab8e50676013 None admin] PATH_INFO: `/v3/users` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:07.301726 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673c0a81-df64-4da1-8cd0-ab8e50676013 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:28:07.302110 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673c0a81-df64-4da1-8cd0-ab8e50676013 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:07.304214 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673c0a81-df64-4da1-8cd0-ab8e50676013 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:07.308370 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:07.335964 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 317/633] 10.222.0.67 () {56 vars in 1133 bytes} [Wed May 25 14:28:07 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:28:07.337683 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4b41b6-132d-4ebe-a31a-f743e27b3b8f None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:07.338102 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4b41b6-132d-4ebe-a31a-f743e27b3b8f None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:07.338536 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4b41b6-132d-4ebe-a31a-f743e27b3b8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:07.361639 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-9e4b41b6-132d-4ebe-a31a-f743e27b3b8f None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:28:07.363358 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-9e4b41b6-132d-4ebe-a31a-f743e27b3b8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:28:07.397875 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e19984d-2335-459c-b88c-1c630034fc6e None None] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:07.443439 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced1419b-e83b-4319-b973-62bfc0bf8e89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:07.444714 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced1419b-e83b-4319-b973-62bfc0bf8e89 None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:07.445374 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced1419b-e83b-4319-b973-62bfc0bf8e89 None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:07.445760 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced1419b-e83b-4319-b973-62bfc0bf8e89 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:07.449939 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 318/634] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 14:28:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 14:28:07.451108 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4b41b6-132d-4ebe-a31a-f743e27b3b8f None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:07.458910 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced1419b-e83b-4319-b973-62bfc0bf8e89 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:07.460533 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced1419b-e83b-4319-b973-62bfc0bf8e89 None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:07.484954 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application [None req-ced1419b-e83b-4319-b973-62bfc0bf8e89 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:28:07.484954 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:28:07.484954 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:28:07.484954 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:28:07.484954 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:28:07.484954 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:28:07.484954 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:28:07.484954 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:28:07.484954 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:28:07.484954 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:28:07.484954 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:28:07.484954 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:28:07.484954 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 14:28:07.484954 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 14:28:07.484954 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 14:28:07.485968 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 14:28:07.485968 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:28:07.485968 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:28:07.485968 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:28:07.485968 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:28:07.485968 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:28:07.485968 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:28:07.485968 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:28:07.485968 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application with Lock( May 25 14:28:07.485968 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:28:07.485968 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self._enter() May 25 14:28:07.485968 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:28:07.485968 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:28:07.485968 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:28:07.485968 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.creator() May 25 14:28:07.485968 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:28:07.485968 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application created_value = creator( May 25 14:28:07.486892 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 14:28:07.486892 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 14:28:07.486892 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:28:07.486892 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application May 25 14:28:07.486892 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 317/635] 10.222.0.67 () {56 vars in 1108 bytes} [Wed May 25 14:28:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:28:07.491165 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced1419b-e83b-4319-b973-62bfc0bf8e89 None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:07.536921 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:07.587130 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4b41b6-132d-4ebe-a31a-f743e27b3b8f None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:07.609296 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:07.633628 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8458d21f-508f-4964-a5c3-aefde7f84aa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:07.634004 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced1419b-e83b-4319-b973-62bfc0bf8e89 None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:07.634926 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8458d21f-508f-4964-a5c3-aefde7f84aa0 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:07.635436 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8458d21f-508f-4964-a5c3-aefde7f84aa0 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:07.636036 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8458d21f-508f-4964-a5c3-aefde7f84aa0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:07.681341 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e69ee1-27d2-4c81-b21e-062bc902b298 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:07.682377 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e69ee1-27d2-4c81-b21e-062bc902b298 None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:07.682873 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e69ee1-27d2-4c81-b21e-062bc902b298 None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:07.683382 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e69ee1-27d2-4c81-b21e-062bc902b298 None admin] PATH_INFO: `/v3/domains` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:07.684312 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e69ee1-27d2-4c81-b21e-062bc902b298 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:28:07.684844 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e69ee1-27d2-4c81-b21e-062bc902b298 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:07.687693 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e69ee1-27d2-4c81-b21e-062bc902b298 None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:07.707857 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 318/636] 10.222.0.67 () {56 vars in 1109 bytes} [Wed May 25 14:28:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:28:07.709320 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e69ee1-27d2-4c81-b21e-062bc902b298 None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:07.725863 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8458d21f-508f-4964-a5c3-aefde7f84aa0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:07.727444 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8458d21f-508f-4964-a5c3-aefde7f84aa0 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:07.807617 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:07.848265 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e69ee1-27d2-4c81-b21e-062bc902b298 None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:07.863690 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 319/637] 10.222.0.67 () {58 vars in 1282 bytes} [Wed May 25 14:28:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 14:28:07.864791 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8458d21f-508f-4964-a5c3-aefde7f84aa0 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:07.894114 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f953eb-5941-4db0-801e-f7e663f0c2e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:07.895597 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f953eb-5941-4db0-801e-f7e663f0c2e5 None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:07.895886 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f953eb-5941-4db0-801e-f7e663f0c2e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:07.896160 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f953eb-5941-4db0-801e-f7e663f0c2e5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:07.906744 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:07.911076 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f953eb-5941-4db0-801e-f7e663f0c2e5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:28:07.920195 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application [None req-81f953eb-5941-4db0-801e-f7e663f0c2e5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 25 14:28:07.920195 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:28:07.920195 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:28:07.920195 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:28:07.920195 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:28:07.920195 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:28:07.920195 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:28:07.920195 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:28:07.920195 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:28:07.920195 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:28:07.920195 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:28:07.920195 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:28:07.920195 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:28:07.920195 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:28:07.920195 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:28:07.920195 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:28:07.921946 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:28:07.921946 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:28:07.921946 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:28:07.921946 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:28:07.921946 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:28:07.921946 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:28:07.921946 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:28:07.921946 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:28:07.921946 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:28:07.921946 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:28:07.921946 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:28:07.921946 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application with Lock( May 25 14:28:07.921946 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:28:07.921946 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self._enter() May 25 14:28:07.921946 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:28:07.921946 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:28:07.922787 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:28:07.922787 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.creator() May 25 14:28:07.922787 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:28:07.922787 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application created_value = creator( May 25 14:28:07.922787 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:28:07.922787 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:28:07.922787 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:28:07.922787 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:28:07.922787 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:28:07.922787 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:28:07.922787 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 25 14:28:07.922787 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application May 25 14:28:07.922787 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 319/638] 10.222.0.67 () {56 vars in 1102 bytes} [Wed May 25 14:28:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:28:07.922787 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f953eb-5941-4db0-801e-f7e663f0c2e5 None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:07.989894 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8458d21f-508f-4964-a5c3-aefde7f84aa0 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:08.027234 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009d5abf-ba42-4281-b36f-8715b6c62add None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:08.028173 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009d5abf-ba42-4281-b36f-8715b6c62add None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:08.028481 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009d5abf-ba42-4281-b36f-8715b6c62add None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:08.028728 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009d5abf-ba42-4281-b36f-8715b6c62add None admin] PATH_INFO: `/v3/users/glance` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:08.036233 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009d5abf-ba42-4281-b36f-8715b6c62add None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:08.037997 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009d5abf-ba42-4281-b36f-8715b6c62add None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:08.040916 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f953eb-5941-4db0-801e-f7e663f0c2e5 None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:08.052713 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application [None req-009d5abf-ba42-4281-b36f-8715b6c62add None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 25 14:28:08.052713 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:28:08.052713 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:28:08.052713 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:28:08.052713 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:28:08.052713 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:28:08.052713 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:28:08.052713 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:28:08.052713 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:28:08.052713 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:28:08.052713 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:28:08.052713 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:28:08.052713 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 14:28:08.052713 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 14:28:08.052713 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 14:28:08.052713 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 14:28:08.053854 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:28:08.053854 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:28:08.053854 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 14:28:08.053854 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 14:28:08.053854 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 14:28:08.053854 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 14:28:08.053854 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:28:08.053854 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:28:08.053854 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:28:08.053854 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:28:08.053854 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:28:08.053854 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application with Lock( May 25 14:28:08.053854 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:28:08.053854 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._enter() May 25 14:28:08.053854 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:28:08.053854 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:28:08.053854 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:28:08.053854 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.creator() May 25 14:28:08.055125 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:28:08.055125 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application created_value = creator( May 25 14:28:08.055125 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 14:28:08.055125 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 14:28:08.055125 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 14:28:08.055125 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 14:28:08.055125 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 14:28:08.055125 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 14:28:08.055125 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 25 14:28:08.055125 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:28:08.055125 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 320/639] 10.222.0.67 () {56 vars in 1099 bytes} [Wed May 25 14:28:07 2022] GET /identity/v3/users/glance => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:28:08.055738 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a0ee7a-a540-43a9-ab8a-2482142757e9 None None] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:08.055738 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a0ee7a-a540-43a9-ab8a-2482142757e9 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:08.055738 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a0ee7a-a540-43a9-ab8a-2482142757e9 None None] PATH_INFO: `/` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:08.057133 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 321/640] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 14:28:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:28:08.059808 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a0ee7a-a540-43a9-ab8a-2482142757e9 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:08.084740 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72389783-27da-45b1-b4f2-c97739928cb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:08.085541 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72389783-27da-45b1-b4f2-c97739928cb3 None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:08.085830 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72389783-27da-45b1-b4f2-c97739928cb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:08.086112 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72389783-27da-45b1-b4f2-c97739928cb3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:08.093616 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:08.098693 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72389783-27da-45b1-b4f2-c97739928cb3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:08.100089 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72389783-27da-45b1-b4f2-c97739928cb3 None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:08.118524 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application [None req-72389783-27da-45b1-b4f2-c97739928cb3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:28:08.118524 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:28:08.118524 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:28:08.118524 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:28:08.118524 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:28:08.118524 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:28:08.118524 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:28:08.118524 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:28:08.118524 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:28:08.118524 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:28:08.118524 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:28:08.118524 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:28:08.118524 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 14:28:08.118524 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 14:28:08.118524 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 14:28:08.119542 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 14:28:08.119542 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:28:08.119542 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:28:08.119542 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:28:08.119542 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:28:08.119542 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:28:08.119542 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:28:08.119542 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:28:08.119542 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application with Lock( May 25 14:28:08.119542 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:28:08.119542 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self._enter() May 25 14:28:08.119542 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:28:08.119542 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:28:08.119542 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:28:08.119542 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.creator() May 25 14:28:08.119542 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:28:08.119542 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application created_value = creator( May 25 14:28:08.120445 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 14:28:08.120445 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 14:28:08.120445 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:28:08.120445 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application May 25 14:28:08.120445 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 320/641] 10.222.0.67 () {56 vars in 1108 bytes} [Wed May 25 14:28:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:28:08.121691 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72389783-27da-45b1-b4f2-c97739928cb3 None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:08.178442 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:08.184449 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a0ee7a-a540-43a9-ab8a-2482142757e9 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:08.221004 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88abd419-a380-410a-9d45-79d5398db182 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:08.222015 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88abd419-a380-410a-9d45-79d5398db182 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:08.222306 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88abd419-a380-410a-9d45-79d5398db182 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:08.222636 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88abd419-a380-410a-9d45-79d5398db182 None admin] PATH_INFO: `/v3/roles` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:08.223423 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88abd419-a380-410a-9d45-79d5398db182 None admin] RBAC: Adding query filter params (name=service) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:28:08.223732 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88abd419-a380-410a-9d45-79d5398db182 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:08.225164 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88abd419-a380-410a-9d45-79d5398db182 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:08.230054 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72389783-27da-45b1-b4f2-c97739928cb3 None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:08.238243 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 322/642] 10.222.0.67 () {56 vars in 1103 bytes} [Wed May 25 14:28:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:28:08.238243 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492cc1d1-8c6f-419e-881b-34bc16c691a5 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:08.238243 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492cc1d1-8c6f-419e-881b-34bc16c691a5 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:08.238243 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492cc1d1-8c6f-419e-881b-34bc16c691a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:08.254243 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-492cc1d1-8c6f-419e-881b-34bc16c691a5 None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:28:08.255437 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-492cc1d1-8c6f-419e-881b-34bc16c691a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:28:08.267476 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93849d7e-6ead-4de7-a0e0-48d5c1a9f0b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:08.268224 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93849d7e-6ead-4de7-a0e0-48d5c1a9f0b9 None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:08.268513 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93849d7e-6ead-4de7-a0e0-48d5c1a9f0b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:08.268789 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93849d7e-6ead-4de7-a0e0-48d5c1a9f0b9 None admin] PATH_INFO: `/v3/users` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:08.269728 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93849d7e-6ead-4de7-a0e0-48d5c1a9f0b9 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:28:08.270038 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93849d7e-6ead-4de7-a0e0-48d5c1a9f0b9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:08.271489 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93849d7e-6ead-4de7-a0e0-48d5c1a9f0b9 None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:08.296171 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 321/643] 10.222.0.67 () {56 vars in 1137 bytes} [Wed May 25 14:28:08 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:28:08.296171 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93849d7e-6ead-4de7-a0e0-48d5c1a9f0b9 None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:08.335773 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 323/644] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 14:28:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 14:28:08.336946 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492cc1d1-8c6f-419e-881b-34bc16c691a5 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:08.353175 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:08.431635 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93849d7e-6ead-4de7-a0e0-48d5c1a9f0b9 None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:08.444222 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:08.448174 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492cc1d1-8c6f-419e-881b-34bc16c691a5 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:08.474385 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57217d40-5bef-43b8-bba7-0b0053404e35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:08.475081 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57217d40-5bef-43b8-bba7-0b0053404e35 None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:08.475373 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57217d40-5bef-43b8-bba7-0b0053404e35 None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:08.475653 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57217d40-5bef-43b8-bba7-0b0053404e35 None admin] PATH_INFO: `/v3/domains` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:08.476385 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57217d40-5bef-43b8-bba7-0b0053404e35 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:28:08.476703 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57217d40-5bef-43b8-bba7-0b0053404e35 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:08.478072 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57217d40-5bef-43b8-bba7-0b0053404e35 None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:08.485094 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7d9b81-b050-4437-86e7-cc5f8efbb1ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:08.485893 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7d9b81-b050-4437-86e7-cc5f8efbb1ba None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:08.486174 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7d9b81-b050-4437-86e7-cc5f8efbb1ba None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:08.486445 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7d9b81-b050-4437-86e7-cc5f8efbb1ba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:08.490161 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 322/645] 10.222.0.67 () {56 vars in 1109 bytes} [Wed May 25 14:28:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:28:08.490977 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57217d40-5bef-43b8-bba7-0b0053404e35 None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:08.497967 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7d9b81-b050-4437-86e7-cc5f8efbb1ba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:08.500082 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7d9b81-b050-4437-86e7-cc5f8efbb1ba None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:08.518728 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application [None req-cb7d9b81-b050-4437-86e7-cc5f8efbb1ba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:28:08.518728 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:28:08.518728 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:28:08.518728 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:28:08.518728 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:28:08.518728 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:28:08.518728 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:28:08.518728 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:28:08.518728 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:28:08.518728 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:28:08.518728 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:28:08.518728 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:28:08.518728 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 14:28:08.518728 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 14:28:08.518728 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 14:28:08.519729 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 14:28:08.519729 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:28:08.519729 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:28:08.519729 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:28:08.519729 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:28:08.519729 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:28:08.519729 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:28:08.519729 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:28:08.519729 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application with Lock( May 25 14:28:08.519729 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:28:08.519729 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._enter() May 25 14:28:08.519729 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:28:08.519729 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:28:08.519729 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:28:08.519729 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.creator() May 25 14:28:08.519729 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:28:08.519729 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application created_value = creator( May 25 14:28:08.520831 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 14:28:08.520831 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 14:28:08.520831 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:28:08.520831 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:28:08.520831 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 324/646] 10.222.0.67 () {56 vars in 1108 bytes} [Wed May 25 14:28:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:28:08.520831 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7d9b81-b050-4437-86e7-cc5f8efbb1ba None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:08.593590 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:08.615134 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57217d40-5bef-43b8-bba7-0b0053404e35 None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:08.632240 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7d9b81-b050-4437-86e7-cc5f8efbb1ba None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:08.652829 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac0ac92-e118-4189-8e03-c08ff91288ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:08.653481 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac0ac92-e118-4189-8e03-c08ff91288ce None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:08.653769 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac0ac92-e118-4189-8e03-c08ff91288ce None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:08.654055 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac0ac92-e118-4189-8e03-c08ff91288ce None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:08.668115 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1601df5c-cd61-4d7a-a92f-5bd0f3017356 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:08.668905 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1601df5c-cd61-4d7a-a92f-5bd0f3017356 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:08.669186 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1601df5c-cd61-4d7a-a92f-5bd0f3017356 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:08.669466 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1601df5c-cd61-4d7a-a92f-5bd0f3017356 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:08.681691 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1601df5c-cd61-4d7a-a92f-5bd0f3017356 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:28:08.690057 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application [None req-1601df5c-cd61-4d7a-a92f-5bd0f3017356 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 25 14:28:08.690057 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:28:08.690057 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:28:08.690057 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:28:08.690057 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:28:08.690057 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:28:08.690057 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:28:08.690057 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:28:08.690057 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:28:08.690057 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:28:08.690057 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:28:08.690057 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:28:08.690057 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:28:08.690057 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:28:08.690057 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:28:08.690057 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:28:08.691089 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:28:08.691089 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:28:08.691089 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:28:08.691089 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:28:08.691089 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:28:08.691089 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:28:08.691089 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:28:08.691089 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:28:08.691089 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:28:08.691089 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:28:08.691089 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:28:08.691089 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application with Lock( May 25 14:28:08.691089 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:28:08.691089 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._enter() May 25 14:28:08.691089 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:28:08.691089 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:28:08.691985 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:28:08.691985 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.creator() May 25 14:28:08.691985 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:28:08.691985 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application created_value = creator( May 25 14:28:08.691985 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:28:08.691985 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:28:08.691985 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:28:08.691985 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:28:08.691985 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:28:08.691985 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:28:08.691985 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 25 14:28:08.691985 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:28:08.696075 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 325/647] 10.222.0.67 () {56 vars in 1102 bytes} [Wed May 25 14:28:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:28:08.696701 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1601df5c-cd61-4d7a-a92f-5bd0f3017356 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:08.699612 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:08.730628 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac0ac92-e118-4189-8e03-c08ff91288ce None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:08.732129 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac0ac92-e118-4189-8e03-c08ff91288ce None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:08.801049 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1601df5c-cd61-4d7a-a92f-5bd0f3017356 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:08.830057 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:08.844221 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d27994e-2a41-4134-a4bf-fb209de7308c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:08.844981 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d27994e-2a41-4134-a4bf-fb209de7308c None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:08.845269 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d27994e-2a41-4134-a4bf-fb209de7308c None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:08.845551 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d27994e-2a41-4134-a4bf-fb209de7308c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:08.846386 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 323/648] 10.222.0.67 () {58 vars in 1282 bytes} [Wed May 25 14:28:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 14:28:08.851959 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac0ac92-e118-4189-8e03-c08ff91288ce None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:08.853592 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d27994e-2a41-4134-a4bf-fb209de7308c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:08.855142 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d27994e-2a41-4134-a4bf-fb209de7308c None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:08.872249 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application [None req-0d27994e-2a41-4134-a4bf-fb209de7308c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 14:28:08.872249 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:28:08.872249 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:28:08.872249 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:28:08.872249 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:28:08.872249 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:28:08.872249 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:28:08.872249 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:28:08.872249 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:28:08.872249 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:28:08.872249 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:28:08.872249 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:28:08.872249 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 14:28:08.872249 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 14:28:08.872249 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 14:28:08.873474 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 14:28:08.873474 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:28:08.873474 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:28:08.873474 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:28:08.873474 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:28:08.873474 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:28:08.873474 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:28:08.873474 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:28:08.873474 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application with Lock( May 25 14:28:08.873474 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:28:08.873474 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._enter() May 25 14:28:08.873474 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:28:08.873474 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:28:08.873474 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:28:08.873474 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.creator() May 25 14:28:08.873474 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:28:08.873474 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application created_value = creator( May 25 14:28:08.874597 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 14:28:08.874597 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 14:28:08.874597 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 14:28:08.874597 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 14:28:08.874597 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 14:28:08.874597 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 14:28:08.874597 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 14:28:08.874597 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:28:08.878652 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 326/649] 10.222.0.67 () {56 vars in 1111 bytes} [Wed May 25 14:28:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:28:08.879758 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d27994e-2a41-4134-a4bf-fb209de7308c None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:08.933202 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:08.966562 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac0ac92-e118-4189-8e03-c08ff91288ce None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:08.988644 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d27994e-2a41-4134-a4bf-fb209de7308c None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:09.005342 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142b7739-a354-4a92-be46-db45f61cccf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:09.006022 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142b7739-a354-4a92-be46-db45f61cccf9 None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:09.006314 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142b7739-a354-4a92-be46-db45f61cccf9 None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:09.006596 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142b7739-a354-4a92-be46-db45f61cccf9 None admin] PATH_INFO: `/v3/domains` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:09.007361 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142b7739-a354-4a92-be46-db45f61cccf9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:28:09.007727 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142b7739-a354-4a92-be46-db45f61cccf9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:09.009160 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142b7739-a354-4a92-be46-db45f61cccf9 None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:09.026730 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 324/650] 10.222.0.67 () {56 vars in 1109 bytes} [Wed May 25 14:28:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:28:09.026730 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142b7739-a354-4a92-be46-db45f61cccf9 None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:09.026984 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0b0954-e75b-4031-b58e-117ad245d2c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:09.027366 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0b0954-e75b-4031-b58e-117ad245d2c8 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:09.027570 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0b0954-e75b-4031-b58e-117ad245d2c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:09.027854 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0b0954-e75b-4031-b58e-117ad245d2c8 None admin] PATH_INFO: `/v3/roles` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:09.028616 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0b0954-e75b-4031-b58e-117ad245d2c8 None admin] RBAC: Adding query filter params (name=service) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:28:09.028929 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0b0954-e75b-4031-b58e-117ad245d2c8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:09.030971 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0b0954-e75b-4031-b58e-117ad245d2c8 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:09.039912 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 327/651] 10.222.0.67 () {56 vars in 1103 bytes} [Wed May 25 14:28:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:28:09.040719 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0b0954-e75b-4031-b58e-117ad245d2c8 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:09.090608 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:09.131893 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142b7739-a354-4a92-be46-db45f61cccf9 None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:09.142797 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0b0954-e75b-4031-b58e-117ad245d2c8 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:09.159169 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:09.165241 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e8c1dc-9fb9-4286-be78-8d1816cbe331 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:09.166032 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e8c1dc-9fb9-4286-be78-8d1816cbe331 None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:09.166319 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e8c1dc-9fb9-4286-be78-8d1816cbe331 None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:09.166597 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e8c1dc-9fb9-4286-be78-8d1816cbe331 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:09.175546 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136cb9b4-d37a-4d78-85c7-f261dfc22b6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:09.176200 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136cb9b4-d37a-4d78-85c7-f261dfc22b6e None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:09.176477 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136cb9b4-d37a-4d78-85c7-f261dfc22b6e None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:09.176747 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136cb9b4-d37a-4d78-85c7-f261dfc22b6e None admin] PATH_INFO: `/v3/projects` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:09.177530 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136cb9b4-d37a-4d78-85c7-f261dfc22b6e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:28:09.177834 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136cb9b4-d37a-4d78-85c7-f261dfc22b6e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:09.177934 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e8c1dc-9fb9-4286-be78-8d1816cbe331 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:09.179303 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136cb9b4-d37a-4d78-85c7-f261dfc22b6e None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:09.179404 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e8c1dc-9fb9-4286-be78-8d1816cbe331 None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:09.191466 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 328/652] 10.222.0.67 () {56 vars in 1148 bytes} [Wed May 25 14:28:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:28:09.192235 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136cb9b4-d37a-4d78-85c7-f261dfc22b6e None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:09.196882 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application [None req-06e8c1dc-9fb9-4286-be78-8d1816cbe331 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:28:09.196882 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:28:09.196882 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:28:09.196882 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:28:09.196882 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:28:09.196882 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:28:09.196882 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:28:09.196882 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:28:09.196882 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:28:09.196882 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:28:09.196882 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:28:09.196882 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:28:09.196882 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 14:28:09.196882 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 14:28:09.196882 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 14:28:09.197934 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 14:28:09.197934 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:28:09.197934 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:28:09.197934 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:28:09.197934 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:28:09.197934 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:28:09.197934 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:28:09.197934 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:28:09.197934 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application with Lock( May 25 14:28:09.197934 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:28:09.197934 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self._enter() May 25 14:28:09.197934 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:28:09.197934 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:28:09.197934 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:28:09.197934 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.creator() May 25 14:28:09.197934 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:28:09.197934 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application created_value = creator( May 25 14:28:09.199244 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 14:28:09.199244 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 14:28:09.199244 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:28:09.199244 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application May 25 14:28:09.199244 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 325/653] 10.222.0.67 () {56 vars in 1108 bytes} [Wed May 25 14:28:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:28:09.199554 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0af5e74-6cc3-4042-9c71-07e7c111a200 None None] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:09.199638 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0af5e74-6cc3-4042-9c71-07e7c111a200 None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:09.199856 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0af5e74-6cc3-4042-9c71-07e7c111a200 None None] PATH_INFO: `/` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:09.201305 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 326/654] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 14:28:09 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:28:09.202544 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0af5e74-6cc3-4042-9c71-07e7c111a200 None None] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:09.293686 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136cb9b4-d37a-4d78-85c7-f261dfc22b6e None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:09.303511 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0af5e74-6cc3-4042-9c71-07e7c111a200 None None] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:09.304001 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:09.329701 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18a5fa0-1727-4d83-9c63-98972c02e27a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:09.330496 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18a5fa0-1727-4d83-9c63-98972c02e27a None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:09.330782 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18a5fa0-1727-4d83-9c63-98972c02e27a None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:09.331089 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18a5fa0-1727-4d83-9c63-98972c02e27a None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:09.337184 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc51f1de-c5ec-4e0a-b740-f5fd22a89ff3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:09.337968 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc51f1de-c5ec-4e0a-b740-f5fd22a89ff3 None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:09.338248 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc51f1de-c5ec-4e0a-b740-f5fd22a89ff3 None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:09.338342 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18a5fa0-1727-4d83-9c63-98972c02e27a None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:09.338536 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc51f1de-c5ec-4e0a-b740-f5fd22a89ff3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:09.339851 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18a5fa0-1727-4d83-9c63-98972c02e27a None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:09.349100 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc51f1de-c5ec-4e0a-b740-f5fd22a89ff3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:09.350515 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc51f1de-c5ec-4e0a-b740-f5fd22a89ff3 None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:09.354426 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application [None req-c18a5fa0-1727-4d83-9c63-98972c02e27a None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 25 14:28:09.354426 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:28:09.354426 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:28:09.354426 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:28:09.354426 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:28:09.354426 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:28:09.354426 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:28:09.354426 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:28:09.354426 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:28:09.354426 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:28:09.354426 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:28:09.354426 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:28:09.354426 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 14:28:09.354426 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 14:28:09.354426 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 14:28:09.354426 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 14:28:09.355458 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:28:09.355458 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:28:09.355458 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 14:28:09.355458 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 14:28:09.355458 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 14:28:09.355458 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 14:28:09.355458 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:28:09.355458 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:28:09.355458 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:28:09.355458 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:28:09.355458 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:28:09.355458 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application with Lock( May 25 14:28:09.355458 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:28:09.355458 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._enter() May 25 14:28:09.355458 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:28:09.355458 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:28:09.355458 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:28:09.355458 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.creator() May 25 14:28:09.356421 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:28:09.356421 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application created_value = creator( May 25 14:28:09.356421 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 14:28:09.356421 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 14:28:09.356421 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 14:28:09.356421 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 14:28:09.356421 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 14:28:09.356421 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 14:28:09.356421 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 25 14:28:09.356421 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:28:09.356421 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 329/655] 10.222.0.67 () {56 vars in 1099 bytes} [Wed May 25 14:28:09 2022] GET /identity/v3/users/cinder => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:28:09.356421 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18a5fa0-1727-4d83-9c63-98972c02e27a None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:09.371984 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application [None req-bc51f1de-c5ec-4e0a-b740-f5fd22a89ff3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:28:09.371984 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:28:09.371984 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:28:09.371984 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:28:09.371984 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:28:09.371984 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:28:09.371984 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:28:09.371984 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:28:09.371984 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:28:09.371984 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:28:09.371984 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:28:09.371984 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:28:09.371984 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 14:28:09.371984 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 14:28:09.371984 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 14:28:09.372900 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 14:28:09.372900 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:28:09.372900 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:28:09.372900 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:28:09.372900 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:28:09.372900 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:28:09.372900 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:28:09.372900 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:28:09.372900 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application with Lock( May 25 14:28:09.372900 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:28:09.372900 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self._enter() May 25 14:28:09.372900 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:28:09.372900 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:28:09.372900 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:28:09.372900 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.creator() May 25 14:28:09.372900 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:28:09.372900 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application created_value = creator( May 25 14:28:09.374381 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 14:28:09.374381 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 14:28:09.374381 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:28:09.374381 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application May 25 14:28:09.374381 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 327/656] 10.222.0.67 () {56 vars in 1108 bytes} [Wed May 25 14:28:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:28:09.374844 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc51f1de-c5ec-4e0a-b740-f5fd22a89ff3 None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:09.410793 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:09.460861 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18a5fa0-1727-4d83-9c63-98972c02e27a None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:09.480691 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc51f1de-c5ec-4e0a-b740-f5fd22a89ff3 None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:09.495149 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e347714-8f8c-4c58-adb8-a736ceb043b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:09.495803 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e347714-8f8c-4c58-adb8-a736ceb043b7 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:09.496359 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e347714-8f8c-4c58-adb8-a736ceb043b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:09.496617 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e347714-8f8c-4c58-adb8-a736ceb043b7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:09.497444 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e347714-8f8c-4c58-adb8-a736ceb043b7 None admin] RBAC: Adding query filter params (role.id=85be32e3c1ae4269b5456307e0827cc7, scope.project.id=bfe93ee8d32a441295efc0b885de4bd7, user.id=428ec99478284743943ed41e9d24a603) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:28:09.497754 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e347714-8f8c-4c58-adb8-a736ceb043b7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:09.499702 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e347714-8f8c-4c58-adb8-a736ceb043b7 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:09.505546 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 330/657] 10.222.0.67 () {56 vars in 1374 bytes} [Wed May 25 14:28:09 2022] GET /identity/v3/role_assignments?user.id=428ec99478284743943ed41e9d24a603&scope.project.id=bfe93ee8d32a441295efc0b885de4bd7&role.id=85be32e3c1ae4269b5456307e0827cc7 => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:28:09.506532 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bf5e19-0fdc-4c0b-b2e9-6e8f368d879d None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:09.506819 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bf5e19-0fdc-4c0b-b2e9-6e8f368d879d None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:09.507128 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bf5e19-0fdc-4c0b-b2e9-6e8f368d879d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:09.521492 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bd2e43-8655-4429-b425-7e2f2b89724c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:09.522185 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bd2e43-8655-4429-b425-7e2f2b89724c None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:09.522468 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bd2e43-8655-4429-b425-7e2f2b89724c None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:09.522742 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bd2e43-8655-4429-b425-7e2f2b89724c None admin] PATH_INFO: `/v3/domains` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:09.523535 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bd2e43-8655-4429-b425-7e2f2b89724c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:28:09.523847 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bd2e43-8655-4429-b425-7e2f2b89724c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:09.525269 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bd2e43-8655-4429-b425-7e2f2b89724c None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:09.533216 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-f2bf5e19-0fdc-4c0b-b2e9-6e8f368d879d None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:28:09.534445 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-f2bf5e19-0fdc-4c0b-b2e9-6e8f368d879d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:28:09.546647 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 328/658] 10.222.0.67 () {56 vars in 1109 bytes} [Wed May 25 14:28:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:28:09.546647 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bd2e43-8655-4429-b425-7e2f2b89724c None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:09.571109 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:09.635018 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 331/659] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 14:28:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 14:28:09.635018 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bf5e19-0fdc-4c0b-b2e9-6e8f368d879d None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:09.663312 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:09.673421 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bd2e43-8655-4429-b425-7e2f2b89724c None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:09.717667 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2082ac-4275-4e23-a887-63d28cc9e0e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:09.718351 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2082ac-4275-4e23-a887-63d28cc9e0e2 None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:09.718635 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2082ac-4275-4e23-a887-63d28cc9e0e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:09.718913 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2082ac-4275-4e23-a887-63d28cc9e0e2 None admin] PATH_INFO: `/v3/users` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:09.719954 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2082ac-4275-4e23-a887-63d28cc9e0e2 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:28:09.720130 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2082ac-4275-4e23-a887-63d28cc9e0e2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:09.721712 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2082ac-4275-4e23-a887-63d28cc9e0e2 None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:09.742540 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 329/660] 10.222.0.67 () {56 vars in 1137 bytes} [Wed May 25 14:28:09 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:28:09.743610 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2082ac-4275-4e23-a887-63d28cc9e0e2 None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:09.760928 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bf5e19-0fdc-4c0b-b2e9-6e8f368d879d None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:09.803082 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e03d47-e235-4340-a2f4-b86935d363e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:09.804099 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e03d47-e235-4340-a2f4-b86935d363e4 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:09.804099 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e03d47-e235-4340-a2f4-b86935d363e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:09.804317 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e03d47-e235-4340-a2f4-b86935d363e4 None admin] PATH_INFO: `/v3/domains` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:09.805053 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e03d47-e235-4340-a2f4-b86935d363e4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:28:09.805363 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e03d47-e235-4340-a2f4-b86935d363e4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:09.806737 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e03d47-e235-4340-a2f4-b86935d363e4 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:09.822270 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 332/661] 10.222.0.67 () {56 vars in 1109 bytes} [Wed May 25 14:28:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:28:09.822270 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e03d47-e235-4340-a2f4-b86935d363e4 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:09.854319 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:09.864306 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2082ac-4275-4e23-a887-63d28cc9e0e2 None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:09.902425 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062fbc55-8c42-4da1-96ef-761cb8448bb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:09.903385 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062fbc55-8c42-4da1-96ef-761cb8448bb8 None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:09.903673 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062fbc55-8c42-4da1-96ef-761cb8448bb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:09.903949 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062fbc55-8c42-4da1-96ef-761cb8448bb8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:09.911753 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062fbc55-8c42-4da1-96ef-761cb8448bb8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:09.913217 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062fbc55-8c42-4da1-96ef-761cb8448bb8 None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:09.927767 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application [None req-062fbc55-8c42-4da1-96ef-761cb8448bb8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 14:28:09.927767 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:28:09.927767 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:28:09.927767 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:28:09.927767 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:28:09.927767 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:28:09.927767 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:28:09.927767 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:28:09.927767 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:28:09.927767 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:28:09.927767 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:28:09.927767 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:28:09.927767 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 14:28:09.927767 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 14:28:09.927767 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 14:28:09.928861 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 14:28:09.928861 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:28:09.928861 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:28:09.928861 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:28:09.928861 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:28:09.928861 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:28:09.928861 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:28:09.928861 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:28:09.928861 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application with Lock( May 25 14:28:09.928861 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:28:09.928861 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self._enter() May 25 14:28:09.928861 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:28:09.928861 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:28:09.928861 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:28:09.928861 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.creator() May 25 14:28:09.928861 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:28:09.928861 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application created_value = creator( May 25 14:28:09.931977 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 14:28:09.931977 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 14:28:09.931977 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 14:28:09.931977 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 14:28:09.931977 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 14:28:09.931977 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 14:28:09.931977 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 14:28:09.931977 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application May 25 14:28:09.931977 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 330/662] 10.222.0.67 () {56 vars in 1111 bytes} [Wed May 25 14:28:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:28:09.931977 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062fbc55-8c42-4da1-96ef-761cb8448bb8 None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:09.943868 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e03d47-e235-4340-a2f4-b86935d363e4 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:09.946035 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:09.980761 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c83c50-258f-4638-abd6-bb1652fc46db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:09.981667 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c83c50-258f-4638-abd6-bb1652fc46db None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:09.981948 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c83c50-258f-4638-abd6-bb1652fc46db None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:09.982225 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c83c50-258f-4638-abd6-bb1652fc46db None admin] PATH_INFO: `/v3/roles/service` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:09.993252 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c83c50-258f-4638-abd6-bb1652fc46db None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:28:10.001840 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application [None req-d1c83c50-258f-4638-abd6-bb1652fc46db None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 25 14:28:10.001840 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:28:10.001840 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:28:10.001840 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:28:10.001840 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:28:10.001840 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:28:10.001840 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:28:10.001840 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:28:10.001840 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:28:10.001840 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:28:10.001840 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:28:10.001840 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:28:10.001840 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:28:10.001840 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:28:10.001840 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:28:10.001840 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:28:10.002789 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:28:10.002789 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:28:10.002789 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:28:10.002789 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:28:10.002789 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:28:10.002789 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:28:10.002789 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:28:10.002789 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:28:10.002789 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:28:10.002789 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:28:10.002789 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:28:10.002789 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application with Lock( May 25 14:28:10.002789 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:28:10.002789 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._enter() May 25 14:28:10.002789 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:28:10.002789 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:28:10.003688 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:28:10.003688 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.creator() May 25 14:28:10.003688 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:28:10.003688 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application created_value = creator( May 25 14:28:10.003688 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:28:10.003688 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:28:10.003688 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:28:10.003688 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:28:10.003688 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:28:10.003688 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:28:10.003688 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 25 14:28:10.003688 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:28:10.003688 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 333/663] 10.222.0.67 () {56 vars in 1102 bytes} [Wed May 25 14:28:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:28:10.004474 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c83c50-258f-4638-abd6-bb1652fc46db None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:10.044801 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062fbc55-8c42-4da1-96ef-761cb8448bb8 None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:10.080971 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28ac90b-4eef-444e-9d4a-017f755243af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:10.081616 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28ac90b-4eef-444e-9d4a-017f755243af None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:10.081896 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28ac90b-4eef-444e-9d4a-017f755243af None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:10.082166 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28ac90b-4eef-444e-9d4a-017f755243af None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:10.095849 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:10.118766 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c83c50-258f-4638-abd6-bb1652fc46db None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:10.152921 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28ac90b-4eef-444e-9d4a-017f755243af None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:10.154366 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28ac90b-4eef-444e-9d4a-017f755243af None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:10.157784 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a70594-2786-4537-bacd-415bece5fa98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:10.158740 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a70594-2786-4537-bacd-415bece5fa98 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:10.158854 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a70594-2786-4537-bacd-415bece5fa98 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:10.159173 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a70594-2786-4537-bacd-415bece5fa98 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:10.167223 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a70594-2786-4537-bacd-415bece5fa98 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:10.168448 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a70594-2786-4537-bacd-415bece5fa98 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:10.170147 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:10.183396 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application [None req-39a70594-2786-4537-bacd-415bece5fa98 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 25 14:28:10.183396 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:28:10.183396 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:28:10.183396 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:28:10.183396 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:28:10.183396 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:28:10.183396 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:28:10.183396 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:28:10.183396 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:28:10.183396 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:28:10.183396 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:28:10.183396 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:28:10.183396 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 14:28:10.183396 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 14:28:10.183396 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 14:28:10.183396 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 14:28:10.184375 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:28:10.184375 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:28:10.184375 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 14:28:10.184375 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 14:28:10.184375 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 14:28:10.184375 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 14:28:10.184375 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:28:10.184375 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:28:10.184375 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:28:10.184375 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:28:10.184375 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:28:10.184375 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application with Lock( May 25 14:28:10.184375 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:28:10.184375 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._enter() May 25 14:28:10.184375 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:28:10.184375 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:28:10.184375 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:28:10.184375 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.creator() May 25 14:28:10.185378 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:28:10.185378 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application created_value = creator( May 25 14:28:10.185378 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 14:28:10.185378 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 14:28:10.185378 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 14:28:10.185378 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 14:28:10.185378 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 14:28:10.185378 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 14:28:10.185378 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 25 14:28:10.185378 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:28:10.185378 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 334/664] 10.222.0.67 () {56 vars in 1102 bytes} [Wed May 25 14:28:10 2022] GET /identity/v3/users/neutron => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:28:10.185378 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a70594-2786-4537-bacd-415bece5fa98 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:10.270638 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 331/665] 10.222.0.67 () {58 vars in 1282 bytes} [Wed May 25 14:28:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 14:28:10.270638 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28ac90b-4eef-444e-9d4a-017f755243af None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:10.295529 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a70594-2786-4537-bacd-415bece5fa98 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:10.333486 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01937362-d154-4fed-a46f-cb23a34968c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:10.334167 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01937362-d154-4fed-a46f-cb23a34968c8 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:10.334448 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01937362-d154-4fed-a46f-cb23a34968c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:10.335813 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01937362-d154-4fed-a46f-cb23a34968c8 None admin] PATH_INFO: `/v3/projects` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:10.336629 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01937362-d154-4fed-a46f-cb23a34968c8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:28:10.336945 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01937362-d154-4fed-a46f-cb23a34968c8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:10.338398 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01937362-d154-4fed-a46f-cb23a34968c8 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:10.356506 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 335/666] 10.222.0.67 () {56 vars in 1148 bytes} [Wed May 25 14:28:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:28:10.356506 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01937362-d154-4fed-a46f-cb23a34968c8 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:10.356506 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:10.377889 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28ac90b-4eef-444e-9d4a-017f755243af None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:10.393097 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:10.416654 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03724283-2ec9-4a30-89f6-efe67b3dee8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:10.417328 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03724283-2ec9-4a30-89f6-efe67b3dee8a None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:10.417614 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03724283-2ec9-4a30-89f6-efe67b3dee8a None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:10.417905 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03724283-2ec9-4a30-89f6-efe67b3dee8a None admin] PATH_INFO: `/v3/roles` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:10.418646 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03724283-2ec9-4a30-89f6-efe67b3dee8a None admin] RBAC: Adding query filter params (name=service) {{(pid=80474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:28:10.418962 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03724283-2ec9-4a30-89f6-efe67b3dee8a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:10.421291 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03724283-2ec9-4a30-89f6-efe67b3dee8a None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:10.433827 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 332/667] 10.222.0.67 () {56 vars in 1103 bytes} [Wed May 25 14:28:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:28:10.433827 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03724283-2ec9-4a30-89f6-efe67b3dee8a None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:10.464309 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01937362-d154-4fed-a46f-cb23a34968c8 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:10.502740 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bde858e-b408-4cfb-9ab9-df91eb31eed0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:10.503505 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bde858e-b408-4cfb-9ab9-df91eb31eed0 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:10.503900 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bde858e-b408-4cfb-9ab9-df91eb31eed0 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:10.504177 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bde858e-b408-4cfb-9ab9-df91eb31eed0 None admin] PATH_INFO: `/v3/users` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:10.505005 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bde858e-b408-4cfb-9ab9-df91eb31eed0 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:28:10.505310 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bde858e-b408-4cfb-9ab9-df91eb31eed0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:10.506740 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bde858e-b408-4cfb-9ab9-df91eb31eed0 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:10.529415 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 336/668] 10.222.0.67 () {56 vars in 1139 bytes} [Wed May 25 14:28:10 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:28:10.529415 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bde858e-b408-4cfb-9ab9-df91eb31eed0 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:10.547494 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03724283-2ec9-4a30-89f6-efe67b3dee8a None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:10.583613 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a17cfc-ac6b-4eed-abda-9665cc2b6fa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:10.584410 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a17cfc-ac6b-4eed-abda-9665cc2b6fa9 None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:10.584695 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a17cfc-ac6b-4eed-abda-9665cc2b6fa9 None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:10.584971 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a17cfc-ac6b-4eed-abda-9665cc2b6fa9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:10.590243 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:10.597442 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a17cfc-ac6b-4eed-abda-9665cc2b6fa9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:10.598896 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a17cfc-ac6b-4eed-abda-9665cc2b6fa9 None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:10.617074 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application [None req-41a17cfc-ac6b-4eed-abda-9665cc2b6fa9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:28:10.617074 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:28:10.617074 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:28:10.617074 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:28:10.617074 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:28:10.617074 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:28:10.617074 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:28:10.617074 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:28:10.617074 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:28:10.617074 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:28:10.617074 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:28:10.617074 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:28:10.617074 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 14:28:10.617074 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 14:28:10.617074 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 14:28:10.618216 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 14:28:10.618216 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:28:10.618216 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:28:10.618216 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:28:10.618216 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:28:10.618216 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:28:10.618216 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:28:10.618216 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:28:10.618216 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application with Lock( May 25 14:28:10.618216 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:28:10.618216 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self._enter() May 25 14:28:10.618216 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:28:10.618216 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:28:10.618216 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:28:10.618216 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.creator() May 25 14:28:10.618216 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:28:10.618216 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application created_value = creator( May 25 14:28:10.619692 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 14:28:10.619692 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 14:28:10.619692 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:28:10.619692 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application May 25 14:28:10.619692 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 333/669] 10.222.0.67 () {56 vars in 1108 bytes} [Wed May 25 14:28:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:28:10.619692 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a17cfc-ac6b-4eed-abda-9665cc2b6fa9 None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:10.639130 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bde858e-b408-4cfb-9ab9-df91eb31eed0 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:10.652028 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:10.676969 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8213a5-e65f-4f26-98f4-43f55bdf943d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:10.677842 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8213a5-e65f-4f26-98f4-43f55bdf943d None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:10.678001 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8213a5-e65f-4f26-98f4-43f55bdf943d None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:10.678289 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8213a5-e65f-4f26-98f4-43f55bdf943d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:10.679197 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8213a5-e65f-4f26-98f4-43f55bdf943d None admin] RBAC: Adding query filter params (role.id=85be32e3c1ae4269b5456307e0827cc7, scope.project.id=bfe93ee8d32a441295efc0b885de4bd7, user.id=b5e4d67668ce40509e057f4f4c994521) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:28:10.679513 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8213a5-e65f-4f26-98f4-43f55bdf943d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:10.681013 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8213a5-e65f-4f26-98f4-43f55bdf943d None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:10.699108 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 337/670] 10.222.0.67 () {56 vars in 1374 bytes} [Wed May 25 14:28:10 2022] GET /identity/v3/role_assignments?user.id=b5e4d67668ce40509e057f4f4c994521&scope.project.id=bfe93ee8d32a441295efc0b885de4bd7&role.id=85be32e3c1ae4269b5456307e0827cc7 => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:28:10.699108 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8213a5-e65f-4f26-98f4-43f55bdf943d None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:10.738029 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a17cfc-ac6b-4eed-abda-9665cc2b6fa9 None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:10.782804 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460dbbfd-5f3a-445b-8947-c1d2d91ae69a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:10.783653 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460dbbfd-5f3a-445b-8947-c1d2d91ae69a None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:10.783939 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460dbbfd-5f3a-445b-8947-c1d2d91ae69a None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:10.784218 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460dbbfd-5f3a-445b-8947-c1d2d91ae69a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:10.797002 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460dbbfd-5f3a-445b-8947-c1d2d91ae69a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:10.798559 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460dbbfd-5f3a-445b-8947-c1d2d91ae69a None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:10.818523 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application [None req-460dbbfd-5f3a-445b-8947-c1d2d91ae69a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:28:10.818523 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:28:10.818523 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:28:10.818523 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:28:10.818523 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:28:10.818523 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:28:10.818523 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:28:10.818523 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:28:10.818523 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:28:10.818523 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:28:10.818523 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:28:10.818523 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:28:10.818523 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 14:28:10.818523 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 14:28:10.818523 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 14:28:10.819553 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 14:28:10.819553 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:28:10.819553 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:28:10.819553 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:28:10.819553 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:28:10.819553 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:28:10.819553 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:28:10.819553 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:28:10.819553 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application with Lock( May 25 14:28:10.819553 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:28:10.819553 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self._enter() May 25 14:28:10.819553 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:28:10.819553 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:28:10.819553 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:28:10.819553 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.creator() May 25 14:28:10.819553 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:28:10.819553 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application created_value = creator( May 25 14:28:10.820503 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 14:28:10.820503 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 14:28:10.820503 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:28:10.820503 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application May 25 14:28:10.820503 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 334/671] 10.222.0.67 () {56 vars in 1108 bytes} [Wed May 25 14:28:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:28:10.821252 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460dbbfd-5f3a-445b-8947-c1d2d91ae69a None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:10.863547 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8213a5-e65f-4f26-98f4-43f55bdf943d None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:10.896784 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:10.917002 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ed633b-a835-4e3a-8d06-a9bfaf70f85b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:10.917623 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ed633b-a835-4e3a-8d06-a9bfaf70f85b None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:10.917948 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ed633b-a835-4e3a-8d06-a9bfaf70f85b None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:10.918350 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ed633b-a835-4e3a-8d06-a9bfaf70f85b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:10.929047 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:10.960791 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460dbbfd-5f3a-445b-8947-c1d2d91ae69a None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:11.011026 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd585ac-8445-4813-8343-7ec0f3123146 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:11.011026 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd585ac-8445-4813-8343-7ec0f3123146 None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:11.011026 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd585ac-8445-4813-8343-7ec0f3123146 None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:11.011026 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd585ac-8445-4813-8343-7ec0f3123146 None admin] PATH_INFO: `/v3/domains` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:11.011530 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd585ac-8445-4813-8343-7ec0f3123146 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:28:11.011530 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd585ac-8445-4813-8343-7ec0f3123146 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:11.011970 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ed633b-a835-4e3a-8d06-a9bfaf70f85b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:11.012802 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd585ac-8445-4813-8343-7ec0f3123146 None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:11.013404 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ed633b-a835-4e3a-8d06-a9bfaf70f85b None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:11.028601 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 335/672] 10.222.0.67 () {56 vars in 1109 bytes} [Wed May 25 14:28:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:28:11.029426 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd585ac-8445-4813-8343-7ec0f3123146 None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:11.146615 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd585ac-8445-4813-8343-7ec0f3123146 None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:11.148717 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 338/673] 10.222.0.67 () {58 vars in 1282 bytes} [Wed May 25 14:28:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 458 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 14:28:11.149654 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ed633b-a835-4e3a-8d06-a9bfaf70f85b None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:11.176126 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:11.194344 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb1c0ea-481b-4c47-bf1e-7844fdae21df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:11.195393 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb1c0ea-481b-4c47-bf1e-7844fdae21df None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:11.195681 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb1c0ea-481b-4c47-bf1e-7844fdae21df None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:11.195956 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb1c0ea-481b-4c47-bf1e-7844fdae21df None admin] PATH_INFO: `/v3/domains` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:11.197013 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb1c0ea-481b-4c47-bf1e-7844fdae21df None admin] RBAC: Adding query filter params (name=Default) {{(pid=80474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:28:11.197323 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb1c0ea-481b-4c47-bf1e-7844fdae21df None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:11.199029 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb1c0ea-481b-4c47-bf1e-7844fdae21df None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:11.207901 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:11.221132 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 336/674] 10.222.0.67 () {56 vars in 1109 bytes} [Wed May 25 14:28:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:28:11.221132 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb1c0ea-481b-4c47-bf1e-7844fdae21df None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:11.277815 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ed633b-a835-4e3a-8d06-a9bfaf70f85b None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:11.323654 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0157f44-7635-48ad-8466-8e9a9f6c3110 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:11.324648 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0157f44-7635-48ad-8466-8e9a9f6c3110 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:11.324965 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0157f44-7635-48ad-8466-8e9a9f6c3110 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:11.325395 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0157f44-7635-48ad-8466-8e9a9f6c3110 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:11.333937 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0157f44-7635-48ad-8466-8e9a9f6c3110 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:11.335132 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0157f44-7635-48ad-8466-8e9a9f6c3110 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:11.345027 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb1c0ea-481b-4c47-bf1e-7844fdae21df None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:11.351306 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application [None req-b0157f44-7635-48ad-8466-8e9a9f6c3110 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 14:28:11.351306 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:28:11.351306 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:28:11.351306 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:28:11.351306 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:28:11.351306 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:28:11.351306 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:28:11.351306 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:28:11.351306 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:28:11.351306 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:28:11.351306 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:28:11.351306 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:28:11.351306 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 14:28:11.351306 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 14:28:11.351306 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 14:28:11.352416 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 14:28:11.352416 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:28:11.352416 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:28:11.352416 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:28:11.352416 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:28:11.352416 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:28:11.352416 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:28:11.352416 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:28:11.352416 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application with Lock( May 25 14:28:11.352416 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:28:11.352416 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._enter() May 25 14:28:11.352416 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:28:11.352416 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:28:11.352416 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:28:11.352416 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.creator() May 25 14:28:11.352416 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:28:11.352416 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application created_value = creator( May 25 14:28:11.353568 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 14:28:11.353568 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 14:28:11.353568 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 14:28:11.353568 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 14:28:11.353568 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 14:28:11.353568 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 14:28:11.353568 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 14:28:11.353568 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:28:11.359511 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 339/675] 10.222.0.67 () {56 vars in 1111 bytes} [Wed May 25 14:28:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:28:11.360432 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0157f44-7635-48ad-8466-8e9a9f6c3110 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:11.391364 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969745d3-eeb8-4d32-b869-116eea024a28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:11.392899 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969745d3-eeb8-4d32-b869-116eea024a28 None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:11.393463 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969745d3-eeb8-4d32-b869-116eea024a28 None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:11.393922 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969745d3-eeb8-4d32-b869-116eea024a28 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:11.407927 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969745d3-eeb8-4d32-b869-116eea024a28 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:11.409602 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969745d3-eeb8-4d32-b869-116eea024a28 None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:11.428759 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application [None req-969745d3-eeb8-4d32-b869-116eea024a28 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:28:11.428759 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:28:11.428759 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:28:11.428759 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:28:11.428759 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:28:11.428759 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:28:11.428759 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:28:11.428759 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:28:11.428759 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:28:11.428759 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:28:11.428759 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:28:11.428759 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:28:11.428759 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 14:28:11.428759 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 14:28:11.428759 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 14:28:11.429701 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 14:28:11.429701 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:28:11.429701 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:28:11.429701 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:28:11.429701 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:28:11.429701 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:28:11.429701 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:28:11.429701 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:28:11.429701 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application with Lock( May 25 14:28:11.429701 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:28:11.429701 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self._enter() May 25 14:28:11.429701 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:28:11.429701 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:28:11.429701 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:28:11.429701 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.creator() May 25 14:28:11.429701 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:28:11.429701 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application created_value = creator( May 25 14:28:11.430788 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 14:28:11.430788 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 14:28:11.430788 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:28:11.430788 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application May 25 14:28:11.430788 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 337/676] 10.222.0.67 () {56 vars in 1108 bytes} [Wed May 25 14:28:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:28:11.431668 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969745d3-eeb8-4d32-b869-116eea024a28 None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:11.459023 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:11.478044 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0157f44-7635-48ad-8466-8e9a9f6c3110 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:11.500401 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:11.522001 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296ef842-fa2b-48ad-acbc-c2a03c59ff7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:11.523351 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296ef842-fa2b-48ad-acbc-c2a03c59ff7e None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:11.523351 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296ef842-fa2b-48ad-acbc-c2a03c59ff7e None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:11.523560 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296ef842-fa2b-48ad-acbc-c2a03c59ff7e None admin] PATH_INFO: `/v3/users/swift` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:11.533906 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296ef842-fa2b-48ad-acbc-c2a03c59ff7e None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:11.536023 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296ef842-fa2b-48ad-acbc-c2a03c59ff7e None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:11.557089 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application [None req-296ef842-fa2b-48ad-acbc-c2a03c59ff7e None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 25 14:28:11.557089 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:28:11.557089 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:28:11.557089 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:28:11.557089 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:28:11.557089 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:28:11.557089 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:28:11.557089 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:28:11.557089 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:28:11.557089 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:28:11.557089 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:28:11.557089 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:28:11.557089 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 14:28:11.557089 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 14:28:11.557089 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 14:28:11.557089 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 14:28:11.558107 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:28:11.558107 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:28:11.558107 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 14:28:11.558107 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 14:28:11.558107 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 14:28:11.558107 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 14:28:11.558107 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:28:11.558107 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:28:11.558107 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:28:11.558107 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:28:11.558107 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:28:11.558107 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application with Lock( May 25 14:28:11.558107 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:28:11.558107 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._enter() May 25 14:28:11.558107 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:28:11.558107 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:28:11.558107 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:28:11.558107 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.creator() May 25 14:28:11.559094 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:28:11.559094 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application created_value = creator( May 25 14:28:11.559094 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 14:28:11.559094 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 14:28:11.559094 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 14:28:11.559094 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 14:28:11.559094 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 14:28:11.559094 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 14:28:11.559094 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 25 14:28:11.559094 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:28:11.565587 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 340/677] 10.222.0.67 () {56 vars in 1096 bytes} [Wed May 25 14:28:11 2022] GET /identity/v3/users/swift => generated 83 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:28:11.565587 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296ef842-fa2b-48ad-acbc-c2a03c59ff7e None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:11.570527 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969745d3-eeb8-4d32-b869-116eea024a28 None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:11.615831 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c4ca28-b5b6-4ab7-b639-804ff223ce75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:11.617402 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c4ca28-b5b6-4ab7-b639-804ff223ce75 None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:11.618197 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c4ca28-b5b6-4ab7-b639-804ff223ce75 None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:11.618684 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c4ca28-b5b6-4ab7-b639-804ff223ce75 None admin] PATH_INFO: `/v3/projects` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:11.619983 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c4ca28-b5b6-4ab7-b639-804ff223ce75 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:28:11.620861 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c4ca28-b5b6-4ab7-b639-804ff223ce75 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:11.626580 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c4ca28-b5b6-4ab7-b639-804ff223ce75 None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:11.651767 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 338/678] 10.222.0.67 () {56 vars in 1148 bytes} [Wed May 25 14:28:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:28:11.653045 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c4ca28-b5b6-4ab7-b639-804ff223ce75 None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:11.691627 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296ef842-fa2b-48ad-acbc-c2a03c59ff7e None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:11.736229 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce4d76f-de3f-4bbc-9037-0538200b9862 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:11.737716 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce4d76f-de3f-4bbc-9037-0538200b9862 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:11.738297 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce4d76f-de3f-4bbc-9037-0538200b9862 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:11.738830 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce4d76f-de3f-4bbc-9037-0538200b9862 None admin] PATH_INFO: `/v3/domains` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:11.740079 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce4d76f-de3f-4bbc-9037-0538200b9862 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:28:11.740540 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce4d76f-de3f-4bbc-9037-0538200b9862 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:11.742955 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce4d76f-de3f-4bbc-9037-0538200b9862 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:11.760089 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 341/679] 10.222.0.67 () {56 vars in 1109 bytes} [Wed May 25 14:28:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:28:11.761666 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce4d76f-de3f-4bbc-9037-0538200b9862 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:11.772195 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:11.786769 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c4ca28-b5b6-4ab7-b639-804ff223ce75 None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:11.799722 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:11.831735 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dfaf15-5c97-4caa-a132-fe6aba1e7d80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:11.832991 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dfaf15-5c97-4caa-a132-fe6aba1e7d80 None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:11.833738 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dfaf15-5c97-4caa-a132-fe6aba1e7d80 None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:11.834612 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dfaf15-5c97-4caa-a132-fe6aba1e7d80 None admin] PATH_INFO: `/v3/users` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:11.836379 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82dfaf15-5c97-4caa-a132-fe6aba1e7d80 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:28:11.836699 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82dfaf15-5c97-4caa-a132-fe6aba1e7d80 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:11.838215 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82dfaf15-5c97-4caa-a132-fe6aba1e7d80 None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:11.862403 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 339/680] 10.222.0.67 () {56 vars in 1135 bytes} [Wed May 25 14:28:11 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:28:11.862403 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dfaf15-5c97-4caa-a132-fe6aba1e7d80 None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:11.890125 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce4d76f-de3f-4bbc-9037-0538200b9862 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:11.929224 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fca987d-f911-4df7-9524-3b3f4b039bc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:11.930165 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fca987d-f911-4df7-9524-3b3f4b039bc4 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:11.930278 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fca987d-f911-4df7-9524-3b3f4b039bc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:11.930510 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fca987d-f911-4df7-9524-3b3f4b039bc4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:11.931381 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fca987d-f911-4df7-9524-3b3f4b039bc4 None admin] RBAC: Adding query filter params (role.id=85be32e3c1ae4269b5456307e0827cc7, scope.project.id=bfe93ee8d32a441295efc0b885de4bd7, user.id=6e462acc9da84a61bb23998dd54e1858) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:28:11.931705 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fca987d-f911-4df7-9524-3b3f4b039bc4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:11.933132 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fca987d-f911-4df7-9524-3b3f4b039bc4 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:11.939789 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 342/681] 10.222.0.67 () {56 vars in 1374 bytes} [Wed May 25 14:28:11 2022] GET /identity/v3/role_assignments?user.id=6e462acc9da84a61bb23998dd54e1858&scope.project.id=bfe93ee8d32a441295efc0b885de4bd7&role.id=85be32e3c1ae4269b5456307e0827cc7 => generated 608 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:28:11.940868 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037e8c5a-7a35-472e-ae25-f0e273ef3c11 None None] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:11.941155 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037e8c5a-7a35-472e-ae25-f0e273ef3c11 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:11.941433 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037e8c5a-7a35-472e-ae25-f0e273ef3c11 None None] PATH_INFO: `/` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:11.942913 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 343/682] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 14:28:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:28:11.947780 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037e8c5a-7a35-472e-ae25-f0e273ef3c11 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:11.981703 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dfaf15-5c97-4caa-a132-fe6aba1e7d80 None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:12.027666 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7270393e-0348-4dcb-ab24-8e6ce6b93655 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:12.028535 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7270393e-0348-4dcb-ab24-8e6ce6b93655 None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:12.028823 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7270393e-0348-4dcb-ab24-8e6ce6b93655 None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:12.029106 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7270393e-0348-4dcb-ab24-8e6ce6b93655 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:12.036464 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:12.039484 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7270393e-0348-4dcb-ab24-8e6ce6b93655 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:12.042041 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7270393e-0348-4dcb-ab24-8e6ce6b93655 None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:12.060013 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application [None req-7270393e-0348-4dcb-ab24-8e6ce6b93655 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 14:28:12.060013 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:28:12.060013 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:28:12.060013 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:28:12.060013 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:28:12.060013 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:28:12.060013 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:28:12.060013 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:28:12.060013 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:28:12.060013 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:28:12.060013 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:28:12.060013 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:28:12.060013 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 14:28:12.060013 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 14:28:12.060013 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 14:28:12.061114 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 14:28:12.061114 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:28:12.061114 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:28:12.061114 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:28:12.061114 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:28:12.061114 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:28:12.061114 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:28:12.061114 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:28:12.061114 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application with Lock( May 25 14:28:12.061114 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:28:12.061114 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self._enter() May 25 14:28:12.061114 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:28:12.061114 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:28:12.061114 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:28:12.061114 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.creator() May 25 14:28:12.061114 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:28:12.061114 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application created_value = creator( May 25 14:28:12.062024 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 14:28:12.062024 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 14:28:12.062024 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 14:28:12.062024 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 14:28:12.062024 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 14:28:12.062024 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 14:28:12.062024 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 14:28:12.062024 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application May 25 14:28:12.064416 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 340/683] 10.222.0.67 () {56 vars in 1111 bytes} [Wed May 25 14:28:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:28:12.065971 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc01216f-9fe8-4669-9207-5469061c8497 None None] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:12.066417 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc01216f-9fe8-4669-9207-5469061c8497 None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:12.066943 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc01216f-9fe8-4669-9207-5469061c8497 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:12.084540 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037e8c5a-7a35-472e-ae25-f0e273ef3c11 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:12.093102 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.auth.core [None req-cc01216f-9fe8-4669-9207-5469061c8497 None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:28:12.095300 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-cc01216f-9fe8-4669-9207-5469061c8497 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:28:12.116918 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd57a53-b920-423b-af6f-3a969f720151 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:12.117673 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd57a53-b920-423b-af6f-3a969f720151 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:12.118047 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd57a53-b920-423b-af6f-3a969f720151 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:12.118386 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd57a53-b920-423b-af6f-3a969f720151 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:12.144236 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:12.192400 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 341/684] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 14:28:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 14:28:12.200016 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc01216f-9fe8-4669-9207-5469061c8497 None None] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:12.220518 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd57a53-b920-423b-af6f-3a969f720151 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:12.221991 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd57a53-b920-423b-af6f-3a969f720151 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:12.311953 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:12.315752 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc01216f-9fe8-4669-9207-5469061c8497 None None] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:12.351448 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 344/685] 10.222.0.67 () {58 vars in 1282 bytes} [Wed May 25 14:28:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 14:28:12.352127 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e20f7e-f341-4029-9a5b-7377f125313d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:12.352353 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd57a53-b920-423b-af6f-3a969f720151 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:12.353241 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e20f7e-f341-4029-9a5b-7377f125313d None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:12.353750 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e20f7e-f341-4029-9a5b-7377f125313d None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:12.354232 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e20f7e-f341-4029-9a5b-7377f125313d None admin] PATH_INFO: `/v3/projects` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:12.355294 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e20f7e-f341-4029-9a5b-7377f125313d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:28:12.355825 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e20f7e-f341-4029-9a5b-7377f125313d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:12.357492 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e20f7e-f341-4029-9a5b-7377f125313d None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:12.376058 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 342/686] 10.222.0.67 () {56 vars in 1148 bytes} [Wed May 25 14:28:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:28:12.381798 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e20f7e-f341-4029-9a5b-7377f125313d None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:12.402595 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:12.466693 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd57a53-b920-423b-af6f-3a969f720151 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:12.489975 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e20f7e-f341-4029-9a5b-7377f125313d None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:12.505552 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9dc40b-9f14-4d9e-9b54-5544b4d2cb35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:12.506366 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9dc40b-9f14-4d9e-9b54-5544b4d2cb35 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:12.506674 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9dc40b-9f14-4d9e-9b54-5544b4d2cb35 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:12.507263 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9dc40b-9f14-4d9e-9b54-5544b4d2cb35 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:12.518695 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9dc40b-9f14-4d9e-9b54-5544b4d2cb35 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:28:12.526931 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application [None req-7b9dc40b-9f14-4d9e-9b54-5544b4d2cb35 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 14:28:12.526931 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:28:12.526931 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:28:12.526931 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:28:12.526931 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:28:12.526931 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:28:12.526931 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:28:12.526931 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:28:12.526931 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:28:12.526931 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:28:12.526931 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:28:12.526931 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:28:12.526931 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:28:12.526931 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:28:12.526931 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:28:12.526931 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:28:12.527903 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:28:12.527903 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:28:12.527903 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:28:12.527903 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:28:12.527903 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:28:12.527903 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:28:12.527903 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:28:12.527903 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:28:12.527903 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:28:12.527903 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:28:12.527903 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:28:12.527903 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application with Lock( May 25 14:28:12.527903 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:28:12.527903 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._enter() May 25 14:28:12.527903 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:28:12.527903 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:28:12.528759 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:28:12.528759 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.creator() May 25 14:28:12.528759 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:28:12.528759 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application created_value = creator( May 25 14:28:12.528759 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:28:12.528759 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:28:12.528759 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:28:12.528759 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:28:12.528759 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:28:12.528759 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:28:12.528759 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 14:28:12.528759 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:28:12.532665 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5762b0ab-5b5f-4d2d-ac81-bf2ea26a06ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:12.533674 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 345/687] 10.222.0.67 () {56 vars in 1096 bytes} [Wed May 25 14:28:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:28:12.533957 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5762b0ab-5b5f-4d2d-ac81-bf2ea26a06ce None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:12.534466 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5762b0ab-5b5f-4d2d-ac81-bf2ea26a06ce None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:12.534587 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9dc40b-9f14-4d9e-9b54-5544b4d2cb35 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:12.535168 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5762b0ab-5b5f-4d2d-ac81-bf2ea26a06ce None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:12.548069 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5762b0ab-5b5f-4d2d-ac81-bf2ea26a06ce None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:12.550178 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5762b0ab-5b5f-4d2d-ac81-bf2ea26a06ce None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:12.569356 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application [None req-5762b0ab-5b5f-4d2d-ac81-bf2ea26a06ce None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:28:12.569356 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:28:12.569356 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:28:12.569356 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:28:12.569356 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:28:12.569356 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:28:12.569356 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:28:12.569356 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:28:12.569356 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:28:12.569356 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:28:12.569356 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:28:12.569356 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:28:12.569356 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 14:28:12.569356 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 14:28:12.569356 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 14:28:12.570311 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 14:28:12.570311 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:28:12.570311 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:28:12.570311 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:28:12.570311 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:28:12.570311 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:28:12.570311 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:28:12.570311 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:28:12.570311 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application with Lock( May 25 14:28:12.570311 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:28:12.570311 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self._enter() May 25 14:28:12.570311 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:28:12.570311 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:28:12.570311 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:28:12.570311 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.creator() May 25 14:28:12.570311 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:28:12.570311 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application created_value = creator( May 25 14:28:12.571277 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 14:28:12.571277 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 14:28:12.571277 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:28:12.571277 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application May 25 14:28:12.571937 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:12.573767 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 343/688] 10.222.0.67 () {56 vars in 1108 bytes} [Wed May 25 14:28:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:28:12.574857 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5762b0ab-5b5f-4d2d-ac81-bf2ea26a06ce None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:12.647650 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:12.657032 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9dc40b-9f14-4d9e-9b54-5544b4d2cb35 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:12.682908 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5762b0ab-5b5f-4d2d-ac81-bf2ea26a06ce None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:12.696080 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9229f5-7363-4605-9610-85cf1c044bd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:12.696751 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9229f5-7363-4605-9610-85cf1c044bd3 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:12.697009 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9229f5-7363-4605-9610-85cf1c044bd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:12.697284 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9229f5-7363-4605-9610-85cf1c044bd3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:12.698125 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9229f5-7363-4605-9610-85cf1c044bd3 None admin] RBAC: Adding query filter params (role.id=85be32e3c1ae4269b5456307e0827cc7, scope.project.id=bfe93ee8d32a441295efc0b885de4bd7, user.id=b68eed985c7b49839bcdd173186ad4ba) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:28:12.698438 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9229f5-7363-4605-9610-85cf1c044bd3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:12.700064 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9229f5-7363-4605-9610-85cf1c044bd3 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:12.715193 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 346/689] 10.222.0.67 () {56 vars in 1374 bytes} [Wed May 25 14:28:12 2022] GET /identity/v3/role_assignments?user.id=b68eed985c7b49839bcdd173186ad4ba&scope.project.id=bfe93ee8d32a441295efc0b885de4bd7&role.id=85be32e3c1ae4269b5456307e0827cc7 => generated 608 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:28:12.716392 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9229f5-7363-4605-9610-85cf1c044bd3 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:12.722715 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07730d34-7fc8-48be-8e7b-7a5275909966 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:12.723709 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07730d34-7fc8-48be-8e7b-7a5275909966 None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:12.724250 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07730d34-7fc8-48be-8e7b-7a5275909966 None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:12.724740 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07730d34-7fc8-48be-8e7b-7a5275909966 None admin] PATH_INFO: `/v3/roles` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:12.725732 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07730d34-7fc8-48be-8e7b-7a5275909966 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:28:12.726260 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07730d34-7fc8-48be-8e7b-7a5275909966 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:12.727910 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07730d34-7fc8-48be-8e7b-7a5275909966 None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:12.738171 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 344/690] 10.222.0.67 () {56 vars in 1099 bytes} [Wed May 25 14:28:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:28:12.743985 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07730d34-7fc8-48be-8e7b-7a5275909966 None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:12.866611 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07730d34-7fc8-48be-8e7b-7a5275909966 None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:12.894313 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:12.905794 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd04f40-2f79-469f-81d3-624f3b6b4a3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:12.911309 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:12.911884 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd04f40-2f79-469f-81d3-624f3b6b4a3e None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:12.912476 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd04f40-2f79-469f-81d3-624f3b6b4a3e None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:12.913717 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd04f40-2f79-469f-81d3-624f3b6b4a3e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:12.921242 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9229f5-7363-4605-9610-85cf1c044bd3 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:12.934808 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd04f40-2f79-469f-81d3-624f3b6b4a3e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:12.941547 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd04f40-2f79-469f-81d3-624f3b6b4a3e None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:12.976090 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application [None req-efd04f40-2f79-469f-81d3-624f3b6b4a3e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:28:12.976090 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:28:12.976090 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:28:12.976090 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:28:12.976090 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:28:12.976090 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:28:12.976090 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:28:12.976090 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:28:12.976090 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:28:12.976090 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:28:12.976090 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:28:12.976090 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:28:12.976090 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 14:28:12.976090 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 14:28:12.976090 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 14:28:12.977101 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 14:28:12.977101 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:28:12.977101 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:28:12.977101 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:28:12.977101 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:28:12.977101 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:28:12.977101 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:28:12.977101 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:28:12.977101 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application with Lock( May 25 14:28:12.977101 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:28:12.977101 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self._enter() May 25 14:28:12.977101 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:28:12.977101 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:28:12.977101 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:28:12.977101 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.creator() May 25 14:28:12.977101 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:28:12.977101 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application created_value = creator( May 25 14:28:12.978013 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 14:28:12.978013 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 14:28:12.978013 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:28:12.978013 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application May 25 14:28:12.981414 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 345/691] 10.222.0.67 () {56 vars in 1108 bytes} [Wed May 25 14:28:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 14:28:12.989278 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd04f40-2f79-469f-81d3-624f3b6b4a3e None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:13.020651 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805cc51d-a655-40da-8933-87f3afbb8c83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:13.021738 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805cc51d-a655-40da-8933-87f3afbb8c83 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:13.022252 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805cc51d-a655-40da-8933-87f3afbb8c83 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:13.022751 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805cc51d-a655-40da-8933-87f3afbb8c83 None admin] PATH_INFO: `/v3/domains` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:13.023757 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805cc51d-a655-40da-8933-87f3afbb8c83 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:28:13.027088 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805cc51d-a655-40da-8933-87f3afbb8c83 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:13.028777 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805cc51d-a655-40da-8933-87f3afbb8c83 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:13.053979 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 347/692] 10.222.0.67 () {56 vars in 1109 bytes} [Wed May 25 14:28:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 338 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:28:13.059546 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805cc51d-a655-40da-8933-87f3afbb8c83 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:13.174121 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd04f40-2f79-469f-81d3-624f3b6b4a3e None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:13.195844 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805cc51d-a655-40da-8933-87f3afbb8c83 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:13.216082 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c28e37f-daee-4cd8-a392-d7fd669772ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:13.216904 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c28e37f-daee-4cd8-a392-d7fd669772ab None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:13.218029 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c28e37f-daee-4cd8-a392-d7fd669772ab None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:13.218308 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c28e37f-daee-4cd8-a392-d7fd669772ab None admin] PATH_INFO: `/v3/domains` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:13.219066 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c28e37f-daee-4cd8-a392-d7fd669772ab None admin] RBAC: Adding query filter params (name=Default) {{(pid=80474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:28:13.219380 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c28e37f-daee-4cd8-a392-d7fd669772ab None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:13.221184 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c28e37f-daee-4cd8-a392-d7fd669772ab None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:13.234968 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58471150-7b12-46dd-bbd1-2e4d809da3e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:13.236130 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58471150-7b12-46dd-bbd1-2e4d809da3e5 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:13.236651 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58471150-7b12-46dd-bbd1-2e4d809da3e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:13.237029 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58471150-7b12-46dd-bbd1-2e4d809da3e5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:13.240723 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 346/693] 10.222.0.67 () {56 vars in 1109 bytes} [Wed May 25 14:28:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:28:13.242272 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e059b5-2c2b-43fd-bc4c-b77209a6616f None None] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:13.242703 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e059b5-2c2b-43fd-bc4c-b77209a6616f None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:13.243154 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e059b5-2c2b-43fd-bc4c-b77209a6616f None None] PATH_INFO: `/` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:13.244747 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 347/694] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 14:28:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:28:13.248993 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e059b5-2c2b-43fd-bc4c-b77209a6616f None None] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:13.251589 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58471150-7b12-46dd-bbd1-2e4d809da3e5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:13.253139 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58471150-7b12-46dd-bbd1-2e4d809da3e5 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:13.274459 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application [None req-58471150-7b12-46dd-bbd1-2e4d809da3e5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 14:28:13.274459 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:28:13.274459 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:28:13.274459 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:28:13.274459 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:28:13.274459 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:28:13.274459 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:28:13.274459 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:28:13.274459 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:28:13.274459 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:28:13.274459 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:28:13.274459 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:28:13.274459 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 14:28:13.274459 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 14:28:13.274459 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 14:28:13.275482 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 14:28:13.275482 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:28:13.275482 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:28:13.275482 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:28:13.275482 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:28:13.275482 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:28:13.275482 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:28:13.275482 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:28:13.275482 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application with Lock( May 25 14:28:13.275482 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:28:13.275482 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._enter() May 25 14:28:13.275482 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:28:13.275482 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:28:13.275482 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:28:13.275482 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.creator() May 25 14:28:13.275482 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:28:13.275482 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application created_value = creator( May 25 14:28:13.276384 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 14:28:13.276384 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 14:28:13.276384 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 14:28:13.276384 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 14:28:13.276384 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 14:28:13.276384 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 14:28:13.276384 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 14:28:13.276384 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:28:13.276384 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 348/695] 10.222.0.67 () {56 vars in 1111 bytes} [Wed May 25 14:28:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 14:28:13.277911 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5195d2-4bfa-46d0-aa26-1a46c3d907b3 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:13.278487 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5195d2-4bfa-46d0-aa26-1a46c3d907b3 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:13.278833 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5195d2-4bfa-46d0-aa26-1a46c3d907b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:13.304831 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:13.306723 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-8b5195d2-4bfa-46d0-aa26-1a46c3d907b3 None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:28:13.309111 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-8b5195d2-4bfa-46d0-aa26-1a46c3d907b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:28:13.323373 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:13.376962 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e059b5-2c2b-43fd-bc4c-b77209a6616f None None] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:13.399251 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 349/696] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 14:28:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 14:28:13.400474 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5195d2-4bfa-46d0-aa26-1a46c3d907b3 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:13.419980 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4550c69-455f-46d8-9122-729bc578bb45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:13.422199 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4550c69-455f-46d8-9122-729bc578bb45 None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:13.422199 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4550c69-455f-46d8-9122-729bc578bb45 None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:13.422473 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4550c69-455f-46d8-9122-729bc578bb45 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:13.436382 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4550c69-455f-46d8-9122-729bc578bb45 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:13.438112 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4550c69-455f-46d8-9122-729bc578bb45 None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:13.532395 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5195d2-4bfa-46d0-aa26-1a46c3d907b3 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:13.572097 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366f9988-5139-4483-ac74-a3636301f224 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:13.572803 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366f9988-5139-4483-ac74-a3636301f224 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:13.573089 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366f9988-5139-4483-ac74-a3636301f224 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:13.573372 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366f9988-5139-4483-ac74-a3636301f224 None admin] PATH_INFO: `/v3/projects` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:13.574174 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366f9988-5139-4483-ac74-a3636301f224 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:28:13.574491 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366f9988-5139-4483-ac74-a3636301f224 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:13.575983 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366f9988-5139-4483-ac74-a3636301f224 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:13.577732 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application [None req-a4550c69-455f-46d8-9122-729bc578bb45 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 25 14:28:13.577732 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:28:13.577732 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:28:13.577732 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:28:13.577732 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:28:13.577732 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:28:13.577732 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:28:13.577732 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:28:13.577732 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:28:13.577732 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:28:13.577732 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:28:13.577732 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:28:13.577732 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 14:28:13.577732 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 14:28:13.577732 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 14:28:13.577732 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 14:28:13.578668 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:28:13.578668 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:28:13.578668 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 14:28:13.578668 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 14:28:13.578668 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 14:28:13.578668 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 14:28:13.578668 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:28:13.578668 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:28:13.578668 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:28:13.578668 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:28:13.578668 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:28:13.578668 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application with Lock( May 25 14:28:13.578668 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:28:13.578668 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self._enter() May 25 14:28:13.578668 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:28:13.578668 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:28:13.578668 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:28:13.578668 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.creator() May 25 14:28:13.579682 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:28:13.579682 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application created_value = creator( May 25 14:28:13.579682 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 14:28:13.579682 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 14:28:13.579682 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 14:28:13.579682 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 14:28:13.579682 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 14:28:13.579682 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 14:28:13.579682 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 25 14:28:13.579682 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application May 25 14:28:13.582387 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 348/697] 10.222.0.67 () {56 vars in 1093 bytes} [Wed May 25 14:28:13 2022] GET /identity/v3/users/nova => generated 82 bytes in 335 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 14:28:13.583415 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4550c69-455f-46d8-9122-729bc578bb45 None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:13.599050 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 350/698] 10.222.0.67 () {56 vars in 1148 bytes} [Wed May 25 14:28:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:28:13.599050 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366f9988-5139-4483-ac74-a3636301f224 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:13.643372 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:13.699071 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4550c69-455f-46d8-9122-729bc578bb45 None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:13.702457 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:13.735852 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366f9988-5139-4483-ac74-a3636301f224 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:13.738553 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17657ca4-4356-438d-9780-b02d25d8d8b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:13.739633 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17657ca4-4356-438d-9780-b02d25d8d8b7 None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:13.740113 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17657ca4-4356-438d-9780-b02d25d8d8b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:13.740599 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17657ca4-4356-438d-9780-b02d25d8d8b7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:13.751896 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17657ca4-4356-438d-9780-b02d25d8d8b7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:13.753664 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17657ca4-4356-438d-9780-b02d25d8d8b7 None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:13.772816 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application [None req-17657ca4-4356-438d-9780-b02d25d8d8b7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:28:13.772816 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:28:13.772816 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:28:13.772816 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:28:13.772816 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:28:13.772816 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:28:13.772816 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:28:13.772816 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:28:13.772816 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:28:13.772816 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:28:13.772816 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:28:13.772816 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:28:13.772816 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 14:28:13.772816 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 14:28:13.772816 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 14:28:13.773779 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 14:28:13.773779 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:28:13.773779 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:28:13.773779 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:28:13.773779 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:28:13.773779 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:28:13.773779 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:28:13.773779 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:28:13.773779 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application with Lock( May 25 14:28:13.773779 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:28:13.773779 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self._enter() May 25 14:28:13.773779 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:28:13.773779 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:28:13.773779 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:28:13.773779 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.creator() May 25 14:28:13.773779 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:28:13.773779 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application created_value = creator( May 25 14:28:13.774693 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 14:28:13.774693 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 14:28:13.774693 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:28:13.774693 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application May 25 14:28:13.777331 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 349/699] 10.222.0.67 () {56 vars in 1108 bytes} [Wed May 25 14:28:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:28:13.777450 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bb381f-a95c-4a1c-bc24-e5f2a7ae9920 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:13.778101 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bb381f-a95c-4a1c-bc24-e5f2a7ae9920 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:13.778389 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bb381f-a95c-4a1c-bc24-e5f2a7ae9920 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:13.778667 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bb381f-a95c-4a1c-bc24-e5f2a7ae9920 None admin] PATH_INFO: `/v3/users` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:13.779106 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17657ca4-4356-438d-9780-b02d25d8d8b7 None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:13.783241 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bb381f-a95c-4a1c-bc24-e5f2a7ae9920 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:28:13.783839 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bb381f-a95c-4a1c-bc24-e5f2a7ae9920 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:13.786476 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bb381f-a95c-4a1c-bc24-e5f2a7ae9920 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:13.816408 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 351/700] 10.222.0.67 () {56 vars in 1133 bytes} [Wed May 25 14:28:13 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:28:13.817753 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bb381f-a95c-4a1c-bc24-e5f2a7ae9920 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:13.902730 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17657ca4-4356-438d-9780-b02d25d8d8b7 None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:13.903971 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:13.942232 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f107178-5c25-4057-99b4-da48e9dd4850 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:13.943264 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f107178-5c25-4057-99b4-da48e9dd4850 None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:13.943854 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f107178-5c25-4057-99b4-da48e9dd4850 None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:13.944432 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f107178-5c25-4057-99b4-da48e9dd4850 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:13.945458 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f107178-5c25-4057-99b4-da48e9dd4850 None admin] RBAC: Adding query filter params (role.id=85be32e3c1ae4269b5456307e0827cc7, scope.project.id=bfe93ee8d32a441295efc0b885de4bd7, user.id=dbe9e38881834198842a476889678096) {{(pid=80474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:28:13.945988 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f107178-5c25-4057-99b4-da48e9dd4850 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:13.947928 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f107178-5c25-4057-99b4-da48e9dd4850 None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:13.950298 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bb381f-a95c-4a1c-bc24-e5f2a7ae9920 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:13.963499 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 350/701] 10.222.0.67 () {56 vars in 1374 bytes} [Wed May 25 14:28:13 2022] GET /identity/v3/role_assignments?user.id=dbe9e38881834198842a476889678096&scope.project.id=bfe93ee8d32a441295efc0b885de4bd7&role.id=85be32e3c1ae4269b5456307e0827cc7 => generated 608 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:28:13.964949 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f107178-5c25-4057-99b4-da48e9dd4850 None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:13.987447 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967b3c4f-3de4-43a1-a934-55ba916cf201 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:13.988120 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967b3c4f-3de4-43a1-a934-55ba916cf201 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:13.988408 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967b3c4f-3de4-43a1-a934-55ba916cf201 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:13.988687 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967b3c4f-3de4-43a1-a934-55ba916cf201 None admin] PATH_INFO: `/v3/domains` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:13.989425 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967b3c4f-3de4-43a1-a934-55ba916cf201 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:28:13.995148 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967b3c4f-3de4-43a1-a934-55ba916cf201 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:13.995148 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967b3c4f-3de4-43a1-a934-55ba916cf201 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:14.010716 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 352/702] 10.222.0.67 () {56 vars in 1109 bytes} [Wed May 25 14:28:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:28:14.010716 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967b3c4f-3de4-43a1-a934-55ba916cf201 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:14.013309 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:14.138521 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f107178-5c25-4057-99b4-da48e9dd4850 None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:14.195856 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d006a8ea-4822-4d3d-821b-5d1f0b115e19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:14.196537 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d006a8ea-4822-4d3d-821b-5d1f0b115e19 None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:14.196824 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d006a8ea-4822-4d3d-821b-5d1f0b115e19 None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:14.197106 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d006a8ea-4822-4d3d-821b-5d1f0b115e19 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:14.257572 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967b3c4f-3de4-43a1-a934-55ba916cf201 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:14.279162 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:14.298754 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c7e6cc-cb41-43dd-a1ef-df21ed8b832b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:14.299542 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c7e6cc-cb41-43dd-a1ef-df21ed8b832b None admin] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:14.299831 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c7e6cc-cb41-43dd-a1ef-df21ed8b832b None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:14.300109 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c7e6cc-cb41-43dd-a1ef-df21ed8b832b None admin] PATH_INFO: `/v3/users` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:14.300968 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c7e6cc-cb41-43dd-a1ef-df21ed8b832b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:14.302255 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c7e6cc-cb41-43dd-a1ef-df21ed8b832b None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:14.308050 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d006a8ea-4822-4d3d-821b-5d1f0b115e19 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:14.309717 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d006a8ea-4822-4d3d-821b-5d1f0b115e19 None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:14.324931 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 353/703] 10.222.0.67 () {60 vars in 1132 bytes} [Wed May 25 14:28:14 2022] POST /identity/v3/users => generated 254 bytes in 315 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 14:28:14.328217 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b28512-be1a-4003-8a06-f76f1d1811f4 None None] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:14.328643 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b28512-be1a-4003-8a06-f76f1d1811f4 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:14.329043 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b28512-be1a-4003-8a06-f76f1d1811f4 None None] PATH_INFO: `/` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:14.330847 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 354/704] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 14:28:14 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:28:14.333698 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:14.336522 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f5c000-4dc6-421a-8b38-ac8ef32ccc2e None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:14.336930 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f5c000-4dc6-421a-8b38-ac8ef32ccc2e None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:14.337359 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f5c000-4dc6-421a-8b38-ac8ef32ccc2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:14.366575 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-d8f5c000-4dc6-421a-8b38-ac8ef32ccc2e None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:28:14.367996 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-d8f5c000-4dc6-421a-8b38-ac8ef32ccc2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:28:14.455340 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 355/705] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 14:28:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 14:28:14.464379 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 351/706] 10.222.0.67 () {58 vars in 1282 bytes} [Wed May 25 14:28:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 500 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 14:28:14.471342 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f5c000-4dc6-421a-8b38-ac8ef32ccc2e None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:14.482834 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d006a8ea-4822-4d3d-821b-5d1f0b115e19 None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:14.616734 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f5c000-4dc6-421a-8b38-ac8ef32ccc2e None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:14.621755 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d006a8ea-4822-4d3d-821b-5d1f0b115e19 None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:14.627204 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:14.646536 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:14.664714 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eeeb0e2-5a6a-419a-82d5-827600cd644a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:14.665534 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eeeb0e2-5a6a-419a-82d5-827600cd644a None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:14.665817 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eeeb0e2-5a6a-419a-82d5-827600cd644a None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:14.666087 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eeeb0e2-5a6a-419a-82d5-827600cd644a None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:14.666756 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eeeb0e2-5a6a-419a-82d5-827600cd644a None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:14.668283 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eeeb0e2-5a6a-419a-82d5-827600cd644a None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:14.676094 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93d140d-c11e-418e-9198-6a358a8b98ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:14.676905 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93d140d-c11e-418e-9198-6a358a8b98ab None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:14.677189 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93d140d-c11e-418e-9198-6a358a8b98ab None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:14.677465 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93d140d-c11e-418e-9198-6a358a8b98ab None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:14.689951 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93d140d-c11e-418e-9198-6a358a8b98ab None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:14.691024 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application [None req-8eeeb0e2-5a6a-419a-82d5-827600cd644a None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 25 14:28:14.691024 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:28:14.691024 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 14:28:14.691024 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 14:28:14.691024 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 14:28:14.691024 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 14:28:14.691024 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 14:28:14.691024 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 14:28:14.691024 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 25 14:28:14.691024 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application May 25 14:28:14.691024 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 14:28:14.691024 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application May 25 14:28:14.691024 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:28:14.691024 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:28:14.691024 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:28:14.691024 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:28:14.691975 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:28:14.691975 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:28:14.691975 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:28:14.691975 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:28:14.691975 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:28:14.691975 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:28:14.691975 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:28:14.691975 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 14:28:14.691975 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 14:28:14.691975 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 14:28:14.691975 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 14:28:14.691975 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:28:14.691975 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:28:14.691975 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:28:14.691975 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:28:14.691975 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:28:14.692829 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:28:14.692829 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:28:14.692829 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application with Lock( May 25 14:28:14.692829 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:28:14.692829 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self._enter() May 25 14:28:14.692829 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:28:14.692829 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:28:14.692829 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:28:14.692829 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.creator() May 25 14:28:14.692829 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:28:14.692829 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application created_value = creator( May 25 14:28:14.692829 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 14:28:14.692829 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 14:28:14.692829 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 25 14:28:14.692829 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application May 25 14:28:14.694158 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 352/707] 10.222.0.67 () {56 vars in 1129 bytes} [Wed May 25 14:28:14 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 14:28:14.695219 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93d140d-c11e-418e-9198-6a358a8b98ab None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:14.700561 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eeeb0e2-5a6a-419a-82d5-827600cd644a None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:14.714352 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application [None req-f93d140d-c11e-418e-9198-6a358a8b98ab None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:28:14.714352 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:28:14.714352 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:28:14.714352 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:28:14.714352 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:28:14.714352 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:28:14.714352 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:28:14.714352 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:28:14.714352 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:28:14.714352 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:28:14.714352 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:28:14.714352 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:28:14.714352 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 14:28:14.714352 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 14:28:14.714352 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 14:28:14.715572 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 14:28:14.715572 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:28:14.715572 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:28:14.715572 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:28:14.715572 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:28:14.715572 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:28:14.715572 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:28:14.715572 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:28:14.715572 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application with Lock( May 25 14:28:14.715572 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:28:14.715572 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._enter() May 25 14:28:14.715572 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:28:14.715572 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:28:14.715572 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:28:14.715572 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.creator() May 25 14:28:14.715572 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:28:14.715572 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application created_value = creator( May 25 14:28:14.716486 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 14:28:14.716486 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 14:28:14.716486 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:28:14.716486 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:28:14.719133 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 356/708] 10.222.0.67 () {56 vars in 1108 bytes} [Wed May 25 14:28:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:28:14.725901 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93d140d-c11e-418e-9198-6a358a8b98ab None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:14.844947 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eeeb0e2-5a6a-419a-82d5-827600cd644a None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:14.873653 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93d140d-c11e-418e-9198-6a358a8b98ab None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:14.912556 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6f62f5-bd68-49e8-a722-a9a87ca4e2cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:14.913702 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6f62f5-bd68-49e8-a722-a9a87ca4e2cc None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:14.913991 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6f62f5-bd68-49e8-a722-a9a87ca4e2cc None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:14.914270 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6f62f5-bd68-49e8-a722-a9a87ca4e2cc None admin] PATH_INFO: `/v3/services` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:14.915185 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6f62f5-bd68-49e8-a722-a9a87ca4e2cc None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:28:14.915499 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6f62f5-bd68-49e8-a722-a9a87ca4e2cc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:14.917026 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6f62f5-bd68-49e8-a722-a9a87ca4e2cc None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:14.923097 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 353/709] 10.222.0.67 () {56 vars in 1124 bytes} [Wed May 25 14:28:14 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:28:14.928594 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6f62f5-bd68-49e8-a722-a9a87ca4e2cc None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:14.946000 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c6f65b-d13b-4958-aec0-30eb79b1fd67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:14.946674 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c6f65b-d13b-4958-aec0-30eb79b1fd67 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:14.946960 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c6f65b-d13b-4958-aec0-30eb79b1fd67 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:14.947268 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c6f65b-d13b-4958-aec0-30eb79b1fd67 None admin] PATH_INFO: `/v3/domains` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:14.948009 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c6f65b-d13b-4958-aec0-30eb79b1fd67 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:28:14.948320 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c6f65b-d13b-4958-aec0-30eb79b1fd67 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:14.949717 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c6f65b-d13b-4958-aec0-30eb79b1fd67 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:14.975861 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 357/710] 10.222.0.67 () {56 vars in 1109 bytes} [Wed May 25 14:28:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:28:14.982147 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c6f65b-d13b-4958-aec0-30eb79b1fd67 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:15.027693 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:15.036261 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:15.145894 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6f62f5-bd68-49e8-a722-a9a87ca4e2cc None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:15.151958 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c6f65b-d13b-4958-aec0-30eb79b1fd67 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:15.197898 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f97d2a-4ab3-4308-a97c-be2bc0459b35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:15.198720 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f97d2a-4ab3-4308-a97c-be2bc0459b35 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:15.199024 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f97d2a-4ab3-4308-a97c-be2bc0459b35 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:15.199310 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f97d2a-4ab3-4308-a97c-be2bc0459b35 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:15.205695 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdc369f-53a4-44f0-b9c0-ffb03bcba08b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:15.206681 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdc369f-53a4-44f0-b9c0-ffb03bcba08b None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:15.207183 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdc369f-53a4-44f0-b9c0-ffb03bcba08b None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:15.207670 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdc369f-53a4-44f0-b9c0-ffb03bcba08b None admin] PATH_INFO: `/v3/services` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:15.208617 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdc369f-53a4-44f0-b9c0-ffb03bcba08b None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:28:15.209086 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdc369f-53a4-44f0-b9c0-ffb03bcba08b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:15.210707 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f97d2a-4ab3-4308-a97c-be2bc0459b35 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:15.210846 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdc369f-53a4-44f0-b9c0-ffb03bcba08b None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:15.212237 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f97d2a-4ab3-4308-a97c-be2bc0459b35 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:15.218471 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 354/711] 10.222.0.67 () {56 vars in 1124 bytes} [Wed May 25 14:28:14 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:28:15.248661 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application [None req-66f97d2a-4ab3-4308-a97c-be2bc0459b35 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 14:28:15.248661 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:28:15.248661 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:28:15.248661 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:28:15.248661 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:28:15.248661 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:28:15.248661 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:28:15.248661 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:28:15.248661 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:28:15.248661 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:28:15.248661 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:28:15.248661 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:28:15.248661 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 14:28:15.248661 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 14:28:15.248661 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 14:28:15.250034 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 14:28:15.250034 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:28:15.250034 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:28:15.250034 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:28:15.250034 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:28:15.250034 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:28:15.250034 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:28:15.250034 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:28:15.250034 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application with Lock( May 25 14:28:15.250034 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:28:15.250034 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._enter() May 25 14:28:15.250034 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:28:15.250034 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:28:15.250034 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:28:15.250034 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.creator() May 25 14:28:15.250034 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:28:15.250034 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application created_value = creator( May 25 14:28:15.251208 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 14:28:15.251208 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 14:28:15.251208 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 14:28:15.251208 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 14:28:15.251208 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 14:28:15.251208 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 14:28:15.251208 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 14:28:15.251208 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:28:15.251208 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 358/712] 10.222.0.67 () {56 vars in 1111 bytes} [Wed May 25 14:28:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:28:15.255885 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdc369f-53a4-44f0-b9c0-ffb03bcba08b None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:15.434924 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c5428c-f525-4c43-883c-0ec01762b5ee None None] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:15.435243 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c5428c-f525-4c43-883c-0ec01762b5ee None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:15.435450 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c5428c-f525-4c43-883c-0ec01762b5ee None None] PATH_INFO: `/` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:15.437517 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 359/713] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 14:28:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 14:28:15.444000 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebb41ab-bf7a-4445-b4fe-7e79b2a11342 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:15.444299 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebb41ab-bf7a-4445-b4fe-7e79b2a11342 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:15.444581 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebb41ab-bf7a-4445-b4fe-7e79b2a11342 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:15.447566 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdc369f-53a4-44f0-b9c0-ffb03bcba08b None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:15.466215 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:15.480124 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-6ebb41ab-bf7a-4445-b4fe-7e79b2a11342 None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:28:15.481451 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-6ebb41ab-bf7a-4445-b4fe-7e79b2a11342 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:28:15.492260 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50fa89e-1fb8-4d39-8701-b8f2b1a9d81d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:15.493998 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50fa89e-1fb8-4d39-8701-b8f2b1a9d81d None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:15.494516 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50fa89e-1fb8-4d39-8701-b8f2b1a9d81d None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:15.495023 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50fa89e-1fb8-4d39-8701-b8f2b1a9d81d None admin] PATH_INFO: `/v3/projects` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:15.496455 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50fa89e-1fb8-4d39-8701-b8f2b1a9d81d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:28:15.497010 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50fa89e-1fb8-4d39-8701-b8f2b1a9d81d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:15.498788 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50fa89e-1fb8-4d39-8701-b8f2b1a9d81d None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:15.513546 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 355/714] 10.222.0.67 () {56 vars in 1148 bytes} [Wed May 25 14:28:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:28:15.519092 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50fa89e-1fb8-4d39-8701-b8f2b1a9d81d None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:15.594265 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 360/715] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 14:28:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 14:28:15.618593 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebb41ab-bf7a-4445-b4fe-7e79b2a11342 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:15.631399 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:15.632875 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50fa89e-1fb8-4d39-8701-b8f2b1a9d81d None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:15.678649 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95875dab-662f-40f5-b3f8-40f2629cc427 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:15.679372 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95875dab-662f-40f5-b3f8-40f2629cc427 None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:15.679662 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95875dab-662f-40f5-b3f8-40f2629cc427 None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:15.679943 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95875dab-662f-40f5-b3f8-40f2629cc427 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:15.680798 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95875dab-662f-40f5-b3f8-40f2629cc427 None admin] RBAC: Adding query filter params (role.id=399893e19eac4ab5a8e596f7c07be13c, scope.project.id=bfe93ee8d32a441295efc0b885de4bd7, user.id=428ec99478284743943ed41e9d24a603) {{(pid=80474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:28:15.681117 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95875dab-662f-40f5-b3f8-40f2629cc427 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:15.682554 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95875dab-662f-40f5-b3f8-40f2629cc427 None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:15.695724 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 356/716] 10.222.0.67 () {56 vars in 1374 bytes} [Wed May 25 14:28:15 2022] GET /identity/v3/role_assignments?user.id=428ec99478284743943ed41e9d24a603&scope.project.id=bfe93ee8d32a441295efc0b885de4bd7&role.id=399893e19eac4ab5a8e596f7c07be13c => generated 259 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:28:15.759544 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebb41ab-bf7a-4445-b4fe-7e79b2a11342 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:15.824926 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e75a3a2-f916-4705-a85b-2af951426eed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:15.825765 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e75a3a2-f916-4705-a85b-2af951426eed None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:15.826046 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e75a3a2-f916-4705-a85b-2af951426eed None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:15.826321 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e75a3a2-f916-4705-a85b-2af951426eed None admin] PATH_INFO: `/v3/services/network` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:15.827743 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e75a3a2-f916-4705-a85b-2af951426eed None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:15.831305 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e75a3a2-f916-4705-a85b-2af951426eed None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:15.866297 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application [None req-0e75a3a2-f916-4705-a85b-2af951426eed None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 25 14:28:15.866297 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:28:15.866297 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 14:28:15.866297 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 14:28:15.866297 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 14:28:15.866297 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 14:28:15.866297 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 14:28:15.866297 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 14:28:15.866297 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 25 14:28:15.866297 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:28:15.866297 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 14:28:15.866297 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:28:15.866297 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:28:15.866297 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:28:15.866297 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:28:15.866297 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:28:15.866297 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:28:15.867434 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:28:15.867434 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:28:15.867434 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:28:15.867434 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:28:15.867434 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:28:15.867434 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:28:15.867434 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 14:28:15.867434 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 14:28:15.867434 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 14:28:15.867434 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 14:28:15.867434 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:28:15.867434 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:28:15.867434 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:28:15.867434 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:28:15.867434 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:28:15.867434 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:28:15.868344 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:28:15.868344 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application with Lock( May 25 14:28:15.868344 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:28:15.868344 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._enter() May 25 14:28:15.868344 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:28:15.868344 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:28:15.868344 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:28:15.868344 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.creator() May 25 14:28:15.868344 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:28:15.868344 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application created_value = creator( May 25 14:28:15.868344 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 14:28:15.868344 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 14:28:15.868344 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 25 14:28:15.868344 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:28:15.868344 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 361/717] 10.222.0.67 () {56 vars in 1111 bytes} [Wed May 25 14:28:15 2022] GET /identity/v3/services/network => generated 88 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:28:15.874865 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95875dab-662f-40f5-b3f8-40f2629cc427 None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:15.927880 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:16.017798 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95875dab-662f-40f5-b3f8-40f2629cc427 None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:16.061360 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fa6c72-b32a-43f5-a903-51250d13f27f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:16.062395 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fa6c72-b32a-43f5-a903-51250d13f27f None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:16.062887 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fa6c72-b32a-43f5-a903-51250d13f27f None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:16.063435 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fa6c72-b32a-43f5-a903-51250d13f27f None admin] PATH_INFO: `/v3/services` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:16.064390 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fa6c72-b32a-43f5-a903-51250d13f27f None admin] RBAC: Adding query filter params (name=network) {{(pid=80474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:28:16.064906 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fa6c72-b32a-43f5-a903-51250d13f27f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:16.066489 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fa6c72-b32a-43f5-a903-51250d13f27f None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:16.072146 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 357/718] 10.222.0.67 () {56 vars in 1112 bytes} [Wed May 25 14:28:15 2022] GET /identity/v3/services?name=network => generated 124 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:28:16.077811 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e75a3a2-f916-4705-a85b-2af951426eed None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:16.174779 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:16.212647 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e75a3a2-f916-4705-a85b-2af951426eed None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:16.253062 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427be101-5e09-4c6f-a235-b8b4c601df79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:16.253740 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427be101-5e09-4c6f-a235-b8b4c601df79 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:16.254021 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427be101-5e09-4c6f-a235-b8b4c601df79 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:16.254295 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427be101-5e09-4c6f-a235-b8b4c601df79 None admin] PATH_INFO: `/v3/services` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:16.255015 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427be101-5e09-4c6f-a235-b8b4c601df79 None admin] RBAC: Adding query filter params (type=network) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:28:16.255326 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427be101-5e09-4c6f-a235-b8b4c601df79 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:16.256694 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427be101-5e09-4c6f-a235-b8b4c601df79 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:16.262974 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 362/719] 10.222.0.67 () {56 vars in 1112 bytes} [Wed May 25 14:28:16 2022] GET /identity/v3/services?type=network => generated 124 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:28:16.874507 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a465cea-17a4-4b83-a670-a772cf3f356c None None] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:16.874831 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a465cea-17a4-4b83-a670-a772cf3f356c None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:16.875098 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a465cea-17a4-4b83-a670-a772cf3f356c None None] PATH_INFO: `/` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:16.876719 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 358/720] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 14:28:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:28:16.882180 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fffe81-e085-47c6-b7cd-566d27854db8 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:16.882468 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fffe81-e085-47c6-b7cd-566d27854db8 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:16.882745 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fffe81-e085-47c6-b7cd-566d27854db8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:16.909102 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-30fffe81-e085-47c6-b7cd-566d27854db8 None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:28:16.910288 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-30fffe81-e085-47c6-b7cd-566d27854db8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:28:16.981206 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 363/721] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 14:28:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 14:28:17.005551 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a465cea-17a4-4b83-a670-a772cf3f356c None None] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:17.065905 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2c4c52-80e6-40be-a6c1-297197e7c180 None None] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:17.066234 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2c4c52-80e6-40be-a6c1-297197e7c180 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:17.066459 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2c4c52-80e6-40be-a6c1-297197e7c180 None None] PATH_INFO: `/` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:17.068145 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 364/722] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 14:28:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 14:28:17.073047 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c623c79-66c0-40f1-bcca-064b5a0f7982 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:17.073335 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c623c79-66c0-40f1-bcca-064b5a0f7982 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:17.073617 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c623c79-66c0-40f1-bcca-064b5a0f7982 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:17.091148 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-7c623c79-66c0-40f1-bcca-064b5a0f7982 None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:28:17.092374 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-7c623c79-66c0-40f1-bcca-064b5a0f7982 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:28:17.116764 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:17.128627 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a465cea-17a4-4b83-a670-a772cf3f356c None None] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:17.165862 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:17.171703 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 365/723] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 14:28:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 14:28:17.193348 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c623c79-66c0-40f1-bcca-064b5a0f7982 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:17.205779 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725d626e-4b13-4b0f-851b-32d265b49d4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:17.206656 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725d626e-4b13-4b0f-851b-32d265b49d4f None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:17.206947 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725d626e-4b13-4b0f-851b-32d265b49d4f None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:17.207250 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725d626e-4b13-4b0f-851b-32d265b49d4f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:17.227018 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725d626e-4b13-4b0f-851b-32d265b49d4f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:28:17.243797 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application [None req-725d626e-4b13-4b0f-851b-32d265b49d4f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 14:28:17.243797 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:28:17.243797 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:28:17.243797 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:28:17.243797 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:28:17.243797 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:28:17.243797 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:28:17.243797 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:28:17.243797 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:28:17.243797 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:28:17.243797 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:28:17.243797 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:28:17.243797 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:28:17.243797 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:28:17.243797 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:28:17.243797 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:28:17.244749 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:28:17.244749 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:28:17.244749 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:28:17.244749 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:28:17.244749 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:28:17.244749 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:28:17.244749 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:28:17.244749 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:28:17.244749 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:28:17.244749 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:28:17.244749 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:28:17.244749 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application with Lock( May 25 14:28:17.244749 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:28:17.244749 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self._enter() May 25 14:28:17.244749 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:28:17.244749 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:28:17.245614 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:28:17.245614 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.creator() May 25 14:28:17.245614 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:28:17.245614 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application created_value = creator( May 25 14:28:17.245614 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:28:17.245614 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:28:17.245614 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:28:17.245614 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:28:17.245614 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:28:17.245614 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:28:17.245614 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 14:28:17.245614 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application May 25 14:28:17.245614 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 359/724] 10.222.0.67 () {56 vars in 1096 bytes} [Wed May 25 14:28:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:28:17.253006 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725d626e-4b13-4b0f-851b-32d265b49d4f None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:17.308009 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c623c79-66c0-40f1-bcca-064b5a0f7982 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:17.346569 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241359e1-3485-4a62-876b-4b931b5a7297 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:17.347386 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241359e1-3485-4a62-876b-4b931b5a7297 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:17.347664 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241359e1-3485-4a62-876b-4b931b5a7297 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:17.347937 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241359e1-3485-4a62-876b-4b931b5a7297 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:17.362641 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241359e1-3485-4a62-876b-4b931b5a7297 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:28:17.371660 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application [None req-241359e1-3485-4a62-876b-4b931b5a7297 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 25 14:28:17.371660 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:28:17.371660 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:28:17.371660 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:28:17.371660 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:28:17.371660 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:28:17.371660 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:28:17.371660 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:28:17.371660 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:28:17.371660 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:28:17.371660 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:28:17.371660 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:28:17.371660 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:28:17.371660 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:28:17.371660 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:28:17.371660 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:28:17.374000 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:28:17.374000 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:28:17.374000 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:28:17.374000 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:28:17.374000 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:28:17.374000 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:28:17.374000 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:28:17.374000 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:28:17.374000 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:28:17.374000 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:28:17.374000 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:28:17.374000 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application with Lock( May 25 14:28:17.374000 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:28:17.374000 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._enter() May 25 14:28:17.374000 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:28:17.374000 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:28:17.376192 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:28:17.376192 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.creator() May 25 14:28:17.376192 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:28:17.376192 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application created_value = creator( May 25 14:28:17.376192 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:28:17.376192 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:28:17.376192 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:28:17.376192 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:28:17.376192 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:28:17.376192 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:28:17.376192 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 25 14:28:17.376192 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:28:17.376192 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 366/725] 10.222.0.67 () {56 vars in 1102 bytes} [Wed May 25 14:28:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 14:28:17.383033 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241359e1-3485-4a62-876b-4b931b5a7297 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:17.441266 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:17.489902 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241359e1-3485-4a62-876b-4b931b5a7297 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:17.527511 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be4c1ba-16f5-4a70-a6b3-4be3951dd693 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:17.528277 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be4c1ba-16f5-4a70-a6b3-4be3951dd693 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:17.528627 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be4c1ba-16f5-4a70-a6b3-4be3951dd693 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:17.528967 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be4c1ba-16f5-4a70-a6b3-4be3951dd693 None admin] PATH_INFO: `/v3/roles` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:17.530407 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be4c1ba-16f5-4a70-a6b3-4be3951dd693 None admin] RBAC: Adding query filter params (name=service) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:28:17.531014 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be4c1ba-16f5-4a70-a6b3-4be3951dd693 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:17.532424 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be4c1ba-16f5-4a70-a6b3-4be3951dd693 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:17.541742 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 367/726] 10.222.0.67 () {56 vars in 1103 bytes} [Wed May 25 14:28:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:28:17.547391 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be4c1ba-16f5-4a70-a6b3-4be3951dd693 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:17.561752 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725d626e-4b13-4b0f-851b-32d265b49d4f None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:17.656910 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be4c1ba-16f5-4a70-a6b3-4be3951dd693 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:17.682911 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c4d9af-3825-4f43-8565-a977676152d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:17.683620 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c4d9af-3825-4f43-8565-a977676152d8 None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:17.683911 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c4d9af-3825-4f43-8565-a977676152d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:17.684190 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c4d9af-3825-4f43-8565-a977676152d8 None admin] PATH_INFO: `/v3/roles` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:17.684959 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c4d9af-3825-4f43-8565-a977676152d8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:28:17.685271 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c4d9af-3825-4f43-8565-a977676152d8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:17.687224 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c4d9af-3825-4f43-8565-a977676152d8 None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:17.688872 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:17.695588 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c27e7b0-a619-4183-97e1-64224bd9e208 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:17.696825 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c27e7b0-a619-4183-97e1-64224bd9e208 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:17.697211 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c27e7b0-a619-4183-97e1-64224bd9e208 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:17.697580 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c27e7b0-a619-4183-97e1-64224bd9e208 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:17.709865 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c27e7b0-a619-4183-97e1-64224bd9e208 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:17.711474 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c27e7b0-a619-4183-97e1-64224bd9e208 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:17.713302 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 360/727] 10.222.0.67 () {56 vars in 1099 bytes} [Wed May 25 14:28:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 461 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:28:17.721061 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c4d9af-3825-4f43-8565-a977676152d8 None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:17.736701 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application [None req-2c27e7b0-a619-4183-97e1-64224bd9e208 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:28:17.736701 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:28:17.736701 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:28:17.736701 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:28:17.736701 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:28:17.736701 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:28:17.736701 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:28:17.736701 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:28:17.736701 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:28:17.736701 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:28:17.736701 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:28:17.736701 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:28:17.736701 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 14:28:17.736701 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 14:28:17.736701 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 14:28:17.738568 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 14:28:17.738568 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:28:17.738568 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:28:17.738568 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:28:17.738568 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:28:17.738568 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:28:17.738568 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:28:17.738568 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:28:17.738568 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application with Lock( May 25 14:28:17.738568 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:28:17.738568 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._enter() May 25 14:28:17.738568 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:28:17.738568 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:28:17.738568 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:28:17.738568 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.creator() May 25 14:28:17.738568 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:28:17.738568 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application created_value = creator( May 25 14:28:17.740722 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 14:28:17.740722 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 14:28:17.740722 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:28:17.740722 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:28:17.740722 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 368/728] 10.222.0.67 () {56 vars in 1108 bytes} [Wed May 25 14:28:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 14:28:17.745396 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c27e7b0-a619-4183-97e1-64224bd9e208 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:17.779359 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:17.853717 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c27e7b0-a619-4183-97e1-64224bd9e208 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:17.903543 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282280d3-4c2e-431e-a297-ad69a17aee54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:17.904207 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282280d3-4c2e-431e-a297-ad69a17aee54 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:17.905021 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282280d3-4c2e-431e-a297-ad69a17aee54 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:17.905716 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282280d3-4c2e-431e-a297-ad69a17aee54 None admin] PATH_INFO: `/v3/domains` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:17.906012 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282280d3-4c2e-431e-a297-ad69a17aee54 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:28:17.906316 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282280d3-4c2e-431e-a297-ad69a17aee54 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:17.907783 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282280d3-4c2e-431e-a297-ad69a17aee54 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:17.937534 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 369/729] 10.222.0.67 () {56 vars in 1109 bytes} [Wed May 25 14:28:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:28:17.940618 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c4d9af-3825-4f43-8565-a977676152d8 None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:17.943221 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282280d3-4c2e-431e-a297-ad69a17aee54 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:18.005020 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:18.021130 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7350a355-18f3-485d-a78c-4155da41cf0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:18.022024 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7350a355-18f3-485d-a78c-4155da41cf0d None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:18.022307 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7350a355-18f3-485d-a78c-4155da41cf0d None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:18.022586 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7350a355-18f3-485d-a78c-4155da41cf0d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:18.040998 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7350a355-18f3-485d-a78c-4155da41cf0d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:18.042458 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7350a355-18f3-485d-a78c-4155da41cf0d None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:18.072766 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application [None req-7350a355-18f3-485d-a78c-4155da41cf0d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:28:18.072766 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:28:18.072766 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:28:18.072766 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:28:18.072766 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:28:18.072766 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:28:18.072766 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:28:18.072766 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:28:18.072766 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:28:18.072766 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:28:18.072766 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:28:18.072766 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:28:18.072766 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 14:28:18.072766 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 14:28:18.072766 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 14:28:18.073926 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 14:28:18.073926 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:28:18.073926 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:28:18.073926 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:28:18.073926 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:28:18.073926 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:28:18.073926 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:28:18.073926 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:28:18.073926 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application with Lock( May 25 14:28:18.073926 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:28:18.073926 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self._enter() May 25 14:28:18.073926 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:28:18.073926 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:28:18.073926 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:28:18.073926 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.creator() May 25 14:28:18.073926 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:28:18.073926 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application created_value = creator( May 25 14:28:18.075044 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 14:28:18.075044 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 14:28:18.075044 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:28:18.075044 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application May 25 14:28:18.077607 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 361/730] 10.222.0.67 () {56 vars in 1108 bytes} [Wed May 25 14:28:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 357 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:28:18.083221 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7350a355-18f3-485d-a78c-4155da41cf0d None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:18.162556 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282280d3-4c2e-431e-a297-ad69a17aee54 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:18.198550 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:18.206621 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d55ce89-cb3f-41c5-a71f-f6fa7653a345 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:18.207458 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d55ce89-cb3f-41c5-a71f-f6fa7653a345 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:18.207739 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d55ce89-cb3f-41c5-a71f-f6fa7653a345 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:18.208012 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d55ce89-cb3f-41c5-a71f-f6fa7653a345 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:18.215427 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d55ce89-cb3f-41c5-a71f-f6fa7653a345 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:18.217114 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d55ce89-cb3f-41c5-a71f-f6fa7653a345 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:18.227192 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7350a355-18f3-485d-a78c-4155da41cf0d None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:18.232377 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application [None req-4d55ce89-cb3f-41c5-a71f-f6fa7653a345 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 25 14:28:18.232377 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:28:18.232377 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:28:18.232377 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:28:18.232377 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:28:18.232377 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:28:18.232377 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:28:18.232377 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:28:18.232377 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:28:18.232377 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:28:18.232377 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:28:18.232377 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:28:18.232377 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 14:28:18.232377 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 14:28:18.232377 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 14:28:18.232377 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 14:28:18.234399 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:28:18.234399 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:28:18.234399 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 14:28:18.234399 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 14:28:18.234399 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 14:28:18.234399 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 14:28:18.234399 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:28:18.234399 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:28:18.234399 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:28:18.234399 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:28:18.234399 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:28:18.234399 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application with Lock( May 25 14:28:18.234399 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:28:18.234399 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._enter() May 25 14:28:18.234399 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:28:18.234399 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:28:18.234399 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:28:18.234399 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.creator() May 25 14:28:18.235398 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:28:18.235398 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application created_value = creator( May 25 14:28:18.235398 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 14:28:18.235398 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 14:28:18.235398 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 14:28:18.235398 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 14:28:18.235398 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 14:28:18.235398 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 14:28:18.235398 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 25 14:28:18.235398 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:28:18.235398 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 370/731] 10.222.0.67 () {56 vars in 1117 bytes} [Wed May 25 14:28:17 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:28:18.240038 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a042a0-5b9a-4088-b6a1-d9c55183db2d None None] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:18.240474 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a042a0-5b9a-4088-b6a1-d9c55183db2d None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:18.240917 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a042a0-5b9a-4088-b6a1-d9c55183db2d None None] PATH_INFO: `/` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:18.242597 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 371/732] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 14:28:18 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:28:18.244154 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a042a0-5b9a-4088-b6a1-d9c55183db2d None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:18.275082 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52dddc81-4827-40c7-bfda-4fe475bdabd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:18.276161 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dddc81-4827-40c7-bfda-4fe475bdabd3 None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:18.276559 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dddc81-4827-40c7-bfda-4fe475bdabd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:18.276946 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dddc81-4827-40c7-bfda-4fe475bdabd3 None admin] PATH_INFO: `/v3/domains` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:18.277889 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52dddc81-4827-40c7-bfda-4fe475bdabd3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:28:18.278307 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52dddc81-4827-40c7-bfda-4fe475bdabd3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:18.280513 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52dddc81-4827-40c7-bfda-4fe475bdabd3 None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:18.293483 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 362/733] 10.222.0.67 () {56 vars in 1109 bytes} [Wed May 25 14:28:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:28:18.294957 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25e4994-f34e-4262-8d54-17c4a3b80909 None None] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:18.296126 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25e4994-f34e-4262-8d54-17c4a3b80909 None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:18.296709 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25e4994-f34e-4262-8d54-17c4a3b80909 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:18.314850 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.auth.core [None req-f25e4994-f34e-4262-8d54-17c4a3b80909 None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:28:18.316535 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-f25e4994-f34e-4262-8d54-17c4a3b80909 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:28:18.345946 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:18.356613 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a042a0-5b9a-4088-b6a1-d9c55183db2d None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:18.393244 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629b6be6-ff51-4ca4-9742-00ca4073fefe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:18.393875 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629b6be6-ff51-4ca4-9742-00ca4073fefe None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:18.394157 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629b6be6-ff51-4ca4-9742-00ca4073fefe None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:18.394429 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629b6be6-ff51-4ca4-9742-00ca4073fefe None admin] PATH_INFO: `/v3/users` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:18.395347 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629b6be6-ff51-4ca4-9742-00ca4073fefe None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:28:18.395654 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629b6be6-ff51-4ca4-9742-00ca4073fefe None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:18.397083 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629b6be6-ff51-4ca4-9742-00ca4073fefe None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:18.398496 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 363/734] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 14:28:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 14:28:18.399674 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25e4994-f34e-4262-8d54-17c4a3b80909 None None] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:18.432249 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 372/735] 10.222.0.67 () {56 vars in 1149 bytes} [Wed May 25 14:28:18 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:28:18.438701 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629b6be6-ff51-4ca4-9742-00ca4073fefe None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:18.477978 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:18.522600 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25e4994-f34e-4262-8d54-17c4a3b80909 None None] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:18.570546 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c25c55-559b-49fc-8ebb-4b0bdcb20157 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:18.572015 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c25c55-559b-49fc-8ebb-4b0bdcb20157 None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:18.572510 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c25c55-559b-49fc-8ebb-4b0bdcb20157 None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:18.573181 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c25c55-559b-49fc-8ebb-4b0bdcb20157 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:18.584251 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629b6be6-ff51-4ca4-9742-00ca4073fefe None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:18.584446 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c25c55-559b-49fc-8ebb-4b0bdcb20157 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:18.586324 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c25c55-559b-49fc-8ebb-4b0bdcb20157 None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:18.606800 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application [None req-a9c25c55-559b-49fc-8ebb-4b0bdcb20157 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 25 14:28:18.606800 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:28:18.606800 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:28:18.606800 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:28:18.606800 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:28:18.606800 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:28:18.606800 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:28:18.606800 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:28:18.606800 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:28:18.606800 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:28:18.606800 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:28:18.606800 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:28:18.606800 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 14:28:18.606800 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 14:28:18.606800 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 14:28:18.606800 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 14:28:18.608451 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:28:18.608451 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:28:18.608451 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 14:28:18.608451 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 14:28:18.608451 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 14:28:18.608451 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 14:28:18.608451 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:28:18.608451 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:28:18.608451 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:28:18.608451 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:28:18.608451 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:28:18.608451 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application with Lock( May 25 14:28:18.608451 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:28:18.608451 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self._enter() May 25 14:28:18.608451 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:28:18.608451 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:28:18.608451 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:28:18.608451 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.creator() May 25 14:28:18.609421 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:28:18.609421 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application created_value = creator( May 25 14:28:18.609421 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 14:28:18.609421 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 14:28:18.609421 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 14:28:18.609421 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 14:28:18.609421 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 14:28:18.609421 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 14:28:18.609421 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 25 14:28:18.609421 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application May 25 14:28:18.616224 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 364/736] 10.222.0.67 () {56 vars in 1096 bytes} [Wed May 25 14:28:18 2022] GET /identity/v3/users/swift => generated 83 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:28:18.616224 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c25c55-559b-49fc-8ebb-4b0bdcb20157 None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:18.630985 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c246efb4-64a9-4d24-b15e-e8ef5a173fbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:18.631680 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c246efb4-64a9-4d24-b15e-e8ef5a173fbc None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:18.631972 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c246efb4-64a9-4d24-b15e-e8ef5a173fbc None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:18.632235 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c246efb4-64a9-4d24-b15e-e8ef5a173fbc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:18.652656 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:18.711712 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c246efb4-64a9-4d24-b15e-e8ef5a173fbc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:18.713152 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c246efb4-64a9-4d24-b15e-e8ef5a173fbc None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:18.726339 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c25c55-559b-49fc-8ebb-4b0bdcb20157 None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:18.751381 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:18.763453 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea0dc07-4245-4ff9-a1c6-13542571b467 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:18.764189 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea0dc07-4245-4ff9-a1c6-13542571b467 None admin] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:18.764470 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea0dc07-4245-4ff9-a1c6-13542571b467 None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:18.764741 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea0dc07-4245-4ff9-a1c6-13542571b467 None admin] PATH_INFO: `/v3/services` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:18.765466 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea0dc07-4245-4ff9-a1c6-13542571b467 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:18.766827 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea0dc07-4245-4ff9-a1c6-13542571b467 None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:18.783118 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 365/737] 10.222.0.67 () {60 vars in 1141 bytes} [Wed May 25 14:28:18 2022] POST /identity/v3/services => generated 251 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:28:18.784000 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea0dc07-4245-4ff9-a1c6-13542571b467 None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:18.849099 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 373/738] 10.222.0.67 () {58 vars in 1282 bytes} [Wed May 25 14:28:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 25 14:28:18.850806 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69983246-2e49-49e2-adbc-5a2f63ad5f84 None None] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:18.851367 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69983246-2e49-49e2-adbc-5a2f63ad5f84 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:18.852001 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69983246-2e49-49e2-adbc-5a2f63ad5f84 None None] PATH_INFO: `/` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:18.854283 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 374/739] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 14:28:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:28:18.855186 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69983246-2e49-49e2-adbc-5a2f63ad5f84 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:18.923857 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:18.968334 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea0dc07-4245-4ff9-a1c6-13542571b467 None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:18.988019 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69983246-2e49-49e2-adbc-5a2f63ad5f84 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:19.024084 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5783f8d7-abf2-42db-8158-93bc4ac4788e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:19.024770 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5783f8d7-abf2-42db-8158-93bc4ac4788e None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:19.025060 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5783f8d7-abf2-42db-8158-93bc4ac4788e None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:19.025339 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5783f8d7-abf2-42db-8158-93bc4ac4788e None admin] PATH_INFO: `/v3/users` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:19.026195 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5783f8d7-abf2-42db-8158-93bc4ac4788e None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:28:19.026501 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5783f8d7-abf2-42db-8158-93bc4ac4788e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:19.027982 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5783f8d7-abf2-42db-8158-93bc4ac4788e None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:19.033667 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b912295e-7954-47be-9938-27e0b8822dfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:19.034473 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b912295e-7954-47be-9938-27e0b8822dfd None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:19.034760 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b912295e-7954-47be-9938-27e0b8822dfd None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:19.035069 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b912295e-7954-47be-9938-27e0b8822dfd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:19.048853 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b912295e-7954-47be-9938-27e0b8822dfd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:19.050343 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b912295e-7954-47be-9938-27e0b8822dfd None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:19.051976 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 366/740] 10.222.0.67 () {56 vars in 1135 bytes} [Wed May 25 14:28:18 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:28:19.052559 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406755ba-aac8-4b3d-a620-e5d60ad783ba None None] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:19.052849 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406755ba-aac8-4b3d-a620-e5d60ad783ba None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:19.053163 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406755ba-aac8-4b3d-a620-e5d60ad783ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:19.070806 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.auth.core [None req-406755ba-aac8-4b3d-a620-e5d60ad783ba None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:28:19.072045 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-406755ba-aac8-4b3d-a620-e5d60ad783ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:28:19.072369 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application [None req-b912295e-7954-47be-9938-27e0b8822dfd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:28:19.072369 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:28:19.072369 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:28:19.072369 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:28:19.072369 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:28:19.072369 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:28:19.072369 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:28:19.072369 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:28:19.072369 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:28:19.072369 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:28:19.072369 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:28:19.072369 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:28:19.072369 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 14:28:19.072369 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 14:28:19.072369 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 14:28:19.073231 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 14:28:19.073231 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:28:19.073231 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:28:19.073231 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:28:19.073231 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:28:19.073231 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:28:19.073231 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:28:19.073231 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:28:19.073231 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application with Lock( May 25 14:28:19.073231 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:28:19.073231 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._enter() May 25 14:28:19.073231 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:28:19.073231 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:28:19.073231 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:28:19.073231 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.creator() May 25 14:28:19.073231 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:28:19.073231 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application created_value = creator( May 25 14:28:19.074173 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 14:28:19.074173 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 14:28:19.074173 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:28:19.074173 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:28:19.074173 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 375/741] 10.222.0.67 () {56 vars in 1108 bytes} [Wed May 25 14:28:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:28:19.075036 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b912295e-7954-47be-9938-27e0b8822dfd None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:19.106384 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:19.150370 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 367/742] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 14:28:19 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 14:28:19.152033 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682fa493-5e4e-4e86-a8d5-1ded3bd296e0 None None] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:19.152498 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682fa493-5e4e-4e86-a8d5-1ded3bd296e0 None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:19.152950 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682fa493-5e4e-4e86-a8d5-1ded3bd296e0 None None] PATH_INFO: `/` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:19.155275 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 368/743] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 14:28:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:28:19.156366 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682fa493-5e4e-4e86-a8d5-1ded3bd296e0 None None] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:19.192912 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:19.196524 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b912295e-7954-47be-9938-27e0b8822dfd None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:19.236817 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c3d182-e912-444e-876b-c00fe06a85ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:19.237969 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c3d182-e912-444e-876b-c00fe06a85ef None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:19.237969 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c3d182-e912-444e-876b-c00fe06a85ef None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:19.238166 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c3d182-e912-444e-876b-c00fe06a85ef None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:19.269440 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682fa493-5e4e-4e86-a8d5-1ded3bd296e0 None None] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:19.306173 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090d2333-fc92-4a7c-b256-51416de38447 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:19.306841 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090d2333-fc92-4a7c-b256-51416de38447 None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:19.307183 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090d2333-fc92-4a7c-b256-51416de38447 None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:19.307457 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090d2333-fc92-4a7c-b256-51416de38447 None admin] PATH_INFO: `/v3/domains` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:19.308180 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090d2333-fc92-4a7c-b256-51416de38447 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:28:19.308648 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090d2333-fc92-4a7c-b256-51416de38447 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:19.310479 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090d2333-fc92-4a7c-b256-51416de38447 None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:19.312296 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c3d182-e912-444e-876b-c00fe06a85ef None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:19.313786 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c3d182-e912-444e-876b-c00fe06a85ef None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:19.328155 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 369/744] 10.222.0.67 () {56 vars in 1109 bytes} [Wed May 25 14:28:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:28:19.328155 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca5c9db-8e04-41a9-803c-97c82012316e None None] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:19.328155 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca5c9db-8e04-41a9-803c-97c82012316e None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:19.328155 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca5c9db-8e04-41a9-803c-97c82012316e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:19.342319 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.auth.core [None req-aca5c9db-8e04-41a9-803c-97c82012316e None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:28:19.343536 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-aca5c9db-8e04-41a9-803c-97c82012316e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:28:19.367838 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:19.416003 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 370/745] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 14:28:19 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 14:28:19.417782 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca5c9db-8e04-41a9-803c-97c82012316e None None] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:19.432302 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:19.440139 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 376/746] 10.222.0.67 () {58 vars in 1282 bytes} [Wed May 25 14:28:19 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 14:28:19.441275 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c3d182-e912-444e-876b-c00fe06a85ef None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:19.539258 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca5c9db-8e04-41a9-803c-97c82012316e None None] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:19.547117 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c3d182-e912-444e-876b-c00fe06a85ef None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:19.578250 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c208bbe-8d9d-4959-ab08-339a30790e9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:19.579087 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c208bbe-8d9d-4959-ab08-339a30790e9a None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:19.579378 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c208bbe-8d9d-4959-ab08-339a30790e9a None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:19.579655 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c208bbe-8d9d-4959-ab08-339a30790e9a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:19.583701 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bab1c01-2c54-436f-956b-93418c374cfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:19.584491 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bab1c01-2c54-436f-956b-93418c374cfc None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:19.584777 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bab1c01-2c54-436f-956b-93418c374cfc None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:19.585050 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bab1c01-2c54-436f-956b-93418c374cfc None admin] PATH_INFO: `/v3/projects/service` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:19.590076 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c208bbe-8d9d-4959-ab08-339a30790e9a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:28:19.592636 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bab1c01-2c54-436f-956b-93418c374cfc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:19.594095 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bab1c01-2c54-436f-956b-93418c374cfc None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:19.598668 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application [None req-3c208bbe-8d9d-4959-ab08-339a30790e9a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 14:28:19.598668 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:28:19.598668 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:28:19.598668 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:28:19.598668 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:28:19.598668 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:28:19.598668 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:28:19.598668 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:28:19.598668 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:28:19.598668 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:28:19.598668 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:28:19.598668 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:28:19.598668 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:28:19.598668 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:28:19.598668 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:28:19.598668 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:28:19.599665 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:28:19.599665 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:28:19.599665 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:28:19.599665 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:28:19.599665 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:28:19.599665 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:28:19.599665 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:28:19.599665 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:28:19.599665 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:28:19.599665 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:28:19.599665 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:28:19.599665 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application with Lock( May 25 14:28:19.599665 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:28:19.599665 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self._enter() May 25 14:28:19.599665 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:28:19.599665 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:28:19.600521 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:28:19.600521 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.creator() May 25 14:28:19.600521 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:28:19.600521 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application created_value = creator( May 25 14:28:19.600521 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:28:19.600521 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:28:19.600521 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:28:19.600521 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:28:19.600521 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:28:19.600521 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:28:19.600521 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 14:28:19.600521 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application May 25 14:28:19.600521 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 371/747] 10.222.0.67 () {56 vars in 1096 bytes} [Wed May 25 14:28:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:28:19.601321 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c208bbe-8d9d-4959-ab08-339a30790e9a None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:19.612053 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application [None req-9bab1c01-2c54-436f-956b-93418c374cfc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 14:28:19.612053 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:28:19.612053 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:28:19.612053 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:28:19.612053 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:28:19.612053 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:28:19.612053 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:28:19.612053 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:28:19.612053 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:28:19.612053 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:28:19.612053 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:28:19.612053 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:28:19.612053 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 14:28:19.612053 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 14:28:19.612053 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 14:28:19.613152 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 14:28:19.613152 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:28:19.613152 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:28:19.613152 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:28:19.613152 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:28:19.613152 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:28:19.613152 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:28:19.613152 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:28:19.613152 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application with Lock( May 25 14:28:19.613152 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:28:19.613152 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._enter() May 25 14:28:19.613152 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:28:19.613152 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:28:19.613152 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:28:19.613152 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.creator() May 25 14:28:19.613152 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:28:19.613152 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application created_value = creator( May 25 14:28:19.614335 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 14:28:19.614335 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 14:28:19.614335 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 14:28:19.614335 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 14:28:19.614335 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 14:28:19.614335 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 14:28:19.614335 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 14:28:19.614335 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:28:19.614335 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 377/748] 10.222.0.67 () {56 vars in 1111 bytes} [Wed May 25 14:28:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:28:19.614335 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bab1c01-2c54-436f-956b-93418c374cfc None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:19.630002 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:19.680033 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:19.718779 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c208bbe-8d9d-4959-ab08-339a30790e9a None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:19.723678 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bab1c01-2c54-436f-956b-93418c374cfc None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:19.755801 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d2fdde-d60d-427e-9b98-e7f8f0450068 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:19.756674 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d2fdde-d60d-427e-9b98-e7f8f0450068 None admin] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:19.757101 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d2fdde-d60d-427e-9b98-e7f8f0450068 None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:19.757520 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d2fdde-d60d-427e-9b98-e7f8f0450068 None admin] PATH_INFO: `/v3/services` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:19.758016 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04dae800-e146-4110-a85b-c3e9b0213cc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:19.758657 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d2fdde-d60d-427e-9b98-e7f8f0450068 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:19.758800 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dae800-e146-4110-a85b-c3e9b0213cc2 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:19.759118 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dae800-e146-4110-a85b-c3e9b0213cc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:19.759403 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dae800-e146-4110-a85b-c3e9b0213cc2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:19.760687 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d2fdde-d60d-427e-9b98-e7f8f0450068 None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:19.771029 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04dae800-e146-4110-a85b-c3e9b0213cc2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:19.772688 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04dae800-e146-4110-a85b-c3e9b0213cc2 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:19.774164 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 372/749] 10.222.0.67 () {60 vars in 1141 bytes} [Wed May 25 14:28:19 2022] POST /identity/v3/services => generated 240 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:28:19.774973 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d2fdde-d60d-427e-9b98-e7f8f0450068 None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:19.798687 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application [None req-04dae800-e146-4110-a85b-c3e9b0213cc2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:28:19.798687 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:28:19.798687 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:28:19.798687 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:28:19.798687 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:28:19.798687 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:28:19.798687 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:28:19.798687 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:28:19.798687 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:28:19.798687 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:28:19.798687 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:28:19.798687 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:28:19.798687 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 14:28:19.798687 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 14:28:19.798687 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 14:28:19.799696 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 14:28:19.799696 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:28:19.799696 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:28:19.799696 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:28:19.799696 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:28:19.799696 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:28:19.799696 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:28:19.799696 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:28:19.799696 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application with Lock( May 25 14:28:19.799696 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:28:19.799696 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._enter() May 25 14:28:19.799696 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:28:19.799696 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:28:19.799696 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:28:19.799696 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.creator() May 25 14:28:19.799696 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:28:19.799696 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application created_value = creator( May 25 14:28:19.800608 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 14:28:19.800608 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 14:28:19.800608 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:28:19.800608 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:28:19.802612 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 378/750] 10.222.0.67 () {56 vars in 1108 bytes} [Wed May 25 14:28:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:28:19.803722 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04dae800-e146-4110-a85b-c3e9b0213cc2 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:19.872882 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:19.908131 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d2fdde-d60d-427e-9b98-e7f8f0450068 None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:19.938111 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04dae800-e146-4110-a85b-c3e9b0213cc2 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:19.947569 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef19d95-b0d2-460f-a9a7-15c824c65399 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:19.947913 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef19d95-b0d2-460f-a9a7-15c824c65399 None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:19.948203 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef19d95-b0d2-460f-a9a7-15c824c65399 None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:19.948486 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef19d95-b0d2-460f-a9a7-15c824c65399 None admin] PATH_INFO: `/v3/roles` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:19.949266 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef19d95-b0d2-460f-a9a7-15c824c65399 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:28:19.949579 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef19d95-b0d2-460f-a9a7-15c824c65399 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:19.951009 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef19d95-b0d2-460f-a9a7-15c824c65399 None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:19.956328 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:19.965938 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 373/751] 10.222.0.67 () {56 vars in 1099 bytes} [Wed May 25 14:28:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:28:19.965938 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef19d95-b0d2-460f-a9a7-15c824c65399 None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:19.986911 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7fb446-8764-4adc-ac14-f6a6373f6004 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:19.987839 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7fb446-8764-4adc-ac14-f6a6373f6004 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:19.988266 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7fb446-8764-4adc-ac14-f6a6373f6004 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:19.988715 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7fb446-8764-4adc-ac14-f6a6373f6004 None admin] PATH_INFO: `/v3/projects` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:19.989969 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7fb446-8764-4adc-ac14-f6a6373f6004 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:28:19.990478 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7fb446-8764-4adc-ac14-f6a6373f6004 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:19.992237 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7fb446-8764-4adc-ac14-f6a6373f6004 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:20.007888 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 379/752] 10.222.0.67 () {56 vars in 1148 bytes} [Wed May 25 14:28:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:28:20.009119 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7fb446-8764-4adc-ac14-f6a6373f6004 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:20.084567 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef19d95-b0d2-460f-a9a7-15c824c65399 None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:20.123937 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7fb446-8764-4adc-ac14-f6a6373f6004 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:20.129654 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc156823-24be-460a-babd-bb49cc3a1b41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:20.130401 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc156823-24be-460a-babd-bb49cc3a1b41 None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:20.130751 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc156823-24be-460a-babd-bb49cc3a1b41 None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:20.131122 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc156823-24be-460a-babd-bb49cc3a1b41 None admin] PATH_INFO: `/v3/domains` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:20.131923 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc156823-24be-460a-babd-bb49cc3a1b41 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:28:20.132304 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc156823-24be-460a-babd-bb49cc3a1b41 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:20.133768 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc156823-24be-460a-babd-bb49cc3a1b41 None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:20.136970 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:20.149184 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 374/753] 10.222.0.67 () {56 vars in 1109 bytes} [Wed May 25 14:28:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:28:20.150264 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc156823-24be-460a-babd-bb49cc3a1b41 None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:20.172560 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd30570-bf5e-4b16-96b8-ce9e3d5e97a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:20.174012 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd30570-bf5e-4b16-96b8-ce9e3d5e97a4 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:20.174529 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd30570-bf5e-4b16-96b8-ce9e3d5e97a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:20.175222 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd30570-bf5e-4b16-96b8-ce9e3d5e97a4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:20.189499 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd30570-bf5e-4b16-96b8-ce9e3d5e97a4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:20.191191 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd30570-bf5e-4b16-96b8-ce9e3d5e97a4 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:20.214886 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application [None req-2bd30570-bf5e-4b16-96b8-ce9e3d5e97a4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:28:20.214886 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:28:20.214886 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:28:20.214886 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:28:20.214886 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:28:20.214886 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:28:20.214886 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:28:20.214886 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:28:20.214886 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:28:20.214886 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:28:20.214886 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:28:20.214886 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:28:20.214886 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 14:28:20.214886 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 14:28:20.214886 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 14:28:20.216463 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 14:28:20.216463 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:28:20.216463 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:28:20.216463 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:28:20.216463 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:28:20.216463 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:28:20.216463 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:28:20.216463 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:28:20.216463 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application with Lock( May 25 14:28:20.216463 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:28:20.216463 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._enter() May 25 14:28:20.216463 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:28:20.216463 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:28:20.216463 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:28:20.216463 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.creator() May 25 14:28:20.216463 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:28:20.216463 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application created_value = creator( May 25 14:28:20.217644 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 14:28:20.217644 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 14:28:20.217644 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:28:20.217644 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:28:20.224498 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 380/754] 10.222.0.67 () {56 vars in 1108 bytes} [Wed May 25 14:28:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:28:20.224498 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd30570-bf5e-4b16-96b8-ce9e3d5e97a4 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:20.250963 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:20.271767 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc156823-24be-460a-babd-bb49cc3a1b41 None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:20.315824 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb40704a-7ff3-447f-a818-5e3a49e77469 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:20.316830 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb40704a-7ff3-447f-a818-5e3a49e77469 None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:20.317319 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb40704a-7ff3-447f-a818-5e3a49e77469 None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:20.317790 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb40704a-7ff3-447f-a818-5e3a49e77469 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:20.318819 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb40704a-7ff3-447f-a818-5e3a49e77469 None admin] RBAC: Adding query filter params (role.id=85be32e3c1ae4269b5456307e0827cc7, scope.project.id=bfe93ee8d32a441295efc0b885de4bd7, user.id=e03f5bb82ffb41a1b1dde935d093e6f4) {{(pid=80474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:28:20.319375 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb40704a-7ff3-447f-a818-5e3a49e77469 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:20.321694 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb40704a-7ff3-447f-a818-5e3a49e77469 None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:20.330891 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 375/755] 10.222.0.67 () {56 vars in 1374 bytes} [Wed May 25 14:28:20 2022] GET /identity/v3/role_assignments?user.id=e03f5bb82ffb41a1b1dde935d093e6f4&scope.project.id=bfe93ee8d32a441295efc0b885de4bd7&role.id=85be32e3c1ae4269b5456307e0827cc7 => generated 259 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:28:20.332553 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb40704a-7ff3-447f-a818-5e3a49e77469 None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:20.334392 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd30570-bf5e-4b16-96b8-ce9e3d5e97a4 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:20.410473 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:20.429832 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc629cc4-0f7d-4f1d-bd5b-02828ea62af3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:20.430655 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc629cc4-0f7d-4f1d-bd5b-02828ea62af3 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:20.430937 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc629cc4-0f7d-4f1d-bd5b-02828ea62af3 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:20.431236 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc629cc4-0f7d-4f1d-bd5b-02828ea62af3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:20.447813 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc629cc4-0f7d-4f1d-bd5b-02828ea62af3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:20.449318 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc629cc4-0f7d-4f1d-bd5b-02828ea62af3 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:20.477032 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb40704a-7ff3-447f-a818-5e3a49e77469 None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:20.488843 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application [None req-fc629cc4-0f7d-4f1d-bd5b-02828ea62af3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 14:28:20.488843 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:28:20.488843 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:28:20.488843 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:28:20.488843 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:28:20.488843 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:28:20.488843 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:28:20.488843 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:28:20.488843 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:28:20.488843 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:28:20.488843 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:28:20.488843 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:28:20.488843 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 14:28:20.488843 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 14:28:20.488843 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 14:28:20.489830 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 14:28:20.489830 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:28:20.489830 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:28:20.489830 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:28:20.489830 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:28:20.489830 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:28:20.489830 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:28:20.489830 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:28:20.489830 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application with Lock( May 25 14:28:20.489830 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:28:20.489830 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._enter() May 25 14:28:20.489830 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:28:20.489830 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:28:20.489830 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:28:20.489830 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.creator() May 25 14:28:20.489830 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:28:20.489830 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application created_value = creator( May 25 14:28:20.490749 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 14:28:20.490749 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 14:28:20.490749 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 14:28:20.490749 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 14:28:20.490749 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 14:28:20.490749 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 14:28:20.490749 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 14:28:20.490749 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:28:20.493128 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 381/756] 10.222.0.67 () {56 vars in 1111 bytes} [Wed May 25 14:28:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:28:20.499142 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc629cc4-0f7d-4f1d-bd5b-02828ea62af3 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:20.551848 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53e940c-7150-484d-9188-b41ec9985818 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:20.552524 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53e940c-7150-484d-9188-b41ec9985818 None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:20.552813 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53e940c-7150-484d-9188-b41ec9985818 None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:20.553097 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53e940c-7150-484d-9188-b41ec9985818 None admin] PATH_INFO: `/v3/domains` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:20.553848 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53e940c-7150-484d-9188-b41ec9985818 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:28:20.554159 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53e940c-7150-484d-9188-b41ec9985818 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:20.556646 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53e940c-7150-484d-9188-b41ec9985818 None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:20.572513 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 376/757] 10.222.0.67 () {56 vars in 1109 bytes} [Wed May 25 14:28:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:28:20.579617 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53e940c-7150-484d-9188-b41ec9985818 None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:20.675917 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:20.705497 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc629cc4-0f7d-4f1d-bd5b-02828ea62af3 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:20.746547 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8903b1-831e-4823-b1d4-b67abf58b6bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:20.749183 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8903b1-831e-4823-b1d4-b67abf58b6bc None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:20.750345 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8903b1-831e-4823-b1d4-b67abf58b6bc None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:20.751008 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8903b1-831e-4823-b1d4-b67abf58b6bc None admin] PATH_INFO: `/v3/projects` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:20.753502 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8903b1-831e-4823-b1d4-b67abf58b6bc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:28:20.754864 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8903b1-831e-4823-b1d4-b67abf58b6bc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:20.757270 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8903b1-831e-4823-b1d4-b67abf58b6bc None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:20.781417 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 382/758] 10.222.0.67 () {56 vars in 1148 bytes} [Wed May 25 14:28:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:28:20.788564 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53e940c-7150-484d-9188-b41ec9985818 None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:20.789770 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8903b1-831e-4823-b1d4-b67abf58b6bc None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:20.819695 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:20.842916 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5384208e-decf-408a-8fa3-6cdb926f6413 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:20.844034 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5384208e-decf-408a-8fa3-6cdb926f6413 None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:20.844547 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5384208e-decf-408a-8fa3-6cdb926f6413 None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:20.845047 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5384208e-decf-408a-8fa3-6cdb926f6413 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:20.854636 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5384208e-decf-408a-8fa3-6cdb926f6413 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:20.857207 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5384208e-decf-408a-8fa3-6cdb926f6413 None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:20.885848 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application [None req-5384208e-decf-408a-8fa3-6cdb926f6413 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 25 14:28:20.885848 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:28:20.885848 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:28:20.885848 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:28:20.885848 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:28:20.885848 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:28:20.885848 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:28:20.885848 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:28:20.885848 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:28:20.885848 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:28:20.885848 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:28:20.885848 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:28:20.885848 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 14:28:20.885848 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 14:28:20.885848 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 14:28:20.885848 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 14:28:20.886886 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:28:20.886886 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:28:20.886886 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 14:28:20.886886 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 14:28:20.886886 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 14:28:20.886886 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 14:28:20.886886 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:28:20.886886 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:28:20.886886 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:28:20.886886 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:28:20.886886 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:28:20.886886 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application with Lock( May 25 14:28:20.886886 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:28:20.886886 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self._enter() May 25 14:28:20.886886 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:28:20.886886 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:28:20.886886 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:28:20.886886 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.creator() May 25 14:28:20.887888 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:28:20.887888 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application created_value = creator( May 25 14:28:20.887888 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 14:28:20.887888 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 14:28:20.887888 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 14:28:20.887888 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 14:28:20.887888 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 14:28:20.887888 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 14:28:20.887888 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 25 14:28:20.887888 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application May 25 14:28:20.898560 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 377/759] 10.222.0.67 () {56 vars in 1093 bytes} [Wed May 25 14:28:20 2022] GET /identity/v3/users/nova => generated 82 bytes in 319 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 14:28:20.905385 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5384208e-decf-408a-8fa3-6cdb926f6413 None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:21.014828 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8903b1-831e-4823-b1d4-b67abf58b6bc None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:21.089535 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5384208e-decf-408a-8fa3-6cdb926f6413 None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:21.103698 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb891da6-a577-4f21-a288-1b2629bba3dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:21.104369 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb891da6-a577-4f21-a288-1b2629bba3dc None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:21.104654 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb891da6-a577-4f21-a288-1b2629bba3dc None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:21.104928 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb891da6-a577-4f21-a288-1b2629bba3dc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:21.105767 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb891da6-a577-4f21-a288-1b2629bba3dc None admin] RBAC: Adding query filter params (role.id=399893e19eac4ab5a8e596f7c07be13c, scope.project.id=bfe93ee8d32a441295efc0b885de4bd7, user.id=dbe9e38881834198842a476889678096) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:28:21.106136 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb891da6-a577-4f21-a288-1b2629bba3dc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:21.108069 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb891da6-a577-4f21-a288-1b2629bba3dc None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:21.126197 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 383/760] 10.222.0.67 () {56 vars in 1374 bytes} [Wed May 25 14:28:20 2022] GET /identity/v3/role_assignments?user.id=dbe9e38881834198842a476889678096&scope.project.id=bfe93ee8d32a441295efc0b885de4bd7&role.id=399893e19eac4ab5a8e596f7c07be13c => generated 259 bytes in 337 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:28:21.131096 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1af6854-fbe3-423a-8c91-f78332630b29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:21.132172 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1af6854-fbe3-423a-8c91-f78332630b29 None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:21.132679 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1af6854-fbe3-423a-8c91-f78332630b29 None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:21.133157 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1af6854-fbe3-423a-8c91-f78332630b29 None admin] PATH_INFO: `/v3/users` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:21.134252 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1af6854-fbe3-423a-8c91-f78332630b29 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:28:21.134777 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1af6854-fbe3-423a-8c91-f78332630b29 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:21.136507 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1af6854-fbe3-423a-8c91-f78332630b29 None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:21.157881 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 378/761] 10.222.0.67 () {56 vars in 1133 bytes} [Wed May 25 14:28:20 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:28:21.163908 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb891da6-a577-4f21-a288-1b2629bba3dc None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:21.175126 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d3e331-4107-461f-b730-8cabeacf9414 None None] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:21.175439 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d3e331-4107-461f-b730-8cabeacf9414 None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:21.175707 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d3e331-4107-461f-b730-8cabeacf9414 None None] PATH_INFO: `/` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:21.178649 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 379/762] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 14:28:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:28:21.183324 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec158f32-7c57-48e8-ac5a-699fe18cfca3 None None] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:21.183617 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec158f32-7c57-48e8-ac5a-699fe18cfca3 None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:21.183889 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec158f32-7c57-48e8-ac5a-699fe18cfca3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:21.185790 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:21.205256 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.auth.core [None req-ec158f32-7c57-48e8-ac5a-699fe18cfca3 None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:28:21.206481 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-ec158f32-7c57-48e8-ac5a-699fe18cfca3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:28:21.266778 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:21.349745 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 380/763] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 14:28:21 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 25 14:28:21.423144 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec158f32-7c57-48e8-ac5a-699fe18cfca3 None None] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:21.556555 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb891da6-a577-4f21-a288-1b2629bba3dc None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:21.614253 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec158f32-7c57-48e8-ac5a-699fe18cfca3 None None] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:21.618596 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bad40fa-4103-4f3b-a398-1ae9218f65e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:21.619409 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bad40fa-4103-4f3b-a398-1ae9218f65e4 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:21.619685 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bad40fa-4103-4f3b-a398-1ae9218f65e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:21.619953 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bad40fa-4103-4f3b-a398-1ae9218f65e4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:21.638635 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bad40fa-4103-4f3b-a398-1ae9218f65e4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:21.640902 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bad40fa-4103-4f3b-a398-1ae9218f65e4 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:21.667978 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application [None req-2bad40fa-4103-4f3b-a398-1ae9218f65e4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:28:21.667978 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:28:21.667978 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:28:21.667978 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:28:21.667978 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:28:21.667978 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:28:21.667978 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:28:21.667978 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:28:21.667978 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:28:21.667978 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:28:21.667978 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:28:21.667978 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:28:21.667978 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 14:28:21.667978 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 14:28:21.667978 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 14:28:21.668948 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 14:28:21.668948 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:28:21.668948 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:28:21.668948 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:28:21.668948 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:28:21.668948 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:28:21.668948 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:28:21.668948 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:28:21.668948 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application with Lock( May 25 14:28:21.668948 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:28:21.668948 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._enter() May 25 14:28:21.668948 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:28:21.668948 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:28:21.668948 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:28:21.668948 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.creator() May 25 14:28:21.668948 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:28:21.668948 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application created_value = creator( May 25 14:28:21.669872 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 14:28:21.669872 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 14:28:21.669872 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:28:21.669872 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:28:21.671309 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 384/764] 10.222.0.67 () {56 vars in 1108 bytes} [Wed May 25 14:28:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 507 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:28:21.687760 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5652f103-5ad8-40d6-a0a1-45b8aa3c4b6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:21.688966 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5652f103-5ad8-40d6-a0a1-45b8aa3c4b6b None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:21.689451 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5652f103-5ad8-40d6-a0a1-45b8aa3c4b6b None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:21.689921 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5652f103-5ad8-40d6-a0a1-45b8aa3c4b6b None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:21.692325 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5652f103-5ad8-40d6-a0a1-45b8aa3c4b6b None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:21.693944 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5652f103-5ad8-40d6-a0a1-45b8aa3c4b6b None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:21.696044 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bad40fa-4103-4f3b-a398-1ae9218f65e4 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:21.707439 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application [None req-5652f103-5ad8-40d6-a0a1-45b8aa3c4b6b None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 25 14:28:21.707439 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:28:21.707439 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 14:28:21.707439 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 14:28:21.707439 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 14:28:21.707439 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 14:28:21.707439 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 14:28:21.707439 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 14:28:21.707439 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 25 14:28:21.707439 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application May 25 14:28:21.707439 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 14:28:21.707439 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application May 25 14:28:21.707439 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:28:21.707439 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:28:21.707439 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:28:21.707439 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:28:21.708417 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:28:21.708417 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:28:21.708417 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:28:21.708417 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:28:21.708417 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:28:21.708417 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:28:21.708417 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:28:21.708417 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 14:28:21.708417 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 14:28:21.708417 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 14:28:21.708417 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 14:28:21.708417 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:28:21.708417 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:28:21.708417 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:28:21.708417 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:28:21.708417 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:28:21.709278 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:28:21.709278 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:28:21.709278 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application with Lock( May 25 14:28:21.709278 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:28:21.709278 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self._enter() May 25 14:28:21.709278 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:28:21.709278 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:28:21.709278 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:28:21.709278 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.creator() May 25 14:28:21.709278 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:28:21.709278 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application created_value = creator( May 25 14:28:21.709278 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 14:28:21.709278 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 14:28:21.709278 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 25 14:28:21.709278 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application May 25 14:28:21.712195 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 381/765] 10.222.0.67 () {56 vars in 1129 bytes} [Wed May 25 14:28:21 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 14:28:21.718961 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5652f103-5ad8-40d6-a0a1-45b8aa3c4b6b None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:21.754187 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:21.793424 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:21.853529 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bad40fa-4103-4f3b-a398-1ae9218f65e4 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:21.864163 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5652f103-5ad8-40d6-a0a1-45b8aa3c4b6b None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:21.900161 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9ede6e-2f17-4cee-becb-a0aeb9ea04c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:21.900924 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9ede6e-2f17-4cee-becb-a0aeb9ea04c5 None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:21.901281 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9ede6e-2f17-4cee-becb-a0aeb9ea04c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:21.901628 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9ede6e-2f17-4cee-becb-a0aeb9ea04c5 None admin] PATH_INFO: `/v3/services` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:21.902409 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9ede6e-2f17-4cee-becb-a0aeb9ea04c5 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:28:21.902786 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9ede6e-2f17-4cee-becb-a0aeb9ea04c5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:21.904256 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9ede6e-2f17-4cee-becb-a0aeb9ea04c5 None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:21.909926 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 382/766] 10.222.0.67 () {56 vars in 1124 bytes} [Wed May 25 14:28:21 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:28:21.915575 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9ede6e-2f17-4cee-becb-a0aeb9ea04c5 None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:21.916524 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c822d38-1ab6-4502-bb66-6393efd223e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:21.917327 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c822d38-1ab6-4502-bb66-6393efd223e7 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:21.917678 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c822d38-1ab6-4502-bb66-6393efd223e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:21.917958 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c822d38-1ab6-4502-bb66-6393efd223e7 None admin] PATH_INFO: `/v3/domains` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:21.918683 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c822d38-1ab6-4502-bb66-6393efd223e7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:28:21.927769 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c822d38-1ab6-4502-bb66-6393efd223e7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:21.929190 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c822d38-1ab6-4502-bb66-6393efd223e7 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:21.957280 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 385/767] 10.222.0.67 () {56 vars in 1109 bytes} [Wed May 25 14:28:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:28:21.959996 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c822d38-1ab6-4502-bb66-6393efd223e7 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:22.079396 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:22.087365 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9ede6e-2f17-4cee-becb-a0aeb9ea04c5 None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:22.163046 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8d10af-3456-4f77-8f83-8af89155e4dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:22.164521 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8d10af-3456-4f77-8f83-8af89155e4dc None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:22.165077 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8d10af-3456-4f77-8f83-8af89155e4dc None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:22.165611 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8d10af-3456-4f77-8f83-8af89155e4dc None admin] PATH_INFO: `/v3/services` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:22.166758 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8d10af-3456-4f77-8f83-8af89155e4dc None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:28:22.168313 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8d10af-3456-4f77-8f83-8af89155e4dc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:22.171716 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8d10af-3456-4f77-8f83-8af89155e4dc None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:22.181628 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 383/768] 10.222.0.67 () {56 vars in 1124 bytes} [Wed May 25 14:28:21 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:28:22.185765 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c822d38-1ab6-4502-bb66-6393efd223e7 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:22.187463 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8d10af-3456-4f77-8f83-8af89155e4dc None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:22.235885 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:22.287146 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a432f1-302c-4a1c-97b2-5b28c22d0815 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:22.288369 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a432f1-302c-4a1c-97b2-5b28c22d0815 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:22.288856 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a432f1-302c-4a1c-97b2-5b28c22d0815 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:22.290286 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a432f1-302c-4a1c-97b2-5b28c22d0815 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:22.306564 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a432f1-302c-4a1c-97b2-5b28c22d0815 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:22.309383 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a432f1-302c-4a1c-97b2-5b28c22d0815 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:22.336650 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application [None req-90a432f1-302c-4a1c-97b2-5b28c22d0815 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 14:28:22.336650 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:28:22.336650 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:28:22.336650 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:28:22.336650 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:28:22.336650 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:28:22.336650 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:28:22.336650 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:28:22.336650 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:28:22.336650 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:28:22.336650 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:28:22.336650 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:28:22.336650 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 14:28:22.336650 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 14:28:22.336650 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 14:28:22.337628 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 14:28:22.337628 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:28:22.337628 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:28:22.337628 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:28:22.337628 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:28:22.337628 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:28:22.337628 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:28:22.337628 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:28:22.337628 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application with Lock( May 25 14:28:22.337628 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:28:22.337628 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._enter() May 25 14:28:22.337628 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:28:22.337628 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:28:22.337628 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:28:22.337628 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.creator() May 25 14:28:22.337628 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:28:22.337628 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application created_value = creator( May 25 14:28:22.338528 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 14:28:22.338528 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 14:28:22.338528 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 14:28:22.338528 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 14:28:22.338528 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 14:28:22.338528 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 14:28:22.338528 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 14:28:22.338528 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:28:22.341137 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 386/769] 10.222.0.67 () {56 vars in 1111 bytes} [Wed May 25 14:28:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 381 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:28:22.343448 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e980764-859f-4244-af34-6d5c3b060bbf None None] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:22.344766 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e980764-859f-4244-af34-6d5c3b060bbf None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:22.345259 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e980764-859f-4244-af34-6d5c3b060bbf None None] PATH_INFO: `/` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:22.347721 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 387/770] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 14:28:22 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:28:22.348674 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e980764-859f-4244-af34-6d5c3b060bbf None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:22.368221 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8d10af-3456-4f77-8f83-8af89155e4dc None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:22.412701 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8d85c4-470b-4d7b-ac61-cfe265c98392 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:22.413866 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8d85c4-470b-4d7b-ac61-cfe265c98392 None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:22.414214 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8d85c4-470b-4d7b-ac61-cfe265c98392 None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:22.414671 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8d85c4-470b-4d7b-ac61-cfe265c98392 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:22.416113 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8d85c4-470b-4d7b-ac61-cfe265c98392 None admin] RBAC: Adding query filter params (interface=public, service_id=966e784ac6ac4d45990bddef5f9b7814, region_id=RegionOne) {{(pid=80474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:28:22.416609 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8d85c4-470b-4d7b-ac61-cfe265c98392 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:22.419761 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8d85c4-470b-4d7b-ac61-cfe265c98392 None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:22.427952 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 384/771] 10.222.0.67 () {56 vars in 1251 bytes} [Wed May 25 14:28:22 2022] GET /identity/v3/endpoints?service_id=966e784ac6ac4d45990bddef5f9b7814&interface=public®ion_id=RegionOne => generated 194 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:28:22.429527 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44bc532-76b0-4447-9fb2-051346013e3f None None] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:22.429818 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44bc532-76b0-4447-9fb2-051346013e3f None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:22.430103 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44bc532-76b0-4447-9fb2-051346013e3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:22.452192 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.auth.core [None req-f44bc532-76b0-4447-9fb2-051346013e3f None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:28:22.453897 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-f44bc532-76b0-4447-9fb2-051346013e3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:28:22.480317 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:22.519470 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e980764-859f-4244-af34-6d5c3b060bbf None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:22.551331 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 385/772] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 14:28:22 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 14:28:22.552363 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44bc532-76b0-4447-9fb2-051346013e3f None None] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:22.577433 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd5efdc-ed9a-44a3-a13e-5eefb2ba80c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:22.578864 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd5efdc-ed9a-44a3-a13e-5eefb2ba80c0 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:22.579402 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd5efdc-ed9a-44a3-a13e-5eefb2ba80c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:22.579905 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd5efdc-ed9a-44a3-a13e-5eefb2ba80c0 None admin] PATH_INFO: `/v3/projects` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:22.581127 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd5efdc-ed9a-44a3-a13e-5eefb2ba80c0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:28:22.581655 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd5efdc-ed9a-44a3-a13e-5eefb2ba80c0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:22.583485 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd5efdc-ed9a-44a3-a13e-5eefb2ba80c0 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:22.604022 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 388/773] 10.222.0.67 () {56 vars in 1148 bytes} [Wed May 25 14:28:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:28:22.610525 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd5efdc-ed9a-44a3-a13e-5eefb2ba80c0 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:22.678497 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:22.713122 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44bc532-76b0-4447-9fb2-051346013e3f None None] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:22.758307 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc629cb-6799-47bf-bcff-4171ac228f61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:22.759957 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc629cb-6799-47bf-bcff-4171ac228f61 None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:22.760995 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc629cb-6799-47bf-bcff-4171ac228f61 None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:22.761469 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc629cb-6799-47bf-bcff-4171ac228f61 None admin] PATH_INFO: `/v3/services` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:22.762770 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc629cb-6799-47bf-bcff-4171ac228f61 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:22.765127 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc629cb-6799-47bf-bcff-4171ac228f61 None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:22.771740 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 386/774] 10.222.0.67 () {56 vars in 1087 bytes} [Wed May 25 14:28:22 2022] GET /identity/v3/services => generated 772 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:28:22.773165 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc629cb-6799-47bf-bcff-4171ac228f61 None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:22.787360 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd5efdc-ed9a-44a3-a13e-5eefb2ba80c0 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:22.800349 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:22.845007 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12448ea7-eefb-4f0e-963c-13d6c157a395 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:22.846236 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12448ea7-eefb-4f0e-963c-13d6c157a395 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:22.846866 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12448ea7-eefb-4f0e-963c-13d6c157a395 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:22.847379 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12448ea7-eefb-4f0e-963c-13d6c157a395 None admin] PATH_INFO: `/v3/services/network` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:22.848469 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12448ea7-eefb-4f0e-963c-13d6c157a395 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:22.850922 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12448ea7-eefb-4f0e-963c-13d6c157a395 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:22.867067 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application [None req-12448ea7-eefb-4f0e-963c-13d6c157a395 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 25 14:28:22.867067 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:28:22.867067 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 14:28:22.867067 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 14:28:22.867067 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 14:28:22.867067 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 14:28:22.867067 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 14:28:22.867067 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 14:28:22.867067 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 25 14:28:22.867067 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:28:22.867067 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 14:28:22.867067 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:28:22.867067 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:28:22.867067 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:28:22.867067 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:28:22.867067 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:28:22.867067 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:28:22.868766 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:28:22.868766 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:28:22.868766 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:28:22.868766 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:28:22.868766 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:28:22.868766 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:28:22.868766 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 14:28:22.868766 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 14:28:22.868766 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 14:28:22.868766 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 14:28:22.868766 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:28:22.868766 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:28:22.868766 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:28:22.868766 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:28:22.868766 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:28:22.868766 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:28:22.869861 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:28:22.869861 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application with Lock( May 25 14:28:22.869861 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:28:22.869861 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._enter() May 25 14:28:22.869861 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:28:22.869861 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:28:22.869861 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:28:22.869861 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.creator() May 25 14:28:22.869861 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:28:22.869861 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application created_value = creator( May 25 14:28:22.869861 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 14:28:22.869861 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 14:28:22.869861 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 25 14:28:22.869861 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:28:22.875574 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 389/775] 10.222.0.67 () {56 vars in 1111 bytes} [Wed May 25 14:28:22 2022] GET /identity/v3/services/network => generated 88 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:28:22.883650 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12448ea7-eefb-4f0e-963c-13d6c157a395 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:22.941932 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc629cb-6799-47bf-bcff-4171ac228f61 None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:22.988493 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03337bed-35d1-4eaf-815d-4270850be5e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:22.990025 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03337bed-35d1-4eaf-815d-4270850be5e6 None admin] REQUEST_METHOD: `PUT` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:22.990508 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03337bed-35d1-4eaf-815d-4270850be5e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:22.990970 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03337bed-35d1-4eaf-815d-4270850be5e6 None admin] PATH_INFO: `/v3/projects/bfe93ee8d32a441295efc0b885de4bd7/users/428ec99478284743943ed41e9d24a603/roles/399893e19eac4ab5a8e596f7c07be13c` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:22.994019 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03337bed-35d1-4eaf-815d-4270850be5e6 None admin] RBAC: Authorizing `identity:create_grant(project_id=bfe93ee8d32a441295efc0b885de4bd7, user_id=428ec99478284743943ed41e9d24a603, role_id=399893e19eac4ab5a8e596f7c07be13c)` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:22.995555 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03337bed-35d1-4eaf-815d-4270850be5e6 None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:23.013720 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 387/776] 10.222.0.67 () {58 vars in 1439 bytes} [Wed May 25 14:28:22 2022] PUT /identity/v3/projects/bfe93ee8d32a441295efc0b885de4bd7/users/428ec99478284743943ed41e9d24a603/roles/399893e19eac4ab5a8e596f7c07be13c => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:28:23.015469 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3076d64-10e3-499a-a51e-0e14bae9ad77 None None] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:23.015766 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3076d64-10e3-499a-a51e-0e14bae9ad77 None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:23.016053 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3076d64-10e3-499a-a51e-0e14bae9ad77 None None] PATH_INFO: `/` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:23.022081 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 388/777] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 14:28:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:28:23.024049 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a5fa96-77e7-4727-a3f8-85597e3f1122 None None] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:23.024577 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a5fa96-77e7-4727-a3f8-85597e3f1122 None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:23.025106 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a5fa96-77e7-4727-a3f8-85597e3f1122 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:23.042721 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12448ea7-eefb-4f0e-963c-13d6c157a395 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:23.045836 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.auth.core [None req-32a5fa96-77e7-4727-a3f8-85597e3f1122 None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:28:23.046408 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:23.047544 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-32a5fa96-77e7-4727-a3f8-85597e3f1122 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:28:23.090797 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3318b61d-d864-4f76-bd74-8f661ea52d4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:23.091662 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3318b61d-d864-4f76-bd74-8f661ea52d4d None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:23.091662 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3318b61d-d864-4f76-bd74-8f661ea52d4d None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:23.093168 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3318b61d-d864-4f76-bd74-8f661ea52d4d None admin] PATH_INFO: `/v3/services` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:23.093168 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3318b61d-d864-4f76-bd74-8f661ea52d4d None admin] RBAC: Adding query filter params (name=network) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:28:23.093168 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3318b61d-d864-4f76-bd74-8f661ea52d4d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:23.094841 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3318b61d-d864-4f76-bd74-8f661ea52d4d None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:23.106168 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 390/778] 10.222.0.67 () {56 vars in 1112 bytes} [Wed May 25 14:28:22 2022] GET /identity/v3/services?name=network => generated 124 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:28:23.113755 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3318b61d-d864-4f76-bd74-8f661ea52d4d None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:23.156158 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 389/779] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 14:28:23 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 14:28:23.180875 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a5fa96-77e7-4727-a3f8-85597e3f1122 None None] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:23.194507 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:23.241761 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3318b61d-d864-4f76-bd74-8f661ea52d4d None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:23.280607 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8c8a3e-2c53-4330-a7ba-dd3aa2716fb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:23.281287 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8c8a3e-2c53-4330-a7ba-dd3aa2716fb5 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:23.281573 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8c8a3e-2c53-4330-a7ba-dd3aa2716fb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:23.281855 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8c8a3e-2c53-4330-a7ba-dd3aa2716fb5 None admin] PATH_INFO: `/v3/services` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:23.282576 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8c8a3e-2c53-4330-a7ba-dd3aa2716fb5 None admin] RBAC: Adding query filter params (type=network) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:28:23.282887 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8c8a3e-2c53-4330-a7ba-dd3aa2716fb5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:23.284317 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8c8a3e-2c53-4330-a7ba-dd3aa2716fb5 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:23.289840 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 391/780] 10.222.0.67 () {56 vars in 1112 bytes} [Wed May 25 14:28:23 2022] GET /identity/v3/services?type=network => generated 350 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:28:23.295850 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8c8a3e-2c53-4330-a7ba-dd3aa2716fb5 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:23.306087 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a5fa96-77e7-4727-a3f8-85597e3f1122 None None] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:23.334572 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:23.360048 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9988e3b9-0ce2-4220-8bcf-6f8a572861b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:23.361312 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9988e3b9-0ce2-4220-8bcf-6f8a572861b4 None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:23.361890 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9988e3b9-0ce2-4220-8bcf-6f8a572861b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:23.362413 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9988e3b9-0ce2-4220-8bcf-6f8a572861b4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:23.385366 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9988e3b9-0ce2-4220-8bcf-6f8a572861b4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:28:23.397292 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application [None req-9988e3b9-0ce2-4220-8bcf-6f8a572861b4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 25 14:28:23.397292 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:28:23.397292 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:28:23.397292 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:28:23.397292 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:28:23.397292 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:28:23.397292 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:28:23.397292 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:28:23.397292 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:28:23.397292 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:28:23.397292 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:28:23.397292 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:28:23.397292 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:28:23.397292 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:28:23.397292 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:28:23.397292 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:28:23.398272 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:28:23.398272 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:28:23.398272 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:28:23.398272 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:28:23.398272 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:28:23.398272 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:28:23.398272 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:28:23.398272 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:28:23.398272 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:28:23.398272 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:28:23.398272 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:28:23.398272 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application with Lock( May 25 14:28:23.398272 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:28:23.398272 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self._enter() May 25 14:28:23.398272 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:28:23.398272 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:28:23.399165 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:28:23.399165 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.creator() May 25 14:28:23.399165 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:28:23.399165 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application created_value = creator( May 25 14:28:23.399165 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:28:23.399165 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:28:23.399165 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:28:23.399165 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:28:23.399165 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:28:23.399165 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:28:23.399165 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 25 14:28:23.399165 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application May 25 14:28:23.400655 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 390/781] 10.222.0.67 () {56 vars in 1102 bytes} [Wed May 25 14:28:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 14:28:23.407247 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9988e3b9-0ce2-4220-8bcf-6f8a572861b4 None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:23.492666 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:23.508974 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8c8a3e-2c53-4330-a7ba-dd3aa2716fb5 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:23.546693 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9988e3b9-0ce2-4220-8bcf-6f8a572861b4 None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:23.588135 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4001f95-6d6f-4c71-a6b3-c8b52d587505 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:23.589269 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4001f95-6d6f-4c71-a6b3-c8b52d587505 None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:23.589814 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4001f95-6d6f-4c71-a6b3-c8b52d587505 None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:23.590324 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4001f95-6d6f-4c71-a6b3-c8b52d587505 None admin] PATH_INFO: `/v3/roles` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:23.591374 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4001f95-6d6f-4c71-a6b3-c8b52d587505 None admin] RBAC: Adding query filter params (name=service) {{(pid=80474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:28:23.591974 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4001f95-6d6f-4c71-a6b3-c8b52d587505 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:23.593818 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4001f95-6d6f-4c71-a6b3-c8b52d587505 None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:23.595853 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed9f319-1586-4a47-b192-f9547b1669b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:23.596557 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed9f319-1586-4a47-b192-f9547b1669b0 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:23.596849 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed9f319-1586-4a47-b192-f9547b1669b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:23.597128 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed9f319-1586-4a47-b192-f9547b1669b0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:23.597964 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed9f319-1586-4a47-b192-f9547b1669b0 None admin] RBAC: Adding query filter params (interface=public, service_id=5fced4652b854c7dbcd6d593182b6634, region_id=RegionOne) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:28:23.598282 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed9f319-1586-4a47-b192-f9547b1669b0 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:23.599758 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed9f319-1586-4a47-b192-f9547b1669b0 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:23.606923 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 391/782] 10.222.0.67 () {56 vars in 1103 bytes} [Wed May 25 14:28:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:28:23.613404 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 392/783] 10.222.0.67 () {56 vars in 1251 bytes} [Wed May 25 14:28:23 2022] GET /identity/v3/endpoints?service_id=5fced4652b854c7dbcd6d593182b6634&interface=public®ion_id=RegionOne => generated 194 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:28:23.614845 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4001f95-6d6f-4c71-a6b3-c8b52d587505 None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:23.618601 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed9f319-1586-4a47-b192-f9547b1669b0 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:23.799701 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4001f95-6d6f-4c71-a6b3-c8b52d587505 None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:23.803671 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:23.811291 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed9f319-1586-4a47-b192-f9547b1669b0 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:23.845909 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:23.852154 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dede84f3-1ac7-4ef9-ab87-42d635f118dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:23.852988 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dede84f3-1ac7-4ef9-ab87-42d635f118dc None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:23.853374 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dede84f3-1ac7-4ef9-ab87-42d635f118dc None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:23.853753 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dede84f3-1ac7-4ef9-ab87-42d635f118dc None admin] PATH_INFO: `/v3/services` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:23.854000 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a57e38d-678f-4c4f-851d-bbf4a6b7c449 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:23.854639 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dede84f3-1ac7-4ef9-ab87-42d635f118dc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:23.855135 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a57e38d-678f-4c4f-851d-bbf4a6b7c449 None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:23.855574 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a57e38d-678f-4c4f-851d-bbf4a6b7c449 None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:23.855990 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a57e38d-678f-4c4f-851d-bbf4a6b7c449 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:23.856426 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dede84f3-1ac7-4ef9-ab87-42d635f118dc None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:23.863020 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 393/784] 10.222.0.67 () {56 vars in 1087 bytes} [Wed May 25 14:28:23 2022] GET /identity/v3/services => generated 772 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:28:23.864499 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dfe59c-b146-4326-aeaf-9b8e1426d383 None None] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:23.864890 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dfe59c-b146-4326-aeaf-9b8e1426d383 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:23.865272 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dfe59c-b146-4326-aeaf-9b8e1426d383 None None] PATH_INFO: `/` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:23.870869 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 394/785] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 14:28:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:28:23.874242 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e813479-e0a7-4a8a-bb21-ea4ad06dfd48 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:23.874748 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e813479-e0a7-4a8a-bb21-ea4ad06dfd48 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:23.875203 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e813479-e0a7-4a8a-bb21-ea4ad06dfd48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:23.884314 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a57e38d-678f-4c4f-851d-bbf4a6b7c449 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:23.886087 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a57e38d-678f-4c4f-851d-bbf4a6b7c449 None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:23.896627 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-6e813479-e0a7-4a8a-bb21-ea4ad06dfd48 None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:28:23.898117 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-6e813479-e0a7-4a8a-bb21-ea4ad06dfd48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:28:23.926345 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application [None req-5a57e38d-678f-4c4f-851d-bbf4a6b7c449 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:28:23.926345 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:28:23.926345 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:28:23.926345 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:28:23.926345 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:28:23.926345 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:28:23.926345 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:28:23.926345 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:28:23.926345 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:28:23.926345 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:28:23.926345 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:28:23.926345 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:28:23.926345 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 14:28:23.926345 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 14:28:23.926345 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 14:28:23.927515 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 14:28:23.927515 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:28:23.927515 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:28:23.927515 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:28:23.927515 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:28:23.927515 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:28:23.927515 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:28:23.927515 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:28:23.927515 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application with Lock( May 25 14:28:23.927515 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:28:23.927515 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self._enter() May 25 14:28:23.927515 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:28:23.927515 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:28:23.927515 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:28:23.927515 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.creator() May 25 14:28:23.927515 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:28:23.927515 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application created_value = creator( May 25 14:28:23.928626 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 14:28:23.928626 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 14:28:23.928626 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:28:23.928626 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application May 25 14:28:23.930255 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 392/786] 10.222.0.67 () {56 vars in 1108 bytes} [Wed May 25 14:28:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 316 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:28:23.936579 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a57e38d-678f-4c4f-851d-bbf4a6b7c449 None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:23.995730 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 395/787] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 14:28:23 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 25 14:28:24.016344 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e813479-e0a7-4a8a-bb21-ea4ad06dfd48 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:24.114208 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a57e38d-678f-4c4f-851d-bbf4a6b7c449 None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:24.117578 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:24.129825 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e813479-e0a7-4a8a-bb21-ea4ad06dfd48 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:24.151817 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6022d6ba-fa4d-4375-ad20-e3ece7d246bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:24.152751 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6022d6ba-fa4d-4375-ad20-e3ece7d246bc None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:24.153129 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6022d6ba-fa4d-4375-ad20-e3ece7d246bc None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:24.153514 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6022d6ba-fa4d-4375-ad20-e3ece7d246bc None admin] PATH_INFO: `/v3/domains` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:24.154485 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6022d6ba-fa4d-4375-ad20-e3ece7d246bc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:28:24.156067 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6022d6ba-fa4d-4375-ad20-e3ece7d246bc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:24.157831 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6022d6ba-fa4d-4375-ad20-e3ece7d246bc None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:24.168808 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83072295-6533-4c21-944c-6df579d33b18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:24.169806 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83072295-6533-4c21-944c-6df579d33b18 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:24.170282 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83072295-6533-4c21-944c-6df579d33b18 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:24.170699 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83072295-6533-4c21-944c-6df579d33b18 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:24.171725 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 393/788] 10.222.0.67 () {56 vars in 1109 bytes} [Wed May 25 14:28:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:28:24.177177 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6022d6ba-fa4d-4375-ad20-e3ece7d246bc None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:24.182495 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83072295-6533-4c21-944c-6df579d33b18 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:28:24.198058 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application [None req-83072295-6533-4c21-944c-6df579d33b18 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 14:28:24.198058 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:28:24.198058 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:28:24.198058 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:28:24.198058 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:28:24.198058 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:28:24.198058 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:28:24.198058 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:28:24.198058 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:28:24.198058 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:28:24.198058 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:28:24.198058 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:28:24.198058 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:28:24.198058 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:28:24.198058 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:28:24.198058 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:28:24.199100 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:28:24.199100 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:28:24.199100 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:28:24.199100 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:28:24.199100 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:28:24.199100 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:28:24.199100 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:28:24.199100 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:28:24.199100 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:28:24.199100 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:28:24.199100 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:28:24.199100 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application with Lock( May 25 14:28:24.199100 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:28:24.199100 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._enter() May 25 14:28:24.199100 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:28:24.199100 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:28:24.199993 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:28:24.199993 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.creator() May 25 14:28:24.199993 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:28:24.199993 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application created_value = creator( May 25 14:28:24.199993 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:28:24.199993 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:28:24.199993 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:28:24.199993 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:28:24.199993 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:28:24.199993 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:28:24.199993 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 14:28:24.199993 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:28:24.199993 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 396/789] 10.222.0.67 () {56 vars in 1096 bytes} [Wed May 25 14:28:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 14:28:24.211027 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83072295-6533-4c21-944c-6df579d33b18 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:24.229762 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:24.293690 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6022d6ba-fa4d-4375-ad20-e3ece7d246bc None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:24.333458 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637e27d7-f680-4f1c-a5d5-2a3efc81e508 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:24.334529 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637e27d7-f680-4f1c-a5d5-2a3efc81e508 None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:24.335161 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637e27d7-f680-4f1c-a5d5-2a3efc81e508 None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:24.335666 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637e27d7-f680-4f1c-a5d5-2a3efc81e508 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:24.341172 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83072295-6533-4c21-944c-6df579d33b18 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:24.344876 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637e27d7-f680-4f1c-a5d5-2a3efc81e508 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:24.346506 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637e27d7-f680-4f1c-a5d5-2a3efc81e508 None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:24.362880 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application [None req-637e27d7-f680-4f1c-a5d5-2a3efc81e508 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 25 14:28:24.362880 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:28:24.362880 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:28:24.362880 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:28:24.362880 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:28:24.362880 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:28:24.362880 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:28:24.362880 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:28:24.362880 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:28:24.362880 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:28:24.362880 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:28:24.362880 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:28:24.362880 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 14:28:24.362880 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 14:28:24.362880 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 14:28:24.362880 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 14:28:24.364258 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:28:24.364258 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:28:24.364258 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 14:28:24.364258 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 14:28:24.364258 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 14:28:24.364258 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 14:28:24.364258 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:28:24.364258 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:28:24.364258 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:28:24.364258 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:28:24.364258 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:28:24.364258 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application with Lock( May 25 14:28:24.364258 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:28:24.364258 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self._enter() May 25 14:28:24.364258 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:28:24.364258 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:28:24.364258 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:28:24.364258 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.creator() May 25 14:28:24.365429 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:28:24.365429 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application created_value = creator( May 25 14:28:24.365429 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 14:28:24.365429 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 14:28:24.365429 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 14:28:24.365429 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 14:28:24.365429 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 14:28:24.365429 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 14:28:24.365429 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 25 14:28:24.365429 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application May 25 14:28:24.367684 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 394/790] 10.222.0.67 () {56 vars in 1117 bytes} [Wed May 25 14:28:24 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 14:28:24.373716 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637e27d7-f680-4f1c-a5d5-2a3efc81e508 None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:24.411184 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ad06ee-4d64-4a34-b83c-016b14207d62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:24.412137 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ad06ee-4d64-4a34-b83c-016b14207d62 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:24.412569 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ad06ee-4d64-4a34-b83c-016b14207d62 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:24.413015 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ad06ee-4d64-4a34-b83c-016b14207d62 None admin] PATH_INFO: `/v3/roles` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:24.413966 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ad06ee-4d64-4a34-b83c-016b14207d62 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:28:24.414418 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ad06ee-4d64-4a34-b83c-016b14207d62 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:24.415982 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ad06ee-4d64-4a34-b83c-016b14207d62 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:24.426137 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 397/791] 10.222.0.67 () {56 vars in 1099 bytes} [Wed May 25 14:28:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:28:24.431699 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ad06ee-4d64-4a34-b83c-016b14207d62 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:24.450474 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:24.577280 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637e27d7-f680-4f1c-a5d5-2a3efc81e508 None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:24.595364 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:24.622792 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ad06ee-4d64-4a34-b83c-016b14207d62 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:24.647690 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1730e5e-0659-4997-8456-7006c2da8f2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:24.648373 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1730e5e-0659-4997-8456-7006c2da8f2f None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:24.648659 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1730e5e-0659-4997-8456-7006c2da8f2f None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:24.648935 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1730e5e-0659-4997-8456-7006c2da8f2f None admin] PATH_INFO: `/v3/users` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:24.649791 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1730e5e-0659-4997-8456-7006c2da8f2f None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:28:24.650103 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1730e5e-0659-4997-8456-7006c2da8f2f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:24.651828 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1730e5e-0659-4997-8456-7006c2da8f2f None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:24.684838 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 395/792] 10.222.0.67 () {56 vars in 1149 bytes} [Wed May 25 14:28:24 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:28:24.690163 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1730e5e-0659-4997-8456-7006c2da8f2f None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:24.705464 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9956c0dc-4850-4a22-884e-9db7672b7dd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:24.706255 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9956c0dc-4850-4a22-884e-9db7672b7dd8 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:24.706531 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9956c0dc-4850-4a22-884e-9db7672b7dd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:24.706798 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9956c0dc-4850-4a22-884e-9db7672b7dd8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:24.724898 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9956c0dc-4850-4a22-884e-9db7672b7dd8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:24.726350 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9956c0dc-4850-4a22-884e-9db7672b7dd8 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:24.756767 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application [None req-9956c0dc-4850-4a22-884e-9db7672b7dd8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:28:24.756767 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:28:24.756767 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:28:24.756767 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:28:24.756767 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:28:24.756767 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:28:24.756767 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:28:24.756767 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:28:24.756767 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:28:24.756767 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:28:24.756767 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:28:24.756767 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:28:24.756767 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 14:28:24.756767 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 14:28:24.756767 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 14:28:24.757781 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 14:28:24.757781 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:28:24.757781 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:28:24.757781 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:28:24.757781 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:28:24.757781 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:28:24.757781 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:28:24.757781 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:28:24.757781 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application with Lock( May 25 14:28:24.757781 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:28:24.757781 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._enter() May 25 14:28:24.757781 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:28:24.757781 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:28:24.757781 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:28:24.757781 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.creator() May 25 14:28:24.757781 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:28:24.757781 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application created_value = creator( May 25 14:28:24.758695 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 14:28:24.758695 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 14:28:24.758695 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:28:24.758695 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:28:24.758695 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 398/793] 10.222.0.67 () {56 vars in 1108 bytes} [Wed May 25 14:28:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 327 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 14:28:24.773301 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9956c0dc-4850-4a22-884e-9db7672b7dd8 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:24.859267 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1730e5e-0659-4997-8456-7006c2da8f2f None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:24.901270 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45789fbd-ead4-4407-94a3-38d57267732c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:24.902006 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45789fbd-ead4-4407-94a3-38d57267732c None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:24.902295 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45789fbd-ead4-4407-94a3-38d57267732c None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:24.902577 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45789fbd-ead4-4407-94a3-38d57267732c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:24.915361 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:24.924451 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45789fbd-ead4-4407-94a3-38d57267732c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:24.925930 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45789fbd-ead4-4407-94a3-38d57267732c None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:24.962399 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application [None req-45789fbd-ead4-4407-94a3-38d57267732c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:28:24.962399 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:28:24.962399 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:28:24.962399 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:28:24.962399 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:28:24.962399 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:28:24.962399 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:28:24.962399 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:28:24.962399 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:28:24.962399 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:28:24.962399 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:28:24.962399 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:28:24.962399 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 14:28:24.962399 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 14:28:24.962399 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 14:28:24.963422 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 14:28:24.963422 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:28:24.963422 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:28:24.963422 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:28:24.963422 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:28:24.963422 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:28:24.963422 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:28:24.963422 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:28:24.963422 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application with Lock( May 25 14:28:24.963422 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:28:24.963422 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self._enter() May 25 14:28:24.963422 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:28:24.963422 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:28:24.963422 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:28:24.963422 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.creator() May 25 14:28:24.963422 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:28:24.963422 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application created_value = creator( May 25 14:28:24.964336 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 14:28:24.964336 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 14:28:24.964336 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:28:24.964336 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application May 25 14:28:24.964336 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 396/794] 10.222.0.67 () {56 vars in 1108 bytes} [Wed May 25 14:28:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 14:28:24.972269 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45789fbd-ead4-4407-94a3-38d57267732c None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:24.992376 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:25.004966 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9956c0dc-4850-4a22-884e-9db7672b7dd8 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:25.093266 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fe7a48-da3f-40eb-a36d-20a8ef58782c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:25.094359 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fe7a48-da3f-40eb-a36d-20a8ef58782c None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:25.094852 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fe7a48-da3f-40eb-a36d-20a8ef58782c None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:25.095381 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fe7a48-da3f-40eb-a36d-20a8ef58782c None admin] PATH_INFO: `/v3/domains` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:25.096324 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fe7a48-da3f-40eb-a36d-20a8ef58782c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:28:25.096854 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fe7a48-da3f-40eb-a36d-20a8ef58782c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:25.098457 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fe7a48-da3f-40eb-a36d-20a8ef58782c None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:25.099552 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45789fbd-ead4-4407-94a3-38d57267732c None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:25.114039 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 399/795] 10.222.0.67 () {56 vars in 1109 bytes} [Wed May 25 14:28:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 341 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:28:25.119863 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fe7a48-da3f-40eb-a36d-20a8ef58782c None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:25.187783 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4280c45-1e43-4ba8-825c-af6086f51373 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:25.188380 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4280c45-1e43-4ba8-825c-af6086f51373 None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:25.188901 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4280c45-1e43-4ba8-825c-af6086f51373 None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:25.188901 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4280c45-1e43-4ba8-825c-af6086f51373 None admin] PATH_INFO: `/v3/domains` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:25.189652 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4280c45-1e43-4ba8-825c-af6086f51373 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:28:25.190027 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4280c45-1e43-4ba8-825c-af6086f51373 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:25.191352 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4280c45-1e43-4ba8-825c-af6086f51373 None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:25.218194 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 397/796] 10.222.0.67 () {56 vars in 1109 bytes} [Wed May 25 14:28:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:28:25.225580 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4280c45-1e43-4ba8-825c-af6086f51373 None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:25.236561 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fe7a48-da3f-40eb-a36d-20a8ef58782c None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:25.263646 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:25.276519 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8497cb46-624f-46ab-8d82-4d69fa0a50b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:25.277757 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8497cb46-624f-46ab-8d82-4d69fa0a50b2 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:25.278250 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8497cb46-624f-46ab-8d82-4d69fa0a50b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:25.278734 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8497cb46-624f-46ab-8d82-4d69fa0a50b2 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:25.287244 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8497cb46-624f-46ab-8d82-4d69fa0a50b2 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:25.289168 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8497cb46-624f-46ab-8d82-4d69fa0a50b2 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:25.305302 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application [None req-8497cb46-624f-46ab-8d82-4d69fa0a50b2 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 25 14:28:25.305302 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:28:25.305302 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:28:25.305302 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:28:25.305302 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:28:25.305302 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:28:25.305302 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:28:25.305302 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:28:25.305302 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:28:25.305302 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:28:25.305302 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:28:25.305302 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:28:25.305302 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 14:28:25.305302 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 14:28:25.305302 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 14:28:25.305302 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 14:28:25.306316 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:28:25.306316 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:28:25.306316 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 14:28:25.306316 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 14:28:25.306316 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 14:28:25.306316 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 14:28:25.306316 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:28:25.306316 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:28:25.306316 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:28:25.306316 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:28:25.306316 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:28:25.306316 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application with Lock( May 25 14:28:25.306316 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:28:25.306316 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._enter() May 25 14:28:25.306316 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:28:25.306316 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:28:25.306316 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:28:25.306316 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.creator() May 25 14:28:25.307326 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:28:25.307326 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application created_value = creator( May 25 14:28:25.307326 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 14:28:25.307326 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 14:28:25.307326 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 14:28:25.307326 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 14:28:25.307326 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 14:28:25.307326 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 14:28:25.307326 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 25 14:28:25.307326 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:28:25.311767 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 400/797] 10.222.0.67 () {56 vars in 1096 bytes} [Wed May 25 14:28:25 2022] GET /identity/v3/users/swift => generated 83 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:28:25.317801 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8497cb46-624f-46ab-8d82-4d69fa0a50b2 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:25.378656 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:25.410739 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4280c45-1e43-4ba8-825c-af6086f51373 None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:25.450274 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae45d31-f669-47d2-808d-8d66e5c562d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:25.452095 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae45d31-f669-47d2-808d-8d66e5c562d3 None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:25.452754 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae45d31-f669-47d2-808d-8d66e5c562d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:25.453251 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae45d31-f669-47d2-808d-8d66e5c562d3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:25.461653 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae45d31-f669-47d2-808d-8d66e5c562d3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:25.463533 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae45d31-f669-47d2-808d-8d66e5c562d3 None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:25.479728 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application [None req-eae45d31-f669-47d2-808d-8d66e5c562d3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 14:28:25.479728 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:28:25.479728 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:28:25.479728 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:28:25.479728 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:28:25.479728 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:28:25.479728 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:28:25.479728 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:28:25.479728 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:28:25.479728 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:28:25.479728 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:28:25.479728 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:28:25.479728 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 14:28:25.479728 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 14:28:25.479728 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 14:28:25.480750 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 14:28:25.480750 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:28:25.480750 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:28:25.480750 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:28:25.480750 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:28:25.480750 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:28:25.480750 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:28:25.480750 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:28:25.480750 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application with Lock( May 25 14:28:25.480750 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:28:25.480750 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self._enter() May 25 14:28:25.480750 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:28:25.480750 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:28:25.480750 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:28:25.480750 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.creator() May 25 14:28:25.480750 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:28:25.480750 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application created_value = creator( May 25 14:28:25.481644 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 14:28:25.481644 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 14:28:25.481644 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 14:28:25.481644 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 14:28:25.481644 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 14:28:25.481644 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 14:28:25.481644 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 14:28:25.481644 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application May 25 14:28:25.485715 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 398/798] 10.222.0.67 () {56 vars in 1111 bytes} [Wed May 25 14:28:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:28:25.491555 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae45d31-f669-47d2-808d-8d66e5c562d3 None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:25.506583 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8497cb46-624f-46ab-8d82-4d69fa0a50b2 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:25.549598 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2923d5-7621-4ec1-8880-9ef65709d62b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:25.550702 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2923d5-7621-4ec1-8880-9ef65709d62b None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:25.551235 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2923d5-7621-4ec1-8880-9ef65709d62b None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:25.551784 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2923d5-7621-4ec1-8880-9ef65709d62b None admin] PATH_INFO: `/v3/users` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:25.552946 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2923d5-7621-4ec1-8880-9ef65709d62b None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:28:25.553697 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2923d5-7621-4ec1-8880-9ef65709d62b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:25.555575 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2923d5-7621-4ec1-8880-9ef65709d62b None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:25.575971 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 401/799] 10.222.0.67 () {56 vars in 1135 bytes} [Wed May 25 14:28:25 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:28:25.581617 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2923d5-7621-4ec1-8880-9ef65709d62b None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:25.647259 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:25.659133 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae45d31-f669-47d2-808d-8d66e5c562d3 None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:25.692614 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:25.698983 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20278527-f317-43c9-92b6-c89272cb0e27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:25.699950 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20278527-f317-43c9-92b6-c89272cb0e27 None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:25.700492 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20278527-f317-43c9-92b6-c89272cb0e27 None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:25.700989 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20278527-f317-43c9-92b6-c89272cb0e27 None admin] PATH_INFO: `/v3/projects` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:25.702597 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20278527-f317-43c9-92b6-c89272cb0e27 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:28:25.703232 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20278527-f317-43c9-92b6-c89272cb0e27 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:25.704861 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20278527-f317-43c9-92b6-c89272cb0e27 None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:25.718527 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 399/800] 10.222.0.67 () {56 vars in 1148 bytes} [Wed May 25 14:28:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:28:25.720137 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885ee707-a0d6-4d9e-a667-82fc0b1bbfb2 None None] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:25.720284 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2923d5-7621-4ec1-8880-9ef65709d62b None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:25.720826 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885ee707-a0d6-4d9e-a667-82fc0b1bbfb2 None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:25.721312 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885ee707-a0d6-4d9e-a667-82fc0b1bbfb2 None None] PATH_INFO: `/` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:25.723513 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 400/801] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 14:28:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:28:25.724418 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885ee707-a0d6-4d9e-a667-82fc0b1bbfb2 None None] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:25.759025 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9ee099-99c4-45d5-ab8a-88284cf512de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:25.759818 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9ee099-99c4-45d5-ab8a-88284cf512de None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:25.760159 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9ee099-99c4-45d5-ab8a-88284cf512de None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:25.760378 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9ee099-99c4-45d5-ab8a-88284cf512de None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:25.770826 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9ee099-99c4-45d5-ab8a-88284cf512de None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:25.772441 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9ee099-99c4-45d5-ab8a-88284cf512de None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:25.790576 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application [None req-7b9ee099-99c4-45d5-ab8a-88284cf512de None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:28:25.790576 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:28:25.790576 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:28:25.790576 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:28:25.790576 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:28:25.790576 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:28:25.790576 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:28:25.790576 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:28:25.790576 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:28:25.790576 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:28:25.790576 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:28:25.790576 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:28:25.790576 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 14:28:25.790576 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 14:28:25.790576 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 14:28:25.791527 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 14:28:25.791527 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:28:25.791527 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:28:25.791527 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:28:25.791527 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:28:25.791527 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:28:25.791527 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:28:25.791527 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:28:25.791527 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application with Lock( May 25 14:28:25.791527 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:28:25.791527 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._enter() May 25 14:28:25.791527 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:28:25.791527 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:28:25.791527 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:28:25.791527 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.creator() May 25 14:28:25.791527 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:28:25.791527 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application created_value = creator( May 25 14:28:25.792437 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 14:28:25.792437 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 14:28:25.792437 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:28:25.792437 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:28:25.797140 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 402/802] 10.222.0.67 () {56 vars in 1108 bytes} [Wed May 25 14:28:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:28:25.798251 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293e955b-2036-421b-8f16-87d5843113fb None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:25.798549 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293e955b-2036-421b-8f16-87d5843113fb None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:25.798839 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293e955b-2036-421b-8f16-87d5843113fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:25.815287 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-293e955b-2036-421b-8f16-87d5843113fb None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:28:25.816463 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-293e955b-2036-421b-8f16-87d5843113fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:28:25.847224 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885ee707-a0d6-4d9e-a667-82fc0b1bbfb2 None None] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:25.882736 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9314c9-b055-43d4-a638-37824f65b496 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:25.883743 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9314c9-b055-43d4-a638-37824f65b496 None admin] REQUEST_METHOD: `PUT` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:25.884093 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9314c9-b055-43d4-a638-37824f65b496 None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:25.884435 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9314c9-b055-43d4-a638-37824f65b496 None admin] PATH_INFO: `/v3/projects/bfe93ee8d32a441295efc0b885de4bd7/users/e03f5bb82ffb41a1b1dde935d093e6f4/roles/85be32e3c1ae4269b5456307e0827cc7` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:25.903030 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 403/803] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 14:28:25 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 14:28:25.903030 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f883bae6-40e5-405b-9c2b-ddcdb1f2c375 None None] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:25.903030 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f883bae6-40e5-405b-9c2b-ddcdb1f2c375 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:25.903030 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f883bae6-40e5-405b-9c2b-ddcdb1f2c375 None None] PATH_INFO: `/` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:25.903030 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 404/804] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 14:28:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:28:25.903030 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f883bae6-40e5-405b-9c2b-ddcdb1f2c375 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:25.905996 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9314c9-b055-43d4-a638-37824f65b496 None admin] RBAC: Authorizing `identity:create_grant(project_id=bfe93ee8d32a441295efc0b885de4bd7, user_id=e03f5bb82ffb41a1b1dde935d093e6f4, role_id=85be32e3c1ae4269b5456307e0827cc7)` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:25.907607 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9314c9-b055-43d4-a638-37824f65b496 None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:25.925191 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 401/805] 10.222.0.67 () {58 vars in 1439 bytes} [Wed May 25 14:28:25 2022] PUT /identity/v3/projects/bfe93ee8d32a441295efc0b885de4bd7/users/e03f5bb82ffb41a1b1dde935d093e6f4/roles/85be32e3c1ae4269b5456307e0827cc7 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:28:25.926806 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a6723b-1efd-4ab3-b127-40687fbb50eb None None] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:25.927143 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a6723b-1efd-4ab3-b127-40687fbb50eb None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:25.927428 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a6723b-1efd-4ab3-b127-40687fbb50eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:25.945374 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.auth.core [None req-44a6723b-1efd-4ab3-b127-40687fbb50eb None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:28:25.946602 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-44a6723b-1efd-4ab3-b127-40687fbb50eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:28:25.948014 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:25.992399 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:26.045780 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 402/806] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 14:28:25 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 14:28:26.046951 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a6723b-1efd-4ab3-b127-40687fbb50eb None None] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:26.061724 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f883bae6-40e5-405b-9c2b-ddcdb1f2c375 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:26.099174 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad0ae45-7268-4cd6-b3aa-4d06a495948f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:26.100261 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad0ae45-7268-4cd6-b3aa-4d06a495948f None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:26.100606 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad0ae45-7268-4cd6-b3aa-4d06a495948f None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:26.100965 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad0ae45-7268-4cd6-b3aa-4d06a495948f None admin] PATH_INFO: `/v3/domains` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:26.101781 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad0ae45-7268-4cd6-b3aa-4d06a495948f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:28:26.102162 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad0ae45-7268-4cd6-b3aa-4d06a495948f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:26.103700 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad0ae45-7268-4cd6-b3aa-4d06a495948f None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:26.116415 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 405/807] 10.222.0.67 () {56 vars in 1109 bytes} [Wed May 25 14:28:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:28:26.117455 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad0ae45-7268-4cd6-b3aa-4d06a495948f None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:26.172861 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a6723b-1efd-4ab3-b127-40687fbb50eb None None] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:26.217592 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8285719b-5d0e-434a-acba-5ebbcbdcd945 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:26.219602 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8285719b-5d0e-434a-acba-5ebbcbdcd945 None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:26.220066 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8285719b-5d0e-434a-acba-5ebbcbdcd945 None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:26.220667 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8285719b-5d0e-434a-acba-5ebbcbdcd945 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:26.221882 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8285719b-5d0e-434a-acba-5ebbcbdcd945 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:26.223461 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8285719b-5d0e-434a-acba-5ebbcbdcd945 None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:26.236814 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad0ae45-7268-4cd6-b3aa-4d06a495948f None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:26.240519 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application [None req-8285719b-5d0e-434a-acba-5ebbcbdcd945 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 25 14:28:26.240519 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:28:26.240519 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 14:28:26.240519 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 14:28:26.240519 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 14:28:26.240519 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 14:28:26.240519 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 14:28:26.240519 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 14:28:26.240519 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 25 14:28:26.240519 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application May 25 14:28:26.240519 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 14:28:26.240519 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application May 25 14:28:26.240519 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:28:26.240519 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:28:26.240519 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:28:26.240519 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:28:26.241477 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:28:26.241477 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:28:26.241477 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:28:26.241477 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:28:26.241477 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:28:26.241477 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:28:26.241477 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:28:26.241477 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 14:28:26.241477 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 14:28:26.241477 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 14:28:26.241477 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 14:28:26.241477 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:28:26.241477 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:28:26.241477 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:28:26.241477 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:28:26.241477 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:28:26.242320 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:28:26.242320 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:28:26.242320 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application with Lock( May 25 14:28:26.242320 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:28:26.242320 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self._enter() May 25 14:28:26.242320 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:28:26.242320 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:28:26.242320 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:28:26.242320 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.creator() May 25 14:28:26.242320 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:28:26.242320 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application created_value = creator( May 25 14:28:26.242320 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 14:28:26.242320 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 14:28:26.242320 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 25 14:28:26.242320 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application May 25 14:28:26.244047 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:26.245472 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 403/808] 10.222.0.67 () {56 vars in 1129 bytes} [Wed May 25 14:28:26 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:28:26.247017 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8285719b-5d0e-434a-acba-5ebbcbdcd945 None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:26.274806 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12eb506-e875-4c4a-822a-4bc17ee2bfcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:26.275690 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12eb506-e875-4c4a-822a-4bc17ee2bfcf None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:26.275971 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12eb506-e875-4c4a-822a-4bc17ee2bfcf None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:26.276245 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12eb506-e875-4c4a-822a-4bc17ee2bfcf None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:26.286056 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:26.288029 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12eb506-e875-4c4a-822a-4bc17ee2bfcf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:28:26.296407 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application [None req-f12eb506-e875-4c4a-822a-4bc17ee2bfcf None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 14:28:26.296407 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:28:26.296407 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:28:26.296407 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:28:26.296407 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:28:26.296407 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:28:26.296407 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:28:26.296407 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:28:26.296407 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:28:26.296407 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:28:26.296407 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:28:26.296407 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:28:26.296407 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:28:26.296407 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:28:26.296407 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:28:26.296407 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:28:26.297410 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:28:26.297410 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:28:26.297410 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:28:26.297410 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:28:26.297410 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:28:26.297410 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:28:26.297410 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:28:26.297410 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:28:26.297410 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:28:26.297410 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:28:26.297410 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:28:26.297410 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application with Lock( May 25 14:28:26.297410 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:28:26.297410 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._enter() May 25 14:28:26.297410 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:28:26.297410 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:28:26.298691 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:28:26.298691 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.creator() May 25 14:28:26.298691 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:28:26.298691 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application created_value = creator( May 25 14:28:26.298691 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:28:26.298691 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:28:26.298691 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:28:26.298691 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:28:26.298691 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:28:26.298691 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:28:26.298691 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 14:28:26.298691 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:28:26.298691 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 406/809] 10.222.0.67 () {56 vars in 1096 bytes} [Wed May 25 14:28:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:28:26.299524 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12eb506-e875-4c4a-822a-4bc17ee2bfcf None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:26.370397 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8285719b-5d0e-434a-acba-5ebbcbdcd945 None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:26.407775 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12eb506-e875-4c4a-822a-4bc17ee2bfcf None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:26.409740 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1322ba40-87a0-4504-a89e-d45b5bf495aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:26.410663 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1322ba40-87a0-4504-a89e-d45b5bf495aa None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:26.410951 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1322ba40-87a0-4504-a89e-d45b5bf495aa None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:26.411258 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1322ba40-87a0-4504-a89e-d45b5bf495aa None admin] PATH_INFO: `/v3/projects/service` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:26.418756 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1322ba40-87a0-4504-a89e-d45b5bf495aa None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:26.420903 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1322ba40-87a0-4504-a89e-d45b5bf495aa None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:26.436737 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application [None req-1322ba40-87a0-4504-a89e-d45b5bf495aa None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 14:28:26.436737 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:28:26.436737 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:28:26.436737 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:28:26.436737 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:28:26.436737 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:28:26.436737 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:28:26.436737 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:28:26.436737 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:28:26.436737 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:28:26.436737 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:28:26.436737 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:28:26.436737 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 14:28:26.436737 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 14:28:26.436737 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 14:28:26.438839 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 14:28:26.438839 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:28:26.438839 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:28:26.438839 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:28:26.438839 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:28:26.438839 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:28:26.438839 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:28:26.438839 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:28:26.438839 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application with Lock( May 25 14:28:26.438839 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:28:26.438839 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self._enter() May 25 14:28:26.438839 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:28:26.438839 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:28:26.438839 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:28:26.438839 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.creator() May 25 14:28:26.438839 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:28:26.438839 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application created_value = creator( May 25 14:28:26.441443 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 14:28:26.441443 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 14:28:26.441443 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 14:28:26.441443 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 14:28:26.441443 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 14:28:26.441443 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 14:28:26.441443 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 14:28:26.441443 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application May 25 14:28:26.444433 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1169ea-a9a0-425f-b8fb-871609809a70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:26.444739 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 404/810] 10.222.0.67 () {56 vars in 1111 bytes} [Wed May 25 14:28:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:28:26.444891 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1169ea-a9a0-425f-b8fb-871609809a70 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:26.444891 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1169ea-a9a0-425f-b8fb-871609809a70 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:26.445174 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1322ba40-87a0-4504-a89e-d45b5bf495aa None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:26.445361 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1169ea-a9a0-425f-b8fb-871609809a70 None admin] PATH_INFO: `/v3/services` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:26.445361 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1169ea-a9a0-425f-b8fb-871609809a70 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:28:26.445361 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1169ea-a9a0-425f-b8fb-871609809a70 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:26.447767 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1169ea-a9a0-425f-b8fb-871609809a70 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:26.452629 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 407/811] 10.222.0.67 () {56 vars in 1124 bytes} [Wed May 25 14:28:26 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:28:26.453519 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1169ea-a9a0-425f-b8fb-871609809a70 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:26.465775 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:26.567913 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:26.569986 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1169ea-a9a0-425f-b8fb-871609809a70 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:26.575218 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1322ba40-87a0-4504-a89e-d45b5bf495aa None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:26.613252 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65351220-c2f1-43a6-b40a-a60cd090dac5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:26.614251 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65351220-c2f1-43a6-b40a-a60cd090dac5 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:26.614729 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65351220-c2f1-43a6-b40a-a60cd090dac5 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:26.615234 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65351220-c2f1-43a6-b40a-a60cd090dac5 None admin] PATH_INFO: `/v3/projects` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:26.616420 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65351220-c2f1-43a6-b40a-a60cd090dac5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:28:26.616930 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65351220-c2f1-43a6-b40a-a60cd090dac5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:26.618554 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65351220-c2f1-43a6-b40a-a60cd090dac5 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:26.622298 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99a4242-40c3-4edb-8b85-be0b4ba56bf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:26.622978 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99a4242-40c3-4edb-8b85-be0b4ba56bf9 None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:26.624705 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99a4242-40c3-4edb-8b85-be0b4ba56bf9 None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:26.625146 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99a4242-40c3-4edb-8b85-be0b4ba56bf9 None admin] PATH_INFO: `/v3/roles` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:26.625916 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99a4242-40c3-4edb-8b85-be0b4ba56bf9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:28:26.626229 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99a4242-40c3-4edb-8b85-be0b4ba56bf9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:26.627622 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99a4242-40c3-4edb-8b85-be0b4ba56bf9 None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:26.639087 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 405/812] 10.222.0.67 () {56 vars in 1099 bytes} [Wed May 25 14:28:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:28:26.639087 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99a4242-40c3-4edb-8b85-be0b4ba56bf9 None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:26.639870 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 408/813] 10.222.0.67 () {56 vars in 1148 bytes} [Wed May 25 14:28:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:28:26.644278 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65351220-c2f1-43a6-b40a-a60cd090dac5 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:26.719187 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:26.756097 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99a4242-40c3-4edb-8b85-be0b4ba56bf9 None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:26.756419 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65351220-c2f1-43a6-b40a-a60cd090dac5 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:26.791865 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3602311-2a93-4d62-8a25-030984c2c7fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:26.792538 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3602311-2a93-4d62-8a25-030984c2c7fd None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:26.792826 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3602311-2a93-4d62-8a25-030984c2c7fd None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:26.793106 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3602311-2a93-4d62-8a25-030984c2c7fd None admin] PATH_INFO: `/v3/services` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:26.793817 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3602311-2a93-4d62-8a25-030984c2c7fd None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:28:26.794179 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3602311-2a93-4d62-8a25-030984c2c7fd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:26.794796 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f52780-f4fc-4ab3-9e92-0ba1c42f4371 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:26.796274 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f52780-f4fc-4ab3-9e92-0ba1c42f4371 None admin] REQUEST_METHOD: `PUT` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:26.796560 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f52780-f4fc-4ab3-9e92-0ba1c42f4371 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:26.796672 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3602311-2a93-4d62-8a25-030984c2c7fd None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:26.796838 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f52780-f4fc-4ab3-9e92-0ba1c42f4371 None admin] PATH_INFO: `/v3/projects/bfe93ee8d32a441295efc0b885de4bd7/users/dbe9e38881834198842a476889678096/roles/399893e19eac4ab5a8e596f7c07be13c` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:26.798884 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f52780-f4fc-4ab3-9e92-0ba1c42f4371 None admin] RBAC: Authorizing `identity:create_grant(project_id=bfe93ee8d32a441295efc0b885de4bd7, user_id=dbe9e38881834198842a476889678096, role_id=399893e19eac4ab5a8e596f7c07be13c)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:26.800340 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f52780-f4fc-4ab3-9e92-0ba1c42f4371 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:26.806530 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 406/814] 10.222.0.67 () {56 vars in 1124 bytes} [Wed May 25 14:28:26 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:28:26.806530 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3602311-2a93-4d62-8a25-030984c2c7fd None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:26.820826 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 409/815] 10.222.0.67 () {58 vars in 1439 bytes} [Wed May 25 14:28:26 2022] PUT /identity/v3/projects/bfe93ee8d32a441295efc0b885de4bd7/users/dbe9e38881834198842a476889678096/roles/399893e19eac4ab5a8e596f7c07be13c => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:28:26.822437 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d0d1e3-2328-4b5e-9917-60d04c737b58 None None] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:26.822797 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d0d1e3-2328-4b5e-9917-60d04c737b58 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:26.823175 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d0d1e3-2328-4b5e-9917-60d04c737b58 None None] PATH_INFO: `/` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:26.824711 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 410/816] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 14:28:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:28:26.828052 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d0d1e3-2328-4b5e-9917-60d04c737b58 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:26.852455 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:26.960444 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3602311-2a93-4d62-8a25-030984c2c7fd None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:26.969233 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d0d1e3-2328-4b5e-9917-60d04c737b58 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:27.004818 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfec28ca-6942-4c36-855c-cce289c4641c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:27.005741 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfec28ca-6942-4c36-855c-cce289c4641c None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:27.006104 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfec28ca-6942-4c36-855c-cce289c4641c None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:27.006457 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfec28ca-6942-4c36-855c-cce289c4641c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:27.011454 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:27.023756 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfec28ca-6942-4c36-855c-cce289c4641c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:27.025132 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6529a692-e9d8-4006-928d-f5d9b4e195bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:27.025722 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfec28ca-6942-4c36-855c-cce289c4641c None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:27.026296 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6529a692-e9d8-4006-928d-f5d9b4e195bb None admin] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:27.026768 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6529a692-e9d8-4006-928d-f5d9b4e195bb None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:27.027309 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6529a692-e9d8-4006-928d-f5d9b4e195bb None admin] PATH_INFO: `/v3/endpoints` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:27.028438 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6529a692-e9d8-4006-928d-f5d9b4e195bb None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:27.031085 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6529a692-e9d8-4006-928d-f5d9b4e195bb None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:27.046828 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application [None req-cfec28ca-6942-4c36-855c-cce289c4641c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:28:27.046828 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:28:27.046828 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:28:27.046828 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:28:27.046828 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:28:27.046828 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:28:27.046828 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:28:27.046828 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:28:27.046828 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:28:27.046828 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:28:27.046828 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:28:27.046828 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:28:27.046828 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 14:28:27.046828 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 14:28:27.046828 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 14:28:27.047856 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 14:28:27.047856 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:28:27.047856 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:28:27.047856 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:28:27.047856 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:28:27.047856 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:28:27.047856 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:28:27.047856 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:28:27.047856 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application with Lock( May 25 14:28:27.047856 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:28:27.047856 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self._enter() May 25 14:28:27.047856 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:28:27.047856 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:28:27.047856 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:28:27.047856 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.creator() May 25 14:28:27.047856 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:28:27.047856 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application created_value = creator( May 25 14:28:27.049094 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 14:28:27.049094 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 14:28:27.049094 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:28:27.049094 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application May 25 14:28:27.049094 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 407/817] 10.222.0.67 () {56 vars in 1108 bytes} [Wed May 25 14:28:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:28:27.050107 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efed6ae7-7fe2-4b88-8b75-82ec696fa863 None None] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:27.050418 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efed6ae7-7fe2-4b88-8b75-82ec696fa863 None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:27.050885 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efed6ae7-7fe2-4b88-8b75-82ec696fa863 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:27.060375 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 411/818] 10.222.0.67 () {60 vars in 1144 bytes} [Wed May 25 14:28:26 2022] POST /identity/v3/endpoints => generated 346 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:28:27.062212 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6529a692-e9d8-4006-928d-f5d9b4e195bb None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:27.073438 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.auth.core [None req-efed6ae7-7fe2-4b88-8b75-82ec696fa863 None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:28:27.075266 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-efed6ae7-7fe2-4b88-8b75-82ec696fa863 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:28:27.185166 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:27.188167 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6529a692-e9d8-4006-928d-f5d9b4e195bb None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:27.194451 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 408/819] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 14:28:27 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 14:28:27.231225 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efed6ae7-7fe2-4b88-8b75-82ec696fa863 None None] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:27.241899 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d68b07d-f572-4412-8768-c1533294f9fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:27.242592 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d68b07d-f572-4412-8768-c1533294f9fa None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:27.242877 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d68b07d-f572-4412-8768-c1533294f9fa None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:27.243186 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d68b07d-f572-4412-8768-c1533294f9fa None admin] PATH_INFO: `/v3/domains` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:27.243934 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d68b07d-f572-4412-8768-c1533294f9fa None admin] RBAC: Adding query filter params (name=Default) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:28:27.244247 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d68b07d-f572-4412-8768-c1533294f9fa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:27.245656 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d68b07d-f572-4412-8768-c1533294f9fa None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:27.272785 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 412/820] 10.222.0.67 () {56 vars in 1109 bytes} [Wed May 25 14:28:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:28:27.273974 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d68b07d-f572-4412-8768-c1533294f9fa None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:27.348318 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:27.349569 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efed6ae7-7fe2-4b88-8b75-82ec696fa863 None None] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:27.400309 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5607a130-0d15-4273-9c82-4e806448f7d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:27.401999 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5607a130-0d15-4273-9c82-4e806448f7d9 None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:27.402474 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5607a130-0d15-4273-9c82-4e806448f7d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:27.402961 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5607a130-0d15-4273-9c82-4e806448f7d9 None admin] PATH_INFO: `/v3/services/network` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:27.403840 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5607a130-0d15-4273-9c82-4e806448f7d9 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:27.406086 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5607a130-0d15-4273-9c82-4e806448f7d9 None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:27.418556 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d68b07d-f572-4412-8768-c1533294f9fa None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:27.423890 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application [None req-5607a130-0d15-4273-9c82-4e806448f7d9 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 25 14:28:27.423890 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:28:27.423890 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 14:28:27.423890 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 14:28:27.423890 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 14:28:27.423890 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 14:28:27.423890 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 14:28:27.423890 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 14:28:27.423890 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 25 14:28:27.423890 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application May 25 14:28:27.423890 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 14:28:27.423890 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application May 25 14:28:27.423890 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:28:27.423890 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:28:27.423890 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:28:27.423890 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:28:27.423890 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:28:27.425304 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:28:27.425304 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:28:27.425304 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:28:27.425304 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:28:27.425304 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:28:27.425304 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:28:27.425304 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 14:28:27.425304 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 14:28:27.425304 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 14:28:27.425304 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 14:28:27.425304 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:28:27.425304 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:28:27.425304 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:28:27.425304 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:28:27.425304 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:28:27.425304 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:28:27.426171 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:28:27.426171 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application with Lock( May 25 14:28:27.426171 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:28:27.426171 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self._enter() May 25 14:28:27.426171 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:28:27.426171 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:28:27.426171 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:28:27.426171 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.creator() May 25 14:28:27.426171 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:28:27.426171 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application created_value = creator( May 25 14:28:27.426171 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 14:28:27.426171 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 14:28:27.426171 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 25 14:28:27.426171 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application May 25 14:28:27.428469 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 409/821] 10.222.0.67 () {56 vars in 1111 bytes} [Wed May 25 14:28:27 2022] GET /identity/v3/services/network => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:28:27.434832 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5607a130-0d15-4273-9c82-4e806448f7d9 None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:27.466699 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ac51ff-3e7b-4070-9a60-d76afa5cefe7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:27.468228 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ac51ff-3e7b-4070-9a60-d76afa5cefe7 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:27.468616 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ac51ff-3e7b-4070-9a60-d76afa5cefe7 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:27.468998 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ac51ff-3e7b-4070-9a60-d76afa5cefe7 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:27.479759 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ac51ff-3e7b-4070-9a60-d76afa5cefe7 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:27.481362 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ac51ff-3e7b-4070-9a60-d76afa5cefe7 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:27.498627 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application [None req-35ac51ff-3e7b-4070-9a60-d76afa5cefe7 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 25 14:28:27.498627 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:28:27.498627 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:28:27.498627 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:28:27.498627 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:28:27.498627 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:28:27.498627 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:28:27.498627 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:28:27.498627 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:28:27.498627 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:28:27.498627 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:28:27.498627 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:28:27.498627 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 14:28:27.498627 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 14:28:27.498627 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 14:28:27.498627 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 14:28:27.499862 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:28:27.499862 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:28:27.499862 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 14:28:27.499862 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 14:28:27.499862 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 14:28:27.499862 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 14:28:27.499862 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:28:27.499862 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:28:27.499862 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:28:27.499862 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:28:27.499862 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:28:27.499862 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application with Lock( May 25 14:28:27.499862 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:28:27.499862 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._enter() May 25 14:28:27.499862 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:28:27.499862 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:28:27.499862 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:28:27.499862 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.creator() May 25 14:28:27.501040 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:28:27.501040 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application created_value = creator( May 25 14:28:27.501040 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 14:28:27.501040 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 14:28:27.501040 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 14:28:27.501040 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 14:28:27.501040 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 14:28:27.501040 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 14:28:27.501040 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 25 14:28:27.501040 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:28:27.503438 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 413/822] 10.222.0.67 () {56 vars in 1093 bytes} [Wed May 25 14:28:27 2022] GET /identity/v3/users/nova => generated 82 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:28:27.508101 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ac51ff-3e7b-4070-9a60-d76afa5cefe7 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:27.531870 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:27.605614 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5607a130-0d15-4273-9c82-4e806448f7d9 None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:27.679021 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58431bb6-d987-4870-a6e7-d505a2d85e12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:27.679021 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58431bb6-d987-4870-a6e7-d505a2d85e12 None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:27.679021 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58431bb6-d987-4870-a6e7-d505a2d85e12 None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:27.679021 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58431bb6-d987-4870-a6e7-d505a2d85e12 None admin] PATH_INFO: `/v3/services` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:27.679451 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58431bb6-d987-4870-a6e7-d505a2d85e12 None admin] RBAC: Adding query filter params (name=network) {{(pid=80474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:28:27.679451 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58431bb6-d987-4870-a6e7-d505a2d85e12 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:27.683036 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58431bb6-d987-4870-a6e7-d505a2d85e12 None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:27.693848 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 410/823] 10.222.0.67 () {56 vars in 1112 bytes} [Wed May 25 14:28:27 2022] GET /identity/v3/services?name=network => generated 124 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:28:27.697130 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:27.698286 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58431bb6-d987-4870-a6e7-d505a2d85e12 None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:27.707662 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ac51ff-3e7b-4070-9a60-d76afa5cefe7 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:27.784096 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283f771c-9c2a-4469-b988-cda58db0c54a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:27.784864 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283f771c-9c2a-4469-b988-cda58db0c54a None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:27.785056 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283f771c-9c2a-4469-b988-cda58db0c54a None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:27.785327 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283f771c-9c2a-4469-b988-cda58db0c54a None admin] PATH_INFO: `/v3/users` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:27.786176 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283f771c-9c2a-4469-b988-cda58db0c54a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:28:27.786490 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283f771c-9c2a-4469-b988-cda58db0c54a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:27.787953 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283f771c-9c2a-4469-b988-cda58db0c54a None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:27.820997 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 414/824] 10.222.0.67 () {56 vars in 1133 bytes} [Wed May 25 14:28:27 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:28:27.829591 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283f771c-9c2a-4469-b988-cda58db0c54a None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:27.887070 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58431bb6-d987-4870-a6e7-d505a2d85e12 None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:27.939527 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:27.949981 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e479010-782f-4123-9ccd-98afbe6b8ad7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:27.950962 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e479010-782f-4123-9ccd-98afbe6b8ad7 None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:27.951982 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e479010-782f-4123-9ccd-98afbe6b8ad7 None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:27.952458 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e479010-782f-4123-9ccd-98afbe6b8ad7 None admin] PATH_INFO: `/v3/services` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:27.953382 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e479010-782f-4123-9ccd-98afbe6b8ad7 None admin] RBAC: Adding query filter params (type=network) {{(pid=80474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:28:27.953916 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e479010-782f-4123-9ccd-98afbe6b8ad7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:27.955515 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e479010-782f-4123-9ccd-98afbe6b8ad7 None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:27.961555 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 411/825] 10.222.0.67 () {56 vars in 1112 bytes} [Wed May 25 14:28:27 2022] GET /identity/v3/services?type=network => generated 350 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:28:27.968395 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e479010-782f-4123-9ccd-98afbe6b8ad7 None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:28.001779 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283f771c-9c2a-4469-b988-cda58db0c54a None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:28.062570 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bd1b89-8dce-40df-9f4a-cb10096a3a2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:28.063260 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bd1b89-8dce-40df-9f4a-cb10096a3a2c None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:28.063600 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bd1b89-8dce-40df-9f4a-cb10096a3a2c None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:28.063887 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bd1b89-8dce-40df-9f4a-cb10096a3a2c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:28.078657 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e479010-782f-4123-9ccd-98afbe6b8ad7 None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:28.115418 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69677edf-4b6b-4c86-bea6-89ef38d96e10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:28.116427 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69677edf-4b6b-4c86-bea6-89ef38d96e10 None admin] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:28.116964 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69677edf-4b6b-4c86-bea6-89ef38d96e10 None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:28.117550 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69677edf-4b6b-4c86-bea6-89ef38d96e10 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:28.118509 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69677edf-4b6b-4c86-bea6-89ef38d96e10 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:28.120236 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69677edf-4b6b-4c86-bea6-89ef38d96e10 None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:28.124584 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:28.150680 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 412/826] 10.222.0.67 () {60 vars in 1144 bytes} [Wed May 25 14:28:27 2022] POST /identity/v3/endpoints => generated 327 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:28:28.208796 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bd1b89-8dce-40df-9f4a-cb10096a3a2c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:28.210650 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bd1b89-8dce-40df-9f4a-cb10096a3a2c None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:28.369365 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 415/827] 10.222.0.67 () {58 vars in 1282 bytes} [Wed May 25 14:28:27 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 540 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 25 14:28:28.375462 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69677edf-4b6b-4c86-bea6-89ef38d96e10 None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:28.376572 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63b173a-55ac-4568-be14-f0b951839029 None None] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:28.376849 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63b173a-55ac-4568-be14-f0b951839029 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:28.377131 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63b173a-55ac-4568-be14-f0b951839029 None None] PATH_INFO: `/` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:28.378744 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 416/828] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 14:28:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:28:28.383546 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ec36c2-c01a-4d87-81bf-6b7e7ef5adcd None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:28.383837 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ec36c2-c01a-4d87-81bf-6b7e7ef5adcd None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:28.384117 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ec36c2-c01a-4d87-81bf-6b7e7ef5adcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:28.401353 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-52ec36c2-c01a-4d87-81bf-6b7e7ef5adcd None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:28:28.402475 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-52ec36c2-c01a-4d87-81bf-6b7e7ef5adcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:28:28.441698 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:28.463260 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:28.487060 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 417/829] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 14:28:28 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 25 14:28:28.504383 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69677edf-4b6b-4c86-bea6-89ef38d96e10 None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:28.514754 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ec36c2-c01a-4d87-81bf-6b7e7ef5adcd None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:28.541951 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a11c354-1027-4b92-97c2-55e472d12bf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:28.543050 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a11c354-1027-4b92-97c2-55e472d12bf3 None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:28.543475 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a11c354-1027-4b92-97c2-55e472d12bf3 None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:28.543891 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a11c354-1027-4b92-97c2-55e472d12bf3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:28.557425 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a11c354-1027-4b92-97c2-55e472d12bf3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:28.559386 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a11c354-1027-4b92-97c2-55e472d12bf3 None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:28.582863 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application [None req-3a11c354-1027-4b92-97c2-55e472d12bf3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:28:28.582863 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:28:28.582863 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:28:28.582863 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:28:28.582863 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:28:28.582863 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:28:28.582863 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:28:28.582863 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:28:28.582863 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:28:28.582863 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:28:28.582863 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:28:28.582863 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:28:28.582863 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 14:28:28.582863 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 14:28:28.582863 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 14:28:28.583850 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 14:28:28.583850 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:28:28.583850 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:28:28.583850 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:28:28.583850 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:28:28.583850 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:28:28.583850 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:28:28.583850 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:28:28.583850 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application with Lock( May 25 14:28:28.583850 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:28:28.583850 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self._enter() May 25 14:28:28.583850 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:28:28.583850 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:28:28.583850 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:28:28.583850 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.creator() May 25 14:28:28.583850 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:28:28.583850 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application created_value = creator( May 25 14:28:28.584759 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 14:28:28.584759 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 14:28:28.584759 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:28:28.584759 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application May 25 14:28:28.587112 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 413/830] 10.222.0.67 () {56 vars in 1108 bytes} [Wed May 25 14:28:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:28:28.592134 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a11c354-1027-4b92-97c2-55e472d12bf3 None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:28.634957 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ec36c2-c01a-4d87-81bf-6b7e7ef5adcd None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:28.676052 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f54313-1e28-48ec-8cb6-b57286d3b513 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:28.676893 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f54313-1e28-48ec-8cb6-b57286d3b513 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:28.677250 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f54313-1e28-48ec-8cb6-b57286d3b513 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:28.677601 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f54313-1e28-48ec-8cb6-b57286d3b513 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:28.694627 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f54313-1e28-48ec-8cb6-b57286d3b513 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:28:28.705174 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application [None req-c6f54313-1e28-48ec-8cb6-b57286d3b513 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 25 14:28:28.705174 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:28:28.705174 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:28:28.705174 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:28:28.705174 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:28:28.705174 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:28:28.705174 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:28:28.705174 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:28:28.705174 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:28:28.705174 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:28:28.705174 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:28:28.705174 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:28:28.705174 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:28:28.705174 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:28:28.705174 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:28:28.705174 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:28:28.706154 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:28:28.706154 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:28:28.706154 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:28:28.706154 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:28:28.706154 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:28:28.706154 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:28:28.706154 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:28:28.706154 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:28:28.706154 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:28:28.706154 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:28:28.706154 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:28:28.706154 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application with Lock( May 25 14:28:28.706154 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:28:28.706154 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._enter() May 25 14:28:28.706154 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:28:28.706154 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:28:28.707256 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:28:28.707256 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.creator() May 25 14:28:28.707256 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:28:28.707256 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application created_value = creator( May 25 14:28:28.707256 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:28:28.707256 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:28:28.707256 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:28:28.707256 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:28:28.707256 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:28:28.707256 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:28:28.707256 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 25 14:28:28.707256 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:28:28.707256 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 418/831] 10.222.0.67 () {56 vars in 1102 bytes} [Wed May 25 14:28:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 14:28:28.712091 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f54313-1e28-48ec-8cb6-b57286d3b513 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:28.722048 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:28.726217 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a11c354-1027-4b92-97c2-55e472d12bf3 None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:28.768555 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8d6a5a-9b20-448f-bf7c-103f90e19ad3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:28.769406 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8d6a5a-9b20-448f-bf7c-103f90e19ad3 None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:28.769798 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8d6a5a-9b20-448f-bf7c-103f90e19ad3 None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:28.770181 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8d6a5a-9b20-448f-bf7c-103f90e19ad3 None admin] PATH_INFO: `/v3/domains` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:28.771204 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8d6a5a-9b20-448f-bf7c-103f90e19ad3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:28:28.771976 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8d6a5a-9b20-448f-bf7c-103f90e19ad3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:28.773183 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8d6a5a-9b20-448f-bf7c-103f90e19ad3 None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:28.777282 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:28.788175 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 414/832] 10.222.0.67 () {56 vars in 1109 bytes} [Wed May 25 14:28:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:28:28.795481 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8d6a5a-9b20-448f-bf7c-103f90e19ad3 None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:28.845061 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f54313-1e28-48ec-8cb6-b57286d3b513 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:28.881997 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9c2d4f-3260-4cee-b2cd-4a9549d4854f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:28.882852 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9c2d4f-3260-4cee-b2cd-4a9549d4854f None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:28.883263 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9c2d4f-3260-4cee-b2cd-4a9549d4854f None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:28.883649 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9c2d4f-3260-4cee-b2cd-4a9549d4854f None admin] PATH_INFO: `/v3/roles` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:28.884618 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9c2d4f-3260-4cee-b2cd-4a9549d4854f None admin] RBAC: Adding query filter params (name=service) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:28:28.885032 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9c2d4f-3260-4cee-b2cd-4a9549d4854f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:28.886632 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9c2d4f-3260-4cee-b2cd-4a9549d4854f None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:28.901468 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 419/833] 10.222.0.67 () {56 vars in 1103 bytes} [Wed May 25 14:28:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:28:28.903526 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9c2d4f-3260-4cee-b2cd-4a9549d4854f None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:28.916497 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8d6a5a-9b20-448f-bf7c-103f90e19ad3 None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:28.953627 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd7f386-c2f2-4fe5-9a6e-e5f00ab797d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:28.954350 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd7f386-c2f2-4fe5-9a6e-e5f00ab797d2 None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:28.954637 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd7f386-c2f2-4fe5-9a6e-e5f00ab797d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:28.954919 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd7f386-c2f2-4fe5-9a6e-e5f00ab797d2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:28.962251 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd7f386-c2f2-4fe5-9a6e-e5f00ab797d2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:28.963758 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd7f386-c2f2-4fe5-9a6e-e5f00ab797d2 None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:28.979208 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application [None req-acd7f386-c2f2-4fe5-9a6e-e5f00ab797d2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 14:28:28.979208 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:28:28.979208 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:28:28.979208 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:28:28.979208 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:28:28.979208 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:28:28.979208 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:28:28.979208 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:28:28.979208 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:28:28.979208 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:28:28.979208 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:28:28.979208 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:28:28.979208 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 14:28:28.979208 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 14:28:28.979208 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 14:28:28.980202 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 14:28:28.980202 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:28:28.980202 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:28:28.980202 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:28:28.980202 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:28:28.980202 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:28:28.980202 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:28:28.980202 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:28:28.980202 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application with Lock( May 25 14:28:28.980202 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:28:28.980202 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self._enter() May 25 14:28:28.980202 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:28:28.980202 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:28:28.980202 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:28:28.980202 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.creator() May 25 14:28:28.980202 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:28:28.980202 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application created_value = creator( May 25 14:28:28.981166 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 14:28:28.981166 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 14:28:28.981166 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 14:28:28.981166 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 14:28:28.981166 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 14:28:28.981166 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 14:28:28.981166 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 14:28:28.981166 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application May 25 14:28:28.981166 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 415/834] 10.222.0.67 () {56 vars in 1111 bytes} [Wed May 25 14:28:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:28:28.986273 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd7f386-c2f2-4fe5-9a6e-e5f00ab797d2 None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:29.019506 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:29.043527 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9c2d4f-3260-4cee-b2cd-4a9549d4854f None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:29.051338 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:29.081072 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9deb9bfc-ff56-423c-9b97-c0d54dfa36a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:29.081895 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9deb9bfc-ff56-423c-9b97-c0d54dfa36a4 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:29.082186 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9deb9bfc-ff56-423c-9b97-c0d54dfa36a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:29.082469 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9deb9bfc-ff56-423c-9b97-c0d54dfa36a4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:29.094158 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9deb9bfc-ff56-423c-9b97-c0d54dfa36a4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:29.095663 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9deb9bfc-ff56-423c-9b97-c0d54dfa36a4 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:29.113735 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application [None req-9deb9bfc-ff56-423c-9b97-c0d54dfa36a4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:28:29.113735 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:28:29.113735 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:28:29.113735 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:28:29.113735 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:28:29.113735 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:28:29.113735 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:28:29.113735 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:28:29.113735 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:28:29.113735 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:28:29.113735 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:28:29.113735 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:28:29.113735 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 14:28:29.113735 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 14:28:29.113735 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 14:28:29.114729 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 14:28:29.114729 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:28:29.114729 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:28:29.114729 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:28:29.114729 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:28:29.114729 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:28:29.114729 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:28:29.114729 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:28:29.114729 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application with Lock( May 25 14:28:29.114729 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:28:29.114729 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._enter() May 25 14:28:29.114729 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:28:29.114729 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:28:29.114729 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:28:29.114729 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.creator() May 25 14:28:29.114729 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:28:29.114729 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application created_value = creator( May 25 14:28:29.115716 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 14:28:29.115716 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 14:28:29.115716 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:28:29.115716 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:28:29.119812 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 420/835] 10.222.0.67 () {56 vars in 1108 bytes} [Wed May 25 14:28:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:28:29.121133 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9deb9bfc-ff56-423c-9b97-c0d54dfa36a4 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:29.140315 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd7f386-c2f2-4fe5-9a6e-e5f00ab797d2 None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:29.192893 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2015428d-11d6-453e-9142-96906eddc9c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:29.194202 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2015428d-11d6-453e-9142-96906eddc9c6 None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:29.194963 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2015428d-11d6-453e-9142-96906eddc9c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:29.195490 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2015428d-11d6-453e-9142-96906eddc9c6 None admin] PATH_INFO: `/v3/projects` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:29.197402 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2015428d-11d6-453e-9142-96906eddc9c6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:28:29.197950 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2015428d-11d6-453e-9142-96906eddc9c6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:29.199634 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2015428d-11d6-453e-9142-96906eddc9c6 None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:29.217954 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 416/836] 10.222.0.67 () {56 vars in 1148 bytes} [Wed May 25 14:28:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:28:29.224205 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2015428d-11d6-453e-9142-96906eddc9c6 None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:29.232793 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9deb9bfc-ff56-423c-9b97-c0d54dfa36a4 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:29.274701 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72737118-5cf7-48b0-b0c0-908ef907b49f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:29.275407 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72737118-5cf7-48b0-b0c0-908ef907b49f None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:29.279018 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72737118-5cf7-48b0-b0c0-908ef907b49f None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:29.279018 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72737118-5cf7-48b0-b0c0-908ef907b49f None admin] PATH_INFO: `/v3/domains` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:29.279018 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72737118-5cf7-48b0-b0c0-908ef907b49f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:28:29.279018 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72737118-5cf7-48b0-b0c0-908ef907b49f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:29.279018 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72737118-5cf7-48b0-b0c0-908ef907b49f None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:29.293307 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 421/837] 10.222.0.67 () {56 vars in 1109 bytes} [Wed May 25 14:28:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:28:29.299386 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72737118-5cf7-48b0-b0c0-908ef907b49f None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:29.324523 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:29.325086 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:29.351536 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2015428d-11d6-453e-9142-96906eddc9c6 None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:29.398428 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac0e36a-de2f-4e27-9eea-0c148074a002 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:29.399526 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac0e36a-de2f-4e27-9eea-0c148074a002 None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:29.399915 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac0e36a-de2f-4e27-9eea-0c148074a002 None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:29.400297 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac0e36a-de2f-4e27-9eea-0c148074a002 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:29.401399 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac0e36a-de2f-4e27-9eea-0c148074a002 None admin] RBAC: Adding query filter params (role.id=399893e19eac4ab5a8e596f7c07be13c, scope.project.id=bfe93ee8d32a441295efc0b885de4bd7, user.id=428ec99478284743943ed41e9d24a603) {{(pid=80474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:28:29.401806 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac0e36a-de2f-4e27-9eea-0c148074a002 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:29.403667 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac0e36a-de2f-4e27-9eea-0c148074a002 None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:29.415193 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 417/838] 10.222.0.67 () {56 vars in 1374 bytes} [Wed May 25 14:28:29 2022] GET /identity/v3/role_assignments?user.id=428ec99478284743943ed41e9d24a603&scope.project.id=bfe93ee8d32a441295efc0b885de4bd7&role.id=399893e19eac4ab5a8e596f7c07be13c => generated 608 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:28:29.429343 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72737118-5cf7-48b0-b0c0-908ef907b49f None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:29.464390 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a663ea7-02d7-4ae6-9a8c-8aff3599aa05 None None] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:29.465259 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a663ea7-02d7-4ae6-9a8c-8aff3599aa05 None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:29.465677 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a663ea7-02d7-4ae6-9a8c-8aff3599aa05 None None] PATH_INFO: `/` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:29.468544 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 418/839] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 14:28:29 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 14:28:29.475070 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5b8a87-7546-4e3a-8918-b3fc76dd7e33 None None] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:29.475510 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5b8a87-7546-4e3a-8918-b3fc76dd7e33 None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:29.475736 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bca6dc-1d73-48e3-a61b-3fdbf4f54e0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:29.475980 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5b8a87-7546-4e3a-8918-b3fc76dd7e33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:29.476890 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bca6dc-1d73-48e3-a61b-3fdbf4f54e0d None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:29.477399 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bca6dc-1d73-48e3-a61b-3fdbf4f54e0d None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:29.477835 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bca6dc-1d73-48e3-a61b-3fdbf4f54e0d None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:29.487879 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bca6dc-1d73-48e3-a61b-3fdbf4f54e0d None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:29.489626 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bca6dc-1d73-48e3-a61b-3fdbf4f54e0d None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:29.496028 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.auth.core [None req-4c5b8a87-7546-4e3a-8918-b3fc76dd7e33 None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:28:29.497645 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-4c5b8a87-7546-4e3a-8918-b3fc76dd7e33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:28:29.508065 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application [None req-48bca6dc-1d73-48e3-a61b-3fdbf4f54e0d None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 25 14:28:29.508065 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:28:29.508065 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:28:29.508065 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:28:29.508065 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:28:29.508065 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:28:29.508065 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:28:29.508065 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:28:29.508065 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:28:29.508065 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:28:29.508065 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:28:29.508065 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:28:29.508065 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 14:28:29.508065 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 14:28:29.508065 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 14:28:29.508065 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 14:28:29.509262 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:28:29.509262 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:28:29.509262 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 14:28:29.509262 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 14:28:29.509262 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 14:28:29.509262 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 14:28:29.509262 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:28:29.509262 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:28:29.509262 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:28:29.509262 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:28:29.509262 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:28:29.509262 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application with Lock( May 25 14:28:29.509262 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:28:29.509262 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._enter() May 25 14:28:29.509262 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:28:29.509262 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:28:29.509262 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:28:29.509262 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.creator() May 25 14:28:29.510425 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:28:29.510425 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application created_value = creator( May 25 14:28:29.510425 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 14:28:29.510425 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 14:28:29.510425 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 14:28:29.510425 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 14:28:29.510425 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 14:28:29.510425 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 14:28:29.510425 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 25 14:28:29.510425 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:28:29.512891 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 422/840] 10.222.0.67 () {56 vars in 1117 bytes} [Wed May 25 14:28:29 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:28:29.520014 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bca6dc-1d73-48e3-a61b-3fdbf4f54e0d None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:29.583156 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 419/841] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 14:28:29 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 25 14:28:29.602126 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5b8a87-7546-4e3a-8918-b3fc76dd7e33 None None] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:29.614133 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:29.641700 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bca6dc-1d73-48e3-a61b-3fdbf4f54e0d None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:29.682310 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7dd1e5-95d1-4c14-904e-50fe0059a814 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:29.683308 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7dd1e5-95d1-4c14-904e-50fe0059a814 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:29.683767 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7dd1e5-95d1-4c14-904e-50fe0059a814 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:29.684215 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7dd1e5-95d1-4c14-904e-50fe0059a814 None admin] PATH_INFO: `/v3/users` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:29.685049 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7dd1e5-95d1-4c14-904e-50fe0059a814 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:28:29.685357 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7dd1e5-95d1-4c14-904e-50fe0059a814 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:29.687371 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7dd1e5-95d1-4c14-904e-50fe0059a814 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:29.700847 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:29.709090 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 423/842] 10.222.0.67 () {56 vars in 1149 bytes} [Wed May 25 14:28:29 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:28:29.714555 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7dd1e5-95d1-4c14-904e-50fe0059a814 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:29.741930 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5b8a87-7546-4e3a-8918-b3fc76dd7e33 None None] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:29.788265 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b902d7ce-cfe7-4182-87f5-416a9e414766 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:29.789405 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b902d7ce-cfe7-4182-87f5-416a9e414766 None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:29.790125 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b902d7ce-cfe7-4182-87f5-416a9e414766 None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:29.790529 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b902d7ce-cfe7-4182-87f5-416a9e414766 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:29.804481 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b902d7ce-cfe7-4182-87f5-416a9e414766 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:28:29.815701 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application [None req-b902d7ce-cfe7-4182-87f5-416a9e414766 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 14:28:29.815701 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:28:29.815701 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:28:29.815701 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:28:29.815701 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:28:29.815701 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:28:29.815701 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:28:29.815701 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:28:29.815701 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:28:29.815701 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:28:29.815701 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:28:29.815701 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:28:29.815701 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:28:29.815701 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:28:29.815701 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:28:29.815701 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:28:29.816865 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:28:29.816865 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:28:29.816865 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:28:29.816865 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:28:29.816865 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:28:29.816865 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:28:29.816865 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:28:29.816865 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:28:29.816865 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:28:29.816865 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:28:29.816865 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:28:29.816865 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application with Lock( May 25 14:28:29.816865 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:28:29.816865 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self._enter() May 25 14:28:29.816865 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:28:29.816865 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:28:29.817937 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:28:29.817937 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.creator() May 25 14:28:29.817937 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:28:29.817937 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application created_value = creator( May 25 14:28:29.817937 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:28:29.817937 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:28:29.817937 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:28:29.817937 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:28:29.817937 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:28:29.817937 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:28:29.817937 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 14:28:29.817937 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application May 25 14:28:29.820273 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 420/843] 10.222.0.67 () {56 vars in 1096 bytes} [Wed May 25 14:28:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 14:28:29.827209 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b902d7ce-cfe7-4182-87f5-416a9e414766 None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:29.848310 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7dd1e5-95d1-4c14-904e-50fe0059a814 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:29.890295 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba891d59-977b-4537-9e42-ce788ed14ab8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:29.891142 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba891d59-977b-4537-9e42-ce788ed14ab8 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:29.891531 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba891d59-977b-4537-9e42-ce788ed14ab8 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:29.892034 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba891d59-977b-4537-9e42-ce788ed14ab8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:29.895820 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:29.949382 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b902d7ce-cfe7-4182-87f5-416a9e414766 None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:29.969757 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba891d59-977b-4537-9e42-ce788ed14ab8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:29.971247 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba891d59-977b-4537-9e42-ce788ed14ab8 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:29.987997 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2009307-53d9-47fd-a3a7-cf6ce96db790 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:29.988799 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2009307-53d9-47fd-a3a7-cf6ce96db790 None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:29.989154 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2009307-53d9-47fd-a3a7-cf6ce96db790 None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:29.989498 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2009307-53d9-47fd-a3a7-cf6ce96db790 None admin] PATH_INFO: `/v3/roles` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:29.990348 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2009307-53d9-47fd-a3a7-cf6ce96db790 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:28:29.990659 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2009307-53d9-47fd-a3a7-cf6ce96db790 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:29.992142 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2009307-53d9-47fd-a3a7-cf6ce96db790 None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:29.993624 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:30.007651 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 421/844] 10.222.0.67 () {56 vars in 1099 bytes} [Wed May 25 14:28:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:28:30.009034 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ded6362-9f6f-410e-8a42-f19588b3cc99 None None] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:30.009327 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ded6362-9f6f-410e-8a42-f19588b3cc99 None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:30.009613 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ded6362-9f6f-410e-8a42-f19588b3cc99 None None] PATH_INFO: `/` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:30.011022 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 422/845] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 14:28:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:28:30.011595 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ded6362-9f6f-410e-8a42-f19588b3cc99 None None] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:30.090334 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 424/846] 10.222.0.67 () {58 vars in 1282 bytes} [Wed May 25 14:28:29 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 25 14:28:30.092504 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb84575-4b06-416d-8f4c-68fc026852e8 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:30.093003 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb84575-4b06-416d-8f4c-68fc026852e8 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:30.093447 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb84575-4b06-416d-8f4c-68fc026852e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:30.112213 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-feb84575-4b06-416d-8f4c-68fc026852e8 None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:28:30.113451 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-feb84575-4b06-416d-8f4c-68fc026852e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:28:30.125769 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ded6362-9f6f-410e-8a42-f19588b3cc99 None None] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:30.149629 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:30.165440 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b367d0e7-a318-4017-bb8c-ed512c3ea404 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:30.166247 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b367d0e7-a318-4017-bb8c-ed512c3ea404 None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:30.166530 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b367d0e7-a318-4017-bb8c-ed512c3ea404 None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:30.166806 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b367d0e7-a318-4017-bb8c-ed512c3ea404 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:30.178051 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b367d0e7-a318-4017-bb8c-ed512c3ea404 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:30.179779 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b367d0e7-a318-4017-bb8c-ed512c3ea404 None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:30.190747 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 425/847] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 14:28:30 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 14:28:30.199883 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb84575-4b06-416d-8f4c-68fc026852e8 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:30.200025 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application [None req-b367d0e7-a318-4017-bb8c-ed512c3ea404 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:28:30.200025 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:28:30.200025 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:28:30.200025 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:28:30.200025 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:28:30.200025 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:28:30.200025 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:28:30.200025 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:28:30.200025 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:28:30.200025 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:28:30.200025 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:28:30.200025 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:28:30.200025 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 14:28:30.200025 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 14:28:30.200025 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 14:28:30.200924 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 14:28:30.200924 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:28:30.200924 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:28:30.200924 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:28:30.200924 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:28:30.200924 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:28:30.200924 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:28:30.200924 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:28:30.200924 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application with Lock( May 25 14:28:30.200924 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:28:30.200924 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self._enter() May 25 14:28:30.200924 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:28:30.200924 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:28:30.200924 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:28:30.200924 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.creator() May 25 14:28:30.200924 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:28:30.200924 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application created_value = creator( May 25 14:28:30.203513 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 14:28:30.203513 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 14:28:30.203513 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:28:30.203513 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application May 25 14:28:30.206407 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 423/848] 10.222.0.67 () {56 vars in 1108 bytes} [Wed May 25 14:28:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:28:30.207485 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b367d0e7-a318-4017-bb8c-ed512c3ea404 None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:30.263176 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:30.313774 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb84575-4b06-416d-8f4c-68fc026852e8 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:30.320644 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b367d0e7-a318-4017-bb8c-ed512c3ea404 None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:30.348994 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d55e1a-7ba9-448b-a0a4-5368917f36f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:30.349790 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d55e1a-7ba9-448b-a0a4-5368917f36f8 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:30.350078 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d55e1a-7ba9-448b-a0a4-5368917f36f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:30.350359 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d55e1a-7ba9-448b-a0a4-5368917f36f8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:30.357161 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d82442f-2f1d-4022-b548-51d19d97c0fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:30.358488 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d82442f-2f1d-4022-b548-51d19d97c0fe None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:30.358795 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d82442f-2f1d-4022-b548-51d19d97c0fe None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:30.359097 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d82442f-2f1d-4022-b548-51d19d97c0fe None admin] PATH_INFO: `/v3/domains` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:30.359836 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d82442f-2f1d-4022-b548-51d19d97c0fe None admin] RBAC: Adding query filter params (name=Default) {{(pid=80474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:28:30.360151 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d82442f-2f1d-4022-b548-51d19d97c0fe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:30.361418 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d55e1a-7ba9-448b-a0a4-5368917f36f8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:30.361537 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d82442f-2f1d-4022-b548-51d19d97c0fe None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:30.362859 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d55e1a-7ba9-448b-a0a4-5368917f36f8 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:30.374400 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 424/849] 10.222.0.67 () {56 vars in 1109 bytes} [Wed May 25 14:28:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:28:30.375477 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d82442f-2f1d-4022-b548-51d19d97c0fe None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:30.381510 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application [None req-48d55e1a-7ba9-448b-a0a4-5368917f36f8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:28:30.381510 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:28:30.381510 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:28:30.381510 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:28:30.381510 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:28:30.381510 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:28:30.381510 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:28:30.381510 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:28:30.381510 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:28:30.381510 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:28:30.381510 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:28:30.381510 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:28:30.381510 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 14:28:30.381510 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 14:28:30.381510 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 14:28:30.382429 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 14:28:30.382429 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:28:30.382429 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:28:30.382429 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:28:30.382429 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:28:30.382429 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:28:30.382429 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:28:30.382429 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:28:30.382429 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application with Lock( May 25 14:28:30.382429 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:28:30.382429 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._enter() May 25 14:28:30.382429 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:28:30.382429 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:28:30.382429 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:28:30.382429 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.creator() May 25 14:28:30.382429 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:28:30.382429 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application created_value = creator( May 25 14:28:30.383367 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 14:28:30.383367 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 14:28:30.383367 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:28:30.383367 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:28:30.383367 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 426/850] 10.222.0.67 () {56 vars in 1108 bytes} [Wed May 25 14:28:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:28:30.383675 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d55e1a-7ba9-448b-a0a4-5368917f36f8 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:30.403370 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:30.489819 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d55e1a-7ba9-448b-a0a4-5368917f36f8 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:30.491870 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d82442f-2f1d-4022-b548-51d19d97c0fe None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:30.501956 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:30.526848 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928a7c2b-b7f6-42e0-866b-974f8a129d8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:30.527705 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928a7c2b-b7f6-42e0-866b-974f8a129d8c None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:30.527969 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928a7c2b-b7f6-42e0-866b-974f8a129d8c None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:30.528248 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928a7c2b-b7f6-42e0-866b-974f8a129d8c None admin] PATH_INFO: `/v3/users/swift` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:30.530285 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c8b735-f7ae-4836-92d9-ac67d8faead5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:30.531598 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c8b735-f7ae-4836-92d9-ac67d8faead5 None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:30.531888 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c8b735-f7ae-4836-92d9-ac67d8faead5 None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:30.532167 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c8b735-f7ae-4836-92d9-ac67d8faead5 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:30.532825 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c8b735-f7ae-4836-92d9-ac67d8faead5 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:30.534186 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c8b735-f7ae-4836-92d9-ac67d8faead5 None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:30.535589 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928a7c2b-b7f6-42e0-866b-974f8a129d8c None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:30.537113 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928a7c2b-b7f6-42e0-866b-974f8a129d8c None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:30.547017 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application [None req-a0c8b735-f7ae-4836-92d9-ac67d8faead5 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 25 14:28:30.547017 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:28:30.547017 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 14:28:30.547017 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 14:28:30.547017 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 14:28:30.547017 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 14:28:30.547017 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 14:28:30.547017 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 14:28:30.547017 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 25 14:28:30.547017 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application May 25 14:28:30.547017 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 14:28:30.547017 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application May 25 14:28:30.547017 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:28:30.547017 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:28:30.547017 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:28:30.547017 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:28:30.547017 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:28:30.548144 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:28:30.548144 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:28:30.548144 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:28:30.548144 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:28:30.548144 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:28:30.548144 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:28:30.548144 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 14:28:30.548144 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 14:28:30.548144 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 14:28:30.548144 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 14:28:30.548144 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:28:30.548144 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:28:30.548144 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:28:30.548144 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:28:30.548144 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:28:30.548144 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:28:30.554668 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:28:30.554668 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application with Lock( May 25 14:28:30.554668 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:28:30.554668 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self._enter() May 25 14:28:30.554668 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:28:30.554668 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:28:30.554668 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:28:30.554668 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.creator() May 25 14:28:30.554668 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:28:30.554668 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application created_value = creator( May 25 14:28:30.554668 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 14:28:30.554668 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 14:28:30.554668 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 25 14:28:30.554668 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application May 25 14:28:30.554668 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 425/851] 10.222.0.67 () {56 vars in 1114 bytes} [Wed May 25 14:28:30 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:28:30.555982 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c8b735-f7ae-4836-92d9-ac67d8faead5 None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:30.556060 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application [None req-928a7c2b-b7f6-42e0-866b-974f8a129d8c None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 25 14:28:30.556060 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:28:30.556060 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:28:30.556060 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:28:30.556060 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:28:30.556060 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:28:30.556060 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:28:30.556060 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:28:30.556060 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:28:30.556060 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:28:30.556060 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:28:30.556060 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:28:30.556060 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 14:28:30.556060 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 14:28:30.556060 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 14:28:30.556060 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 14:28:30.556942 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:28:30.556942 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:28:30.556942 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 14:28:30.556942 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 14:28:30.556942 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 14:28:30.556942 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 14:28:30.556942 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:28:30.556942 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:28:30.556942 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:28:30.556942 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:28:30.556942 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:28:30.556942 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application with Lock( May 25 14:28:30.556942 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:28:30.556942 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._enter() May 25 14:28:30.556942 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:28:30.556942 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:28:30.556942 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:28:30.556942 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.creator() May 25 14:28:30.561681 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:28:30.561681 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application created_value = creator( May 25 14:28:30.561681 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 14:28:30.561681 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 14:28:30.561681 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 14:28:30.561681 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 14:28:30.561681 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 14:28:30.561681 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 14:28:30.561681 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 25 14:28:30.561681 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:28:30.561681 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 427/852] 10.222.0.67 () {56 vars in 1096 bytes} [Wed May 25 14:28:30 2022] GET /identity/v3/users/swift => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:28:30.561681 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928a7c2b-b7f6-42e0-866b-974f8a129d8c None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:30.647914 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:30.666064 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c8b735-f7ae-4836-92d9-ac67d8faead5 None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:30.674431 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928a7c2b-b7f6-42e0-866b-974f8a129d8c None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:30.708536 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f146ac4-58c6-481c-ac72-05fa4ce46d3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:30.709206 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f146ac4-58c6-481c-ac72-05fa4ce46d3a None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:30.709489 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f146ac4-58c6-481c-ac72-05fa4ce46d3a None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:30.709764 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f146ac4-58c6-481c-ac72-05fa4ce46d3a None admin] PATH_INFO: `/v3/domains` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:30.710492 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f146ac4-58c6-481c-ac72-05fa4ce46d3a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:28:30.710799 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f146ac4-58c6-481c-ac72-05fa4ce46d3a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:30.712206 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f146ac4-58c6-481c-ac72-05fa4ce46d3a None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:30.716693 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1640d8-e417-44b1-a73b-bf9aa2cf1d8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:30.717393 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1640d8-e417-44b1-a73b-bf9aa2cf1d8f None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:30.717682 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1640d8-e417-44b1-a73b-bf9aa2cf1d8f None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:30.717961 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1640d8-e417-44b1-a73b-bf9aa2cf1d8f None admin] PATH_INFO: `/v3/services` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:30.718673 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1640d8-e417-44b1-a73b-bf9aa2cf1d8f None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:28:30.718983 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1640d8-e417-44b1-a73b-bf9aa2cf1d8f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:30.720398 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1640d8-e417-44b1-a73b-bf9aa2cf1d8f None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:30.731230 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 426/853] 10.222.0.67 () {56 vars in 1109 bytes} [Wed May 25 14:28:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:28:30.731230 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f146ac4-58c6-481c-ac72-05fa4ce46d3a None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:30.731491 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 428/854] 10.222.0.67 () {56 vars in 1114 bytes} [Wed May 25 14:28:30 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:28:30.731491 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1640d8-e417-44b1-a73b-bf9aa2cf1d8f None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:30.768884 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:30.846922 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f146ac4-58c6-481c-ac72-05fa4ce46d3a None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:30.852674 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1640d8-e417-44b1-a73b-bf9aa2cf1d8f None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:30.891781 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f461997d-e11f-4292-a3d1-f67ae6188f5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:30.892320 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea7bba3-09d2-4315-b39a-d60c9be3904f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:30.892480 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f461997d-e11f-4292-a3d1-f67ae6188f5b None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:30.892716 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f461997d-e11f-4292-a3d1-f67ae6188f5b None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:30.892990 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f461997d-e11f-4292-a3d1-f67ae6188f5b None admin] PATH_INFO: `/v3/services` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:30.893596 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea7bba3-09d2-4315-b39a-d60c9be3904f None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:30.893717 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f461997d-e11f-4292-a3d1-f67ae6188f5b None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:28:30.893989 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f461997d-e11f-4292-a3d1-f67ae6188f5b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:30.894290 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea7bba3-09d2-4315-b39a-d60c9be3904f None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:30.894717 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea7bba3-09d2-4315-b39a-d60c9be3904f None admin] PATH_INFO: `/v3/users` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:30.895397 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f461997d-e11f-4292-a3d1-f67ae6188f5b None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:30.895905 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea7bba3-09d2-4315-b39a-d60c9be3904f None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:28:30.896374 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea7bba3-09d2-4315-b39a-d60c9be3904f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:30.898225 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea7bba3-09d2-4315-b39a-d60c9be3904f None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:30.900338 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 429/855] 10.222.0.67 () {56 vars in 1114 bytes} [Wed May 25 14:28:30 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:28:30.901863 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f461997d-e11f-4292-a3d1-f67ae6188f5b None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:30.919356 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 427/856] 10.222.0.67 () {56 vars in 1135 bytes} [Wed May 25 14:28:30 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:28:30.925303 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:30.926189 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea7bba3-09d2-4315-b39a-d60c9be3904f None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:31.034160 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f461997d-e11f-4292-a3d1-f67ae6188f5b None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:31.035864 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:31.047398 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea7bba3-09d2-4315-b39a-d60c9be3904f None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:31.072744 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c7b8c6-67c7-4832-acd6-9bf8a4ea4447 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:31.073562 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c7b8c6-67c7-4832-acd6-9bf8a4ea4447 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:31.073900 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c7b8c6-67c7-4832-acd6-9bf8a4ea4447 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:31.074183 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c7b8c6-67c7-4832-acd6-9bf8a4ea4447 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:31.083439 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c7b8c6-67c7-4832-acd6-9bf8a4ea4447 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:31.084874 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c7b8c6-67c7-4832-acd6-9bf8a4ea4447 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:31.088032 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f771d1-7f2c-4ad4-b920-96899934910f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:31.088928 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f771d1-7f2c-4ad4-b920-96899934910f None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:31.089369 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f771d1-7f2c-4ad4-b920-96899934910f None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:31.089784 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f771d1-7f2c-4ad4-b920-96899934910f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:31.102641 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application [None req-c6c7b8c6-67c7-4832-acd6-9bf8a4ea4447 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 14:28:31.102641 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:28:31.102641 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:28:31.102641 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:28:31.102641 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:28:31.102641 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:28:31.102641 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:28:31.102641 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:28:31.102641 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:28:31.102641 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:28:31.102641 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:28:31.102641 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:28:31.102641 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 14:28:31.102641 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 14:28:31.102641 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 14:28:31.103853 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 14:28:31.103853 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:28:31.103853 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:28:31.103853 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:28:31.103853 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:28:31.103853 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:28:31.103853 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:28:31.103853 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:28:31.103853 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application with Lock( May 25 14:28:31.103853 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:28:31.103853 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._enter() May 25 14:28:31.103853 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:28:31.103853 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:28:31.103853 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:28:31.103853 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.creator() May 25 14:28:31.103853 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:28:31.103853 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application created_value = creator( May 25 14:28:31.104953 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 14:28:31.104953 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 14:28:31.104953 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 14:28:31.104953 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 14:28:31.104953 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 14:28:31.104953 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 14:28:31.104953 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 14:28:31.104953 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:28:31.104953 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 430/857] 10.222.0.67 () {56 vars in 1111 bytes} [Wed May 25 14:28:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:28:31.110161 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c7b8c6-67c7-4832-acd6-9bf8a4ea4447 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:31.188951 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f771d1-7f2c-4ad4-b920-96899934910f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:31.190864 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f771d1-7f2c-4ad4-b920-96899934910f None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:31.206795 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:31.251507 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c7b8c6-67c7-4832-acd6-9bf8a4ea4447 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:31.294359 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f416d78-6172-456d-9bf4-a573d57af1c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:31.295945 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f416d78-6172-456d-9bf4-a573d57af1c4 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:31.296231 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f416d78-6172-456d-9bf4-a573d57af1c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:31.296511 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f416d78-6172-456d-9bf4-a573d57af1c4 None admin] PATH_INFO: `/v3/projects` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:31.297610 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f416d78-6172-456d-9bf4-a573d57af1c4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:28:31.297923 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f416d78-6172-456d-9bf4-a573d57af1c4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:31.299964 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f416d78-6172-456d-9bf4-a573d57af1c4 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:31.309523 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:31.320263 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 431/858] 10.222.0.67 () {56 vars in 1148 bytes} [Wed May 25 14:28:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:28:31.321848 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f416d78-6172-456d-9bf4-a573d57af1c4 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:31.328376 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 428/859] 10.222.0.67 () {58 vars in 1282 bytes} [Wed May 25 14:28:30 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 25 14:28:31.336105 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f771d1-7f2c-4ad4-b920-96899934910f None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:31.437689 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f416d78-6172-456d-9bf4-a573d57af1c4 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:31.446225 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f771d1-7f2c-4ad4-b920-96899934910f None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:31.466520 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:31.476871 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b24b177-8e52-42b4-8f45-df0682992f64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:31.477634 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b24b177-8e52-42b4-8f45-df0682992f64 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:31.477933 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b24b177-8e52-42b4-8f45-df0682992f64 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:31.478309 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b24b177-8e52-42b4-8f45-df0682992f64 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:31.479282 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b24b177-8e52-42b4-8f45-df0682992f64 None admin] RBAC: Adding query filter params (role.id=85be32e3c1ae4269b5456307e0827cc7, scope.project.id=bfe93ee8d32a441295efc0b885de4bd7, user.id=e03f5bb82ffb41a1b1dde935d093e6f4) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:28:31.479627 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b24b177-8e52-42b4-8f45-df0682992f64 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:31.481264 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b24b177-8e52-42b4-8f45-df0682992f64 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:31.486537 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64af966-8b23-4024-996c-d67f4cb60900 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:31.487383 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64af966-8b23-4024-996c-d67f4cb60900 None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:31.487672 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64af966-8b23-4024-996c-d67f4cb60900 None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:31.487951 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64af966-8b23-4024-996c-d67f4cb60900 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:31.495126 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 432/860] 10.222.0.67 () {56 vars in 1374 bytes} [Wed May 25 14:28:31 2022] GET /identity/v3/role_assignments?user.id=e03f5bb82ffb41a1b1dde935d093e6f4&scope.project.id=bfe93ee8d32a441295efc0b885de4bd7&role.id=85be32e3c1ae4269b5456307e0827cc7 => generated 608 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:28:31.499768 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64af966-8b23-4024-996c-d67f4cb60900 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:31.501273 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64af966-8b23-4024-996c-d67f4cb60900 None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:31.521056 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application [None req-b64af966-8b23-4024-996c-d67f4cb60900 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:28:31.521056 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:28:31.521056 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:28:31.521056 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:28:31.521056 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:28:31.521056 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:28:31.521056 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:28:31.521056 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:28:31.521056 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:28:31.521056 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:28:31.521056 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:28:31.521056 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:28:31.521056 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 14:28:31.521056 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 14:28:31.521056 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 14:28:31.522134 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 14:28:31.522134 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:28:31.522134 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:28:31.522134 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:28:31.522134 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:28:31.522134 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:28:31.522134 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:28:31.522134 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:28:31.522134 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application with Lock( May 25 14:28:31.522134 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:28:31.522134 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self._enter() May 25 14:28:31.522134 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:28:31.522134 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:28:31.522134 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:28:31.522134 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.creator() May 25 14:28:31.522134 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:28:31.522134 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application created_value = creator( May 25 14:28:31.523074 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 14:28:31.523074 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 14:28:31.523074 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:28:31.523074 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application May 25 14:28:31.523074 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 429/861] 10.222.0.67 () {56 vars in 1108 bytes} [Wed May 25 14:28:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:28:31.530855 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b24b177-8e52-42b4-8f45-df0682992f64 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:31.661370 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b24b177-8e52-42b4-8f45-df0682992f64 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:31.700097 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb86314-4218-476e-91bf-bf68728c83ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:31.700690 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb86314-4218-476e-91bf-bf68728c83ed None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:31.700975 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb86314-4218-476e-91bf-bf68728c83ed None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:31.701857 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb86314-4218-476e-91bf-bf68728c83ed None admin] PATH_INFO: `/v3/domains` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:31.703228 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb86314-4218-476e-91bf-bf68728c83ed None admin] RBAC: Adding query filter params (name=Default) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:28:31.703544 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb86314-4218-476e-91bf-bf68728c83ed None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:31.704939 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb86314-4218-476e-91bf-bf68728c83ed None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:31.719113 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 433/862] 10.222.0.67 () {56 vars in 1109 bytes} [Wed May 25 14:28:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:28:31.724909 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64af966-8b23-4024-996c-d67f4cb60900 None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:31.777667 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:31.841628 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76d7374-a258-4e92-bc4c-6ae4baf11449 None None] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:31.843196 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76d7374-a258-4e92-bc4c-6ae4baf11449 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:31.843912 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76d7374-a258-4e92-bc4c-6ae4baf11449 None None] PATH_INFO: `/` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:31.846175 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 434/863] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 14:28:31 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 14:28:31.848714 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64af966-8b23-4024-996c-d67f4cb60900 None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:31.851580 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db7e3a0-ec39-484b-9ccc-b1eb2a62fa29 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:31.851870 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db7e3a0-ec39-484b-9ccc-b1eb2a62fa29 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:31.852146 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db7e3a0-ec39-484b-9ccc-b1eb2a62fa29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:31.869781 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-1db7e3a0-ec39-484b-9ccc-b1eb2a62fa29 None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:28:31.872077 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-1db7e3a0-ec39-484b-9ccc-b1eb2a62fa29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:28:31.885627 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bb622e-a515-4b66-9a9c-46c6af310642 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:31.886459 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bb622e-a515-4b66-9a9c-46c6af310642 None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:31.886728 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bb622e-a515-4b66-9a9c-46c6af310642 None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:31.887019 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bb622e-a515-4b66-9a9c-46c6af310642 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:31.895390 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bb622e-a515-4b66-9a9c-46c6af310642 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:31.896831 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bb622e-a515-4b66-9a9c-46c6af310642 None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:31.911858 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application [None req-56bb622e-a515-4b66-9a9c-46c6af310642 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 14:28:31.911858 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:28:31.911858 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:28:31.911858 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:28:31.911858 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:28:31.911858 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:28:31.911858 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:28:31.911858 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:28:31.911858 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:28:31.911858 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:28:31.911858 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:28:31.911858 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:28:31.911858 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 14:28:31.911858 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 14:28:31.911858 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 14:28:31.912826 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 14:28:31.912826 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:28:31.912826 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:28:31.912826 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:28:31.912826 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:28:31.912826 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:28:31.912826 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:28:31.912826 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:28:31.912826 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application with Lock( May 25 14:28:31.912826 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:28:31.912826 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self._enter() May 25 14:28:31.912826 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:28:31.912826 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:28:31.912826 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:28:31.912826 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.creator() May 25 14:28:31.912826 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:28:31.912826 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application created_value = creator( May 25 14:28:31.914157 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 14:28:31.914157 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 14:28:31.914157 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 14:28:31.914157 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 14:28:31.914157 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 14:28:31.914157 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 14:28:31.914157 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 14:28:31.914157 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application May 25 14:28:31.914157 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 430/864] 10.222.0.67 () {56 vars in 1111 bytes} [Wed May 25 14:28:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 14:28:31.918775 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bb622e-a515-4b66-9a9c-46c6af310642 None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:31.934243 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:31.960711 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 435/865] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 14:28:31 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 25 14:28:31.984808 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db7e3a0-ec39-484b-9ccc-b1eb2a62fa29 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:32.038652 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bb622e-a515-4b66-9a9c-46c6af310642 None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:32.041105 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:32.079191 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249e4aeb-acc9-4f81-b19f-194405407a68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:32.080266 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249e4aeb-acc9-4f81-b19f-194405407a68 None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:32.080816 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249e4aeb-acc9-4f81-b19f-194405407a68 None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:32.081299 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249e4aeb-acc9-4f81-b19f-194405407a68 None admin] PATH_INFO: `/v3/projects` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:32.082414 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249e4aeb-acc9-4f81-b19f-194405407a68 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:28:32.082921 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249e4aeb-acc9-4f81-b19f-194405407a68 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:32.084692 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249e4aeb-acc9-4f81-b19f-194405407a68 None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:32.104556 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 431/866] 10.222.0.67 () {56 vars in 1148 bytes} [Wed May 25 14:28:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:28:32.105773 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249e4aeb-acc9-4f81-b19f-194405407a68 None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:32.119313 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db7e3a0-ec39-484b-9ccc-b1eb2a62fa29 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:32.159413 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0607aafd-12f2-4fe7-b3c0-b1c92e07039c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:32.160696 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0607aafd-12f2-4fe7-b3c0-b1c92e07039c None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:32.161187 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0607aafd-12f2-4fe7-b3c0-b1c92e07039c None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:32.161665 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0607aafd-12f2-4fe7-b3c0-b1c92e07039c None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:32.162631 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0607aafd-12f2-4fe7-b3c0-b1c92e07039c None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:32.164354 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0607aafd-12f2-4fe7-b3c0-b1c92e07039c None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:32.179026 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application [None req-0607aafd-12f2-4fe7-b3c0-b1c92e07039c None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 25 14:28:32.179026 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:28:32.179026 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 14:28:32.179026 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 14:28:32.179026 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 14:28:32.179026 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 14:28:32.179026 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 14:28:32.179026 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 14:28:32.179026 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 25 14:28:32.179026 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:28:32.179026 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 14:28:32.179026 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:28:32.179026 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:28:32.179026 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:28:32.179026 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:28:32.179026 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:28:32.180011 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:28:32.180011 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:28:32.180011 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:28:32.180011 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:28:32.180011 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:28:32.180011 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:28:32.180011 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:28:32.180011 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 14:28:32.180011 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 14:28:32.180011 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 14:28:32.180011 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 14:28:32.180011 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:28:32.180011 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:28:32.180011 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:28:32.180011 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:28:32.180011 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:28:32.180869 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:28:32.180869 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:28:32.180869 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application with Lock( May 25 14:28:32.180869 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:28:32.180869 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._enter() May 25 14:28:32.180869 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:28:32.180869 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:28:32.180869 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:28:32.180869 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.creator() May 25 14:28:32.180869 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:28:32.180869 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application created_value = creator( May 25 14:28:32.180869 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 14:28:32.180869 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 14:28:32.180869 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 25 14:28:32.180869 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:28:32.188934 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 436/867] 10.222.0.67 () {56 vars in 1132 bytes} [Wed May 25 14:28:31 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 14:28:32.190193 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0607aafd-12f2-4fe7-b3c0-b1c92e07039c None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:32.235384 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249e4aeb-acc9-4f81-b19f-194405407a68 None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:32.239376 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:32.273069 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcb3441-2f96-4d0d-8125-98d45f9a1df2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:32.274098 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcb3441-2f96-4d0d-8125-98d45f9a1df2 None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:32.274589 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcb3441-2f96-4d0d-8125-98d45f9a1df2 None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:32.275138 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcb3441-2f96-4d0d-8125-98d45f9a1df2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:32.276168 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcb3441-2f96-4d0d-8125-98d45f9a1df2 None admin] RBAC: Adding query filter params (role.id=399893e19eac4ab5a8e596f7c07be13c, scope.project.id=bfe93ee8d32a441295efc0b885de4bd7, user.id=dbe9e38881834198842a476889678096) {{(pid=80474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:28:32.276678 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcb3441-2f96-4d0d-8125-98d45f9a1df2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:32.278306 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcb3441-2f96-4d0d-8125-98d45f9a1df2 None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:32.285727 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 432/868] 10.222.0.67 () {56 vars in 1374 bytes} [Wed May 25 14:28:32 2022] GET /identity/v3/role_assignments?user.id=dbe9e38881834198842a476889678096&scope.project.id=bfe93ee8d32a441295efc0b885de4bd7&role.id=399893e19eac4ab5a8e596f7c07be13c => generated 608 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:28:32.316626 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0607aafd-12f2-4fe7-b3c0-b1c92e07039c None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:32.356061 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db0f83d-7f1d-4ea8-9018-c3c98e2e8437 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:32.357183 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db0f83d-7f1d-4ea8-9018-c3c98e2e8437 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:32.358265 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db0f83d-7f1d-4ea8-9018-c3c98e2e8437 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:32.358926 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db0f83d-7f1d-4ea8-9018-c3c98e2e8437 None admin] PATH_INFO: `/v3/services` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:32.359908 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db0f83d-7f1d-4ea8-9018-c3c98e2e8437 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:28:32.360434 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db0f83d-7f1d-4ea8-9018-c3c98e2e8437 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:32.362100 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db0f83d-7f1d-4ea8-9018-c3c98e2e8437 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:32.368195 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 437/869] 10.222.0.67 () {56 vars in 1126 bytes} [Wed May 25 14:28:32 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:28:32.374647 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcb3441-2f96-4d0d-8125-98d45f9a1df2 None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:32.407389 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:32.497439 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcb3441-2f96-4d0d-8125-98d45f9a1df2 None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:32.536307 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760748cb-504d-44ca-a955-9db1dfb3ad48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:32.537068 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760748cb-504d-44ca-a955-9db1dfb3ad48 None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:32.537267 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760748cb-504d-44ca-a955-9db1dfb3ad48 None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:32.537553 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760748cb-504d-44ca-a955-9db1dfb3ad48 None admin] PATH_INFO: `/v3/services` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:32.538273 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760748cb-504d-44ca-a955-9db1dfb3ad48 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:28:32.538585 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760748cb-504d-44ca-a955-9db1dfb3ad48 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:32.539994 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760748cb-504d-44ca-a955-9db1dfb3ad48 None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:32.546264 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 433/870] 10.222.0.67 () {56 vars in 1126 bytes} [Wed May 25 14:28:32 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:28:33.229714 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786c5b0f-a007-450a-8436-5a7451041e0f None None] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:33.230221 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786c5b0f-a007-450a-8436-5a7451041e0f None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:33.230221 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786c5b0f-a007-450a-8436-5a7451041e0f None None] PATH_INFO: `/` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:33.231817 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 438/871] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 14:28:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:28:33.237581 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27f2221-8a3a-4802-9447-cffa068e5d3c None None] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:33.238071 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27f2221-8a3a-4802-9447-cffa068e5d3c None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:33.238570 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27f2221-8a3a-4802-9447-cffa068e5d3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:33.258008 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.auth.core [None req-c27f2221-8a3a-4802-9447-cffa068e5d3c None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:28:33.259203 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-c27f2221-8a3a-4802-9447-cffa068e5d3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:28:33.332539 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 434/872] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 14:28:33 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 14:28:33.354953 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786c5b0f-a007-450a-8436-5a7451041e0f None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:33.466629 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786c5b0f-a007-450a-8436-5a7451041e0f None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:33.476747 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:33.509688 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437fd562-2888-4eca-a93f-f15a6d241033 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:33.510279 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437fd562-2888-4eca-a93f-f15a6d241033 None admin] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:33.510568 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437fd562-2888-4eca-a93f-f15a6d241033 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:33.510843 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437fd562-2888-4eca-a93f-f15a6d241033 None admin] PATH_INFO: `/v3/services` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:33.511710 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437fd562-2888-4eca-a93f-f15a6d241033 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:33.513159 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437fd562-2888-4eca-a93f-f15a6d241033 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:33.531406 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 439/873] 10.222.0.67 () {60 vars in 1141 bytes} [Wed May 25 14:28:33 2022] POST /identity/v3/services => generated 251 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:28:33.924292 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924681ba-7361-4374-8da3-1596ddd3c7cc None None] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:33.924956 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924681ba-7361-4374-8da3-1596ddd3c7cc None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:33.924956 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924681ba-7361-4374-8da3-1596ddd3c7cc None None] PATH_INFO: `/` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:33.926479 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 435/874] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 14:28:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:28:33.931823 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4c8271-2f99-41be-a6bf-7295e745ef29 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:33.932121 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4c8271-2f99-41be-a6bf-7295e745ef29 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:33.932401 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4c8271-2f99-41be-a6bf-7295e745ef29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:33.950292 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-4b4c8271-2f99-41be-a6bf-7295e745ef29 None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:28:33.952083 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-4b4c8271-2f99-41be-a6bf-7295e745ef29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:28:34.027611 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 440/875] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 14:28:33 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 14:28:34.051426 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924681ba-7361-4374-8da3-1596ddd3c7cc None None] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:34.073783 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:34.163123 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924681ba-7361-4374-8da3-1596ddd3c7cc None None] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:34.199071 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c7de12-a79f-4136-b0e4-a4c924504b77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:34.200124 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c7de12-a79f-4136-b0e4-a4c924504b77 None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:34.200553 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c7de12-a79f-4136-b0e4-a4c924504b77 None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:34.200969 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c7de12-a79f-4136-b0e4-a4c924504b77 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:34.212479 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c7de12-a79f-4136-b0e4-a4c924504b77 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:28:34.221648 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application [None req-32c7de12-a79f-4136-b0e4-a4c924504b77 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 25 14:28:34.221648 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:28:34.221648 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:28:34.221648 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:28:34.221648 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:28:34.221648 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:28:34.221648 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:28:34.221648 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:28:34.221648 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:28:34.221648 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:28:34.221648 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:28:34.221648 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:28:34.221648 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:28:34.221648 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:28:34.221648 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:28:34.221648 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:28:34.222789 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:28:34.222789 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:28:34.222789 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:28:34.222789 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:28:34.222789 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:28:34.222789 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:28:34.222789 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:28:34.222789 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:28:34.222789 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:28:34.222789 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:28:34.222789 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:28:34.222789 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application with Lock( May 25 14:28:34.222789 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:28:34.222789 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self._enter() May 25 14:28:34.222789 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:28:34.222789 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:28:34.223879 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:28:34.223879 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.creator() May 25 14:28:34.223879 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:28:34.223879 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application created_value = creator( May 25 14:28:34.223879 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:28:34.223879 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:28:34.223879 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:28:34.223879 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:28:34.223879 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:28:34.223879 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:28:34.223879 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 25 14:28:34.223879 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application May 25 14:28:34.226269 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 436/876] 10.222.0.67 () {56 vars in 1120 bytes} [Wed May 25 14:28:34 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:28:34.235268 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4c8271-2f99-41be-a6bf-7295e745ef29 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:34.336194 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:34.345115 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4c8271-2f99-41be-a6bf-7295e745ef29 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:34.382742 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc83473-11fa-4f0b-ad6f-2746024e3bee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:34.383775 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc83473-11fa-4f0b-ad6f-2746024e3bee None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:34.384069 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc83473-11fa-4f0b-ad6f-2746024e3bee None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:34.384351 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc83473-11fa-4f0b-ad6f-2746024e3bee None admin] PATH_INFO: `/v3/roles` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:34.385108 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc83473-11fa-4f0b-ad6f-2746024e3bee None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:28:34.385417 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc83473-11fa-4f0b-ad6f-2746024e3bee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:34.386796 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc83473-11fa-4f0b-ad6f-2746024e3bee None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:34.396250 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 441/877] 10.222.0.67 () {56 vars in 1115 bytes} [Wed May 25 14:28:34 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:28:34.401404 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c7de12-a79f-4136-b0e4-a4c924504b77 None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:34.497468 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:34.519297 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c7de12-a79f-4136-b0e4-a4c924504b77 None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:34.555678 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a2d03b-09af-46f8-9a1b-8b347038e112 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:34.556865 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a2d03b-09af-46f8-9a1b-8b347038e112 None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:34.557363 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a2d03b-09af-46f8-9a1b-8b347038e112 None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:34.557914 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a2d03b-09af-46f8-9a1b-8b347038e112 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:34.570333 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a2d03b-09af-46f8-9a1b-8b347038e112 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:34.572044 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a2d03b-09af-46f8-9a1b-8b347038e112 None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:34.589751 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application [None req-86a2d03b-09af-46f8-9a1b-8b347038e112 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:28:34.589751 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:28:34.589751 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:28:34.589751 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:28:34.589751 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:28:34.589751 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:28:34.589751 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:28:34.589751 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:28:34.589751 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:28:34.589751 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:28:34.589751 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:28:34.589751 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:28:34.589751 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 14:28:34.589751 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 14:28:34.589751 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 14:28:34.590686 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 14:28:34.590686 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:28:34.590686 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:28:34.590686 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:28:34.590686 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:28:34.590686 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:28:34.590686 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:28:34.590686 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:28:34.590686 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application with Lock( May 25 14:28:34.590686 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:28:34.590686 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self._enter() May 25 14:28:34.590686 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:28:34.590686 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:28:34.590686 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:28:34.590686 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.creator() May 25 14:28:34.590686 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:28:34.590686 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application created_value = creator( May 25 14:28:34.591625 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 14:28:34.591625 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 14:28:34.591625 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:28:34.591625 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application May 25 14:28:34.594197 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 437/878] 10.222.0.67 () {56 vars in 1108 bytes} [Wed May 25 14:28:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:28:34.599582 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc83473-11fa-4f0b-ad6f-2746024e3bee None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:34.653085 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7f93bf-d23f-4078-aaeb-5b769b18f5e0 None None] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:34.653604 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7f93bf-d23f-4078-aaeb-5b769b18f5e0 None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:34.654025 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7f93bf-d23f-4078-aaeb-5b769b18f5e0 None None] PATH_INFO: `/` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:34.656607 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 438/879] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 14:28:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:28:34.662358 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe6d2ae-526f-40a5-b541-aa09ea245ea8 None None] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:34.662973 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe6d2ae-526f-40a5-b541-aa09ea245ea8 None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:34.663496 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe6d2ae-526f-40a5-b541-aa09ea245ea8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:34.682551 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.auth.core [None req-abe6d2ae-526f-40a5-b541-aa09ea245ea8 None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:28:34.684186 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-abe6d2ae-526f-40a5-b541-aa09ea245ea8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:28:34.717550 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc83473-11fa-4f0b-ad6f-2746024e3bee None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:34.756777 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8654ad0-4d24-4420-a2c4-5d6ef171fd5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:34.757369 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8654ad0-4d24-4420-a2c4-5d6ef171fd5d None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:34.757655 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8654ad0-4d24-4420-a2c4-5d6ef171fd5d None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:34.757937 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8654ad0-4d24-4420-a2c4-5d6ef171fd5d None admin] PATH_INFO: `/v3/domains` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:34.758682 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8654ad0-4d24-4420-a2c4-5d6ef171fd5d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:28:34.759010 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8654ad0-4d24-4420-a2c4-5d6ef171fd5d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:34.760471 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8654ad0-4d24-4420-a2c4-5d6ef171fd5d None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:34.771316 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 439/880] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 14:28:34 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 25 14:28:34.774402 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 442/881] 10.222.0.67 () {56 vars in 1109 bytes} [Wed May 25 14:28:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:28:34.779940 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe6d2ae-526f-40a5-b541-aa09ea245ea8 None None] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:34.786504 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8654ad0-4d24-4420-a2c4-5d6ef171fd5d None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:34.808931 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:34.872721 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:34.915044 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8654ad0-4d24-4420-a2c4-5d6ef171fd5d None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:34.917974 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe6d2ae-526f-40a5-b541-aa09ea245ea8 None None] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:34.956718 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455fd218-996b-43da-9de3-949d52135487 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:34.957377 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76eab83-6502-4e64-bc59-2994792a0e92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:34.957588 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76eab83-6502-4e64-bc59-2994792a0e92 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:34.957698 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455fd218-996b-43da-9de3-949d52135487 None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:34.957831 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455fd218-996b-43da-9de3-949d52135487 None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:34.958083 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455fd218-996b-43da-9de3-949d52135487 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:34.958181 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76eab83-6502-4e64-bc59-2994792a0e92 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:34.958429 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76eab83-6502-4e64-bc59-2994792a0e92 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:34.959186 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76eab83-6502-4e64-bc59-2994792a0e92 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:34.960615 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76eab83-6502-4e64-bc59-2994792a0e92 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:34.965457 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455fd218-996b-43da-9de3-949d52135487 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:34.967731 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455fd218-996b-43da-9de3-949d52135487 None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:34.973536 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application [None req-d76eab83-6502-4e64-bc59-2994792a0e92 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 25 14:28:34.973536 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:28:34.973536 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 14:28:34.973536 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 14:28:34.973536 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 14:28:34.973536 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 14:28:34.973536 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 14:28:34.973536 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 14:28:34.973536 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 25 14:28:34.973536 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:28:34.973536 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 14:28:34.973536 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:28:34.973536 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:28:34.973536 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:28:34.973536 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:28:34.973536 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:28:34.973536 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:28:34.974569 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:28:34.974569 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:28:34.974569 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:28:34.974569 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:28:34.974569 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:28:34.974569 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:28:34.974569 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 14:28:34.974569 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 14:28:34.974569 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 14:28:34.974569 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 14:28:34.974569 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:28:34.974569 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:28:34.974569 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:28:34.974569 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:28:34.974569 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:28:34.974569 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:28:34.975502 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:28:34.975502 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application with Lock( May 25 14:28:34.975502 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:28:34.975502 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._enter() May 25 14:28:34.975502 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:28:34.975502 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:28:34.975502 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:28:34.975502 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.creator() May 25 14:28:34.975502 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:28:34.975502 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application created_value = creator( May 25 14:28:34.975502 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 14:28:34.975502 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 14:28:34.975502 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 25 14:28:34.975502 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:28:34.975502 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 443/882] 10.222.0.67 () {56 vars in 1126 bytes} [Wed May 25 14:28:34 2022] GET /identity/v3/services/object-store => generated 93 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 14:28:34.976790 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83ab2cd-0ba7-4143-bb73-006734332188 None None] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:34.976790 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83ab2cd-0ba7-4143-bb73-006734332188 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:34.976962 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83ab2cd-0ba7-4143-bb73-006734332188 None None] PATH_INFO: `/` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:34.978143 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 444/883] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 14:28:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:28:34.980593 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83ab2cd-0ba7-4143-bb73-006734332188 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:34.988954 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application [None req-455fd218-996b-43da-9de3-949d52135487 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 25 14:28:34.988954 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:28:34.988954 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:28:34.988954 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:28:34.988954 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:28:34.988954 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:28:34.988954 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:28:34.988954 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:28:34.988954 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:28:34.988954 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:28:34.988954 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:28:34.988954 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:28:34.988954 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 14:28:34.988954 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 14:28:34.988954 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 14:28:34.988954 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 14:28:34.989954 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:28:34.989954 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:28:34.989954 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 14:28:34.989954 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 14:28:34.989954 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 14:28:34.989954 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 14:28:34.989954 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:28:34.989954 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:28:34.989954 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:28:34.989954 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:28:34.989954 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:28:34.989954 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application with Lock( May 25 14:28:34.989954 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:28:34.989954 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self._enter() May 25 14:28:34.989954 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:28:34.989954 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:28:34.989954 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:28:34.989954 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.creator() May 25 14:28:34.991024 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:28:34.991024 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application created_value = creator( May 25 14:28:34.991024 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 14:28:34.991024 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 14:28:34.991024 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 14:28:34.991024 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 14:28:34.991024 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 14:28:34.991024 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 14:28:34.991024 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 25 14:28:34.991024 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application May 25 14:28:34.994762 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 440/884] 10.222.0.67 () {56 vars in 1117 bytes} [Wed May 25 14:28:34 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:28:34.995913 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a023ad4-c379-40c7-8388-f5c73220a3e2 None None] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:34.996200 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a023ad4-c379-40c7-8388-f5c73220a3e2 None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:34.996729 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a023ad4-c379-40c7-8388-f5c73220a3e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:35.015512 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.auth.core [None req-8a023ad4-c379-40c7-8388-f5c73220a3e2 None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:28:35.016630 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-8a023ad4-c379-40c7-8388-f5c73220a3e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:28:35.069607 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:35.087375 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 441/885] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 14:28:34 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 14:28:35.088211 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a023ad4-c379-40c7-8388-f5c73220a3e2 None None] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:35.101393 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83ab2cd-0ba7-4143-bb73-006734332188 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:35.142043 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e565ce-5177-447d-9a88-543fc146b600 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:35.142967 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e565ce-5177-447d-9a88-543fc146b600 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:35.143306 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e565ce-5177-447d-9a88-543fc146b600 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:35.143565 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e565ce-5177-447d-9a88-543fc146b600 None admin] PATH_INFO: `/v3/services` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:35.144281 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e565ce-5177-447d-9a88-543fc146b600 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:28:35.144592 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e565ce-5177-447d-9a88-543fc146b600 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:35.145467 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:35.145974 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e565ce-5177-447d-9a88-543fc146b600 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:35.150977 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 445/886] 10.222.0.67 () {56 vars in 1122 bytes} [Wed May 25 14:28:34 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:28:35.150977 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e565ce-5177-447d-9a88-543fc146b600 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:35.202398 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a023ad4-c379-40c7-8388-f5c73220a3e2 None None] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:35.239377 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e743a9-d771-43d7-aaa9-bfe6b32bc88c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:35.240058 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e743a9-d771-43d7-aaa9-bfe6b32bc88c None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:35.240345 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e743a9-d771-43d7-aaa9-bfe6b32bc88c None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:35.240627 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e743a9-d771-43d7-aaa9-bfe6b32bc88c None admin] PATH_INFO: `/v3/users` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:35.241469 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e743a9-d771-43d7-aaa9-bfe6b32bc88c None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:28:35.241784 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e743a9-d771-43d7-aaa9-bfe6b32bc88c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:35.243250 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e743a9-d771-43d7-aaa9-bfe6b32bc88c None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:35.259919 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e565ce-5177-447d-9a88-543fc146b600 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:35.261783 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 442/887] 10.222.0.67 () {56 vars in 1149 bytes} [Wed May 25 14:28:35 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:28:35.262600 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e743a9-d771-43d7-aaa9-bfe6b32bc88c None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:35.302065 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa6fbff-ad04-44d1-8408-1e4851f3ba43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:35.303151 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa6fbff-ad04-44d1-8408-1e4851f3ba43 None admin] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:35.303648 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa6fbff-ad04-44d1-8408-1e4851f3ba43 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:35.304135 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa6fbff-ad04-44d1-8408-1e4851f3ba43 None admin] PATH_INFO: `/v3/services` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:35.305129 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa6fbff-ad04-44d1-8408-1e4851f3ba43 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:35.307224 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa6fbff-ad04-44d1-8408-1e4851f3ba43 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:35.324146 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 446/888] 10.222.0.67 () {60 vars in 1141 bytes} [Wed May 25 14:28:35 2022] POST /identity/v3/services => generated 269 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:28:35.325206 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa6fbff-ad04-44d1-8408-1e4851f3ba43 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:35.329668 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:35.405146 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e743a9-d771-43d7-aaa9-bfe6b32bc88c None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:35.418803 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:35.456770 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225eab25-01d4-4189-9882-0432e4ae3a9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:35.457919 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225eab25-01d4-4189-9882-0432e4ae3a9a None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:35.458401 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225eab25-01d4-4189-9882-0432e4ae3a9a None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:35.458977 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225eab25-01d4-4189-9882-0432e4ae3a9a None admin] PATH_INFO: `/v3/services` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:35.459935 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225eab25-01d4-4189-9882-0432e4ae3a9a None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:28:35.460404 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225eab25-01d4-4189-9882-0432e4ae3a9a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:35.462088 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225eab25-01d4-4189-9882-0432e4ae3a9a None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:35.475523 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 443/889] 10.222.0.67 () {56 vars in 1122 bytes} [Wed May 25 14:28:35 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:28:35.478438 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa6fbff-ad04-44d1-8408-1e4851f3ba43 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:35.522343 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d12e200-6710-4d66-8fc7-26279021e573 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:35.523035 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d12e200-6710-4d66-8fc7-26279021e573 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:35.523341 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d12e200-6710-4d66-8fc7-26279021e573 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:35.523620 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d12e200-6710-4d66-8fc7-26279021e573 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:35.607836 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d12e200-6710-4d66-8fc7-26279021e573 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:35.609388 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d12e200-6710-4d66-8fc7-26279021e573 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:35.612580 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:35.729287 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 447/890] 10.222.0.67 () {58 vars in 1282 bytes} [Wed May 25 14:28:35 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 25 14:28:35.736147 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225eab25-01d4-4189-9882-0432e4ae3a9a None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:35.852542 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225eab25-01d4-4189-9882-0432e4ae3a9a None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:35.874534 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7ce2ee-122e-408c-af29-77fb82e76dda None None] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:35.874819 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7ce2ee-122e-408c-af29-77fb82e76dda None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:35.875045 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7ce2ee-122e-408c-af29-77fb82e76dda None None] PATH_INFO: `/` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:35.876649 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 448/891] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 14:28:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:28:35.881929 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44da1092-ff5f-4630-b75e-dbbc26527b11 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:35.882191 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44da1092-ff5f-4630-b75e-dbbc26527b11 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:35.882447 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44da1092-ff5f-4630-b75e-dbbc26527b11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:35.895852 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5642af6e-771b-4fd4-ad42-81132c6b3856 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:35.897000 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5642af6e-771b-4fd4-ad42-81132c6b3856 None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:35.897756 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5642af6e-771b-4fd4-ad42-81132c6b3856 None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:35.898272 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5642af6e-771b-4fd4-ad42-81132c6b3856 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:35.901374 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-44da1092-ff5f-4630-b75e-dbbc26527b11 None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:28:35.902566 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-44da1092-ff5f-4630-b75e-dbbc26527b11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:28:35.911767 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5642af6e-771b-4fd4-ad42-81132c6b3856 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:35.913234 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5642af6e-771b-4fd4-ad42-81132c6b3856 None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:35.939532 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application [None req-5642af6e-771b-4fd4-ad42-81132c6b3856 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:28:35.939532 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:28:35.939532 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:28:35.939532 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:28:35.939532 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:28:35.939532 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:28:35.939532 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:28:35.939532 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:28:35.939532 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:28:35.939532 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:28:35.939532 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:28:35.939532 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:28:35.939532 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 14:28:35.939532 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 14:28:35.939532 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 14:28:35.940527 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 14:28:35.940527 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:28:35.940527 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:28:35.940527 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:28:35.940527 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:28:35.940527 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:28:35.940527 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:28:35.940527 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:28:35.940527 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application with Lock( May 25 14:28:35.940527 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:28:35.940527 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self._enter() May 25 14:28:35.940527 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:28:35.940527 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:28:35.940527 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:28:35.940527 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.creator() May 25 14:28:35.940527 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:28:35.940527 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application created_value = creator( May 25 14:28:35.941458 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 14:28:35.941458 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 14:28:35.941458 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:28:35.941458 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application May 25 14:28:35.944400 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 444/892] 10.222.0.67 () {56 vars in 1108 bytes} [Wed May 25 14:28:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 14:28:35.949597 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5642af6e-771b-4fd4-ad42-81132c6b3856 None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:35.981322 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 449/893] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 14:28:35 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 14:28:35.987417 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:36.005070 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44da1092-ff5f-4630-b75e-dbbc26527b11 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:36.040270 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:36.066001 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5642af6e-771b-4fd4-ad42-81132c6b3856 None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:36.104832 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551e2784-2fbc-4238-9e31-4770c724668a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:36.105514 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551e2784-2fbc-4238-9e31-4770c724668a None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:36.105802 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551e2784-2fbc-4238-9e31-4770c724668a None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:36.106089 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551e2784-2fbc-4238-9e31-4770c724668a None admin] PATH_INFO: `/v3/domains` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:36.106928 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551e2784-2fbc-4238-9e31-4770c724668a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:28:36.108061 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551e2784-2fbc-4238-9e31-4770c724668a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:36.109322 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551e2784-2fbc-4238-9e31-4770c724668a None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:36.114038 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44da1092-ff5f-4630-b75e-dbbc26527b11 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:36.126730 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 445/894] 10.222.0.67 () {56 vars in 1109 bytes} [Wed May 25 14:28:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:28:36.129393 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551e2784-2fbc-4238-9e31-4770c724668a None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:36.165685 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c22dba-c7c4-4467-a2e6-62b4062b0338 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:36.166497 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c22dba-c7c4-4467-a2e6-62b4062b0338 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:36.166835 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c22dba-c7c4-4467-a2e6-62b4062b0338 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:36.167152 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c22dba-c7c4-4467-a2e6-62b4062b0338 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:36.167868 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c22dba-c7c4-4467-a2e6-62b4062b0338 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:36.169251 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c22dba-c7c4-4467-a2e6-62b4062b0338 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:36.182127 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application [None req-a5c22dba-c7c4-4467-a2e6-62b4062b0338 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 25 14:28:36.182127 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:28:36.182127 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 14:28:36.182127 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 14:28:36.182127 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 14:28:36.182127 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 14:28:36.182127 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 14:28:36.182127 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 14:28:36.182127 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 25 14:28:36.182127 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:28:36.182127 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 14:28:36.182127 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:28:36.182127 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:28:36.182127 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:28:36.182127 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:28:36.182127 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:28:36.182127 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:28:36.183176 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:28:36.183176 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:28:36.183176 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:28:36.183176 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:28:36.183176 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:28:36.183176 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:28:36.183176 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 14:28:36.183176 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 14:28:36.183176 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 14:28:36.183176 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 14:28:36.183176 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:28:36.183176 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:28:36.183176 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:28:36.183176 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:28:36.183176 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:28:36.183176 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:28:36.184040 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:28:36.184040 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application with Lock( May 25 14:28:36.184040 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:28:36.184040 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._enter() May 25 14:28:36.184040 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:28:36.184040 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:28:36.184040 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:28:36.184040 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.creator() May 25 14:28:36.184040 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:28:36.184040 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application created_value = creator( May 25 14:28:36.184040 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 14:28:36.184040 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 14:28:36.184040 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 25 14:28:36.184040 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:28:36.188363 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 450/895] 10.222.0.67 () {56 vars in 1114 bytes} [Wed May 25 14:28:36 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 14:28:36.189245 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c22dba-c7c4-4467-a2e6-62b4062b0338 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:36.242060 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:36.269638 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551e2784-2fbc-4238-9e31-4770c724668a None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:36.301213 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:36.305696 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c22dba-c7c4-4467-a2e6-62b4062b0338 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:36.316482 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472494f5-ee0d-45ac-bdf9-5054799d96b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:36.317968 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472494f5-ee0d-45ac-bdf9-5054799d96b0 None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:36.318805 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472494f5-ee0d-45ac-bdf9-5054799d96b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:36.319260 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472494f5-ee0d-45ac-bdf9-5054799d96b0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:36.329194 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472494f5-ee0d-45ac-bdf9-5054799d96b0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:36.331531 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472494f5-ee0d-45ac-bdf9-5054799d96b0 None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:36.348730 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application [None req-472494f5-ee0d-45ac-bdf9-5054799d96b0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 14:28:36.348730 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:28:36.348730 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:28:36.348730 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:28:36.348730 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:28:36.348730 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:28:36.348730 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:28:36.348730 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:28:36.348730 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:28:36.348730 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:28:36.348730 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:28:36.348730 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:28:36.348730 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 14:28:36.348730 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 14:28:36.348730 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 14:28:36.349719 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 14:28:36.349719 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:28:36.349719 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:28:36.349719 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:28:36.349719 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:28:36.349719 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:28:36.349719 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:28:36.349719 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:28:36.349719 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application with Lock( May 25 14:28:36.349719 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:28:36.349719 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self._enter() May 25 14:28:36.349719 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:28:36.349719 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:28:36.349719 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:28:36.349719 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.creator() May 25 14:28:36.349719 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:28:36.349719 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application created_value = creator( May 25 14:28:36.350634 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 14:28:36.350634 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 14:28:36.350634 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 14:28:36.350634 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 14:28:36.350634 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 14:28:36.350634 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 14:28:36.350634 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 14:28:36.350634 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application May 25 14:28:36.353202 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9dc450d-f8e1-4ebe-baac-937d9836b9a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:36.354104 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dc450d-f8e1-4ebe-baac-937d9836b9a9 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:36.354657 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dc450d-f8e1-4ebe-baac-937d9836b9a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:36.354815 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 446/896] 10.222.0.67 () {56 vars in 1111 bytes} [Wed May 25 14:28:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:28:36.355324 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dc450d-f8e1-4ebe-baac-937d9836b9a9 None admin] PATH_INFO: `/v3/services` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:36.355661 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472494f5-ee0d-45ac-bdf9-5054799d96b0 None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:36.356583 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9dc450d-f8e1-4ebe-baac-937d9836b9a9 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:28:36.357094 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9dc450d-f8e1-4ebe-baac-937d9836b9a9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:36.360551 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9dc450d-f8e1-4ebe-baac-937d9836b9a9 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:36.366845 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 451/897] 10.222.0.67 () {56 vars in 1114 bytes} [Wed May 25 14:28:36 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:28:36.372988 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9dc450d-f8e1-4ebe-baac-937d9836b9a9 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:36.486355 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9dc450d-f8e1-4ebe-baac-937d9836b9a9 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:36.489814 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472494f5-ee0d-45ac-bdf9-5054799d96b0 None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:36.532770 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b453f7-faf9-42bb-9d60-52f011f932ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:36.533810 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168c7260-07da-445a-8bb3-491ee17dc1b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:36.534221 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b453f7-faf9-42bb-9d60-52f011f932ff None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:36.534473 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168c7260-07da-445a-8bb3-491ee17dc1b8 None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:36.534756 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168c7260-07da-445a-8bb3-491ee17dc1b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:36.535050 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168c7260-07da-445a-8bb3-491ee17dc1b8 None admin] PATH_INFO: `/v3/projects` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:36.535362 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b453f7-faf9-42bb-9d60-52f011f932ff None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:36.535852 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168c7260-07da-445a-8bb3-491ee17dc1b8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:28:36.536076 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b453f7-faf9-42bb-9d60-52f011f932ff None admin] PATH_INFO: `/v3/services` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:36.536177 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168c7260-07da-445a-8bb3-491ee17dc1b8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:36.537087 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b453f7-faf9-42bb-9d60-52f011f932ff None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:28:36.537585 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168c7260-07da-445a-8bb3-491ee17dc1b8 None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:36.537863 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b453f7-faf9-42bb-9d60-52f011f932ff None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:36.539658 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b453f7-faf9-42bb-9d60-52f011f932ff None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:36.550454 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 452/898] 10.222.0.67 () {56 vars in 1114 bytes} [Wed May 25 14:28:36 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:28:36.553655 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b453f7-faf9-42bb-9d60-52f011f932ff None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:36.554667 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 447/899] 10.222.0.67 () {56 vars in 1148 bytes} [Wed May 25 14:28:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:28:36.561667 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168c7260-07da-445a-8bb3-491ee17dc1b8 None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:36.564508 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:36.590824 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:36.666650 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168c7260-07da-445a-8bb3-491ee17dc1b8 None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:36.677147 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b453f7-faf9-42bb-9d60-52f011f932ff None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:36.708187 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb22e60b-b5ff-4b1d-912c-c9f79ae57c92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:36.709122 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb22e60b-b5ff-4b1d-912c-c9f79ae57c92 None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:36.709410 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb22e60b-b5ff-4b1d-912c-c9f79ae57c92 None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:36.709783 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb22e60b-b5ff-4b1d-912c-c9f79ae57c92 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:36.710776 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb22e60b-b5ff-4b1d-912c-c9f79ae57c92 None admin] RBAC: Adding query filter params (role.id=a45d5a067e824fa18ca4428cff2a3889, scope.project.id=bfe93ee8d32a441295efc0b885de4bd7, user.id=e03f5bb82ffb41a1b1dde935d093e6f4) {{(pid=80474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:28:36.711226 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb22e60b-b5ff-4b1d-912c-c9f79ae57c92 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:36.712804 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb22e60b-b5ff-4b1d-912c-c9f79ae57c92 None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:36.719889 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a27731-f57a-4d9a-a578-238b95ed4efe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:36.720770 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a27731-f57a-4d9a-a578-238b95ed4efe None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:36.721272 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a27731-f57a-4d9a-a578-238b95ed4efe None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:36.721767 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a27731-f57a-4d9a-a578-238b95ed4efe None admin] PATH_INFO: `/v3/endpoints` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:36.722799 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a27731-f57a-4d9a-a578-238b95ed4efe None admin] RBAC: Adding query filter params (interface=public, service_id=357cbb2a8016423fbb7ff51f7c4a0e3c, region_id=RegionOne) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:28:36.723367 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a27731-f57a-4d9a-a578-238b95ed4efe None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:36.724993 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a27731-f57a-4d9a-a578-238b95ed4efe None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:36.727177 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 448/900] 10.222.0.67 () {56 vars in 1374 bytes} [Wed May 25 14:28:36 2022] GET /identity/v3/role_assignments?user.id=e03f5bb82ffb41a1b1dde935d093e6f4&scope.project.id=bfe93ee8d32a441295efc0b885de4bd7&role.id=a45d5a067e824fa18ca4428cff2a3889 => generated 259 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:28:36.732195 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 453/901] 10.222.0.67 () {56 vars in 1251 bytes} [Wed May 25 14:28:36 2022] GET /identity/v3/endpoints?service_id=357cbb2a8016423fbb7ff51f7c4a0e3c&interface=public®ion_id=RegionOne => generated 194 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:28:36.738283 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb22e60b-b5ff-4b1d-912c-c9f79ae57c92 None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:36.824061 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:36.865329 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb22e60b-b5ff-4b1d-912c-c9f79ae57c92 None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:36.912773 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f988e121-837e-43af-a8b2-3796a26a231b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:36.913468 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f988e121-837e-43af-a8b2-3796a26a231b None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:36.913755 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f988e121-837e-43af-a8b2-3796a26a231b None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:36.914037 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f988e121-837e-43af-a8b2-3796a26a231b None admin] PATH_INFO: `/v3/services` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:36.914966 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f988e121-837e-43af-a8b2-3796a26a231b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:36.916382 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f988e121-837e-43af-a8b2-3796a26a231b None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:36.924020 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 449/902] 10.222.0.67 () {56 vars in 1087 bytes} [Wed May 25 14:28:36 2022] GET /identity/v3/services => generated 1268 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 25 14:28:37.682918 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07323b27-50b6-44f5-a0aa-5413e8189117 None None] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:37.683475 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07323b27-50b6-44f5-a0aa-5413e8189117 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:37.683554 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07323b27-50b6-44f5-a0aa-5413e8189117 None None] PATH_INFO: `/` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:37.685122 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 454/903] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 14:28:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:28:37.690946 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25502a9a-9e9b-43d1-a5a4-620421a678d5 None None] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:37.691429 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25502a9a-9e9b-43d1-a5a4-620421a678d5 None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:37.691619 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25502a9a-9e9b-43d1-a5a4-620421a678d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:37.713037 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.auth.core [None req-25502a9a-9e9b-43d1-a5a4-620421a678d5 None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:28:37.714363 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-25502a9a-9e9b-43d1-a5a4-620421a678d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:28:37.785070 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 450/904] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 14:28:37 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 25 14:28:37.808297 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07323b27-50b6-44f5-a0aa-5413e8189117 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:37.847355 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3271e2-389b-4576-b737-7a36139edf8f None None] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:37.847640 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3271e2-389b-4576-b737-7a36139edf8f None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:37.847925 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3271e2-389b-4576-b737-7a36139edf8f None None] PATH_INFO: `/` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:37.849545 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 451/905] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 14:28:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 14:28:37.854973 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd9c0eb-588f-4e9a-be62-0fa7257a35c7 None None] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:37.855291 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd9c0eb-588f-4e9a-be62-0fa7257a35c7 None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:37.855573 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd9c0eb-588f-4e9a-be62-0fa7257a35c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:37.876954 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.auth.core [None req-7dd9c0eb-588f-4e9a-be62-0fa7257a35c7 None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:28:37.878625 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-7dd9c0eb-588f-4e9a-be62-0fa7257a35c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:28:37.927023 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:37.937144 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07323b27-50b6-44f5-a0aa-5413e8189117 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:37.959289 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:37.975378 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 452/906] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 14:28:37 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (3 switches on core 0) May 25 14:28:37.977711 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30728868-1780-4c26-b4be-028cdd68387b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:37.978525 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30728868-1780-4c26-b4be-028cdd68387b None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:37.978804 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30728868-1780-4c26-b4be-028cdd68387b None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:37.979101 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30728868-1780-4c26-b4be-028cdd68387b None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:37.979755 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30728868-1780-4c26-b4be-028cdd68387b None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:37.981115 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30728868-1780-4c26-b4be-028cdd68387b None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:37.993953 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application [None req-30728868-1780-4c26-b4be-028cdd68387b None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 25 14:28:37.993953 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:28:37.993953 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 14:28:37.993953 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 14:28:37.993953 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 14:28:37.993953 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 14:28:37.993953 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 14:28:37.993953 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 14:28:37.993953 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 25 14:28:37.993953 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:28:37.993953 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 14:28:37.993953 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:28:37.993953 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:28:37.993953 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:28:37.993953 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:28:37.993953 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:28:37.994899 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:28:37.994899 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:28:37.994899 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:28:37.994899 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:28:37.994899 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:28:37.994899 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:28:37.994899 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:28:37.994899 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 14:28:37.994899 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 14:28:37.994899 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 14:28:37.994899 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 14:28:37.994899 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:28:37.994899 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:28:37.994899 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:28:37.994899 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:28:37.994899 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:28:37.995805 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:28:37.995805 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:28:37.995805 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application with Lock( May 25 14:28:37.995805 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:28:37.995805 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._enter() May 25 14:28:37.995805 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:28:37.995805 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:28:37.995805 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:28:37.995805 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.creator() May 25 14:28:37.995805 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:28:37.995805 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application created_value = creator( May 25 14:28:37.995805 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 14:28:37.995805 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 14:28:37.995805 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 25 14:28:37.995805 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:28:37.995805 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 455/907] 10.222.0.67 () {56 vars in 1132 bytes} [Wed May 25 14:28:37 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:28:37.997597 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd9c0eb-588f-4e9a-be62-0fa7257a35c7 None None] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:38.003067 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30728868-1780-4c26-b4be-028cdd68387b None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:38.126339 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd9c0eb-588f-4e9a-be62-0fa7257a35c7 None None] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:38.137531 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30728868-1780-4c26-b4be-028cdd68387b None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:38.169940 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2493a1a1-4e0f-4395-85bc-04b12d19b4ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:38.170618 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2493a1a1-4e0f-4395-85bc-04b12d19b4ea None admin] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:38.171254 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2493a1a1-4e0f-4395-85bc-04b12d19b4ea None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:38.171537 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2493a1a1-4e0f-4395-85bc-04b12d19b4ea None admin] PATH_INFO: `/v3/services` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:38.172555 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2493a1a1-4e0f-4395-85bc-04b12d19b4ea None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:38.174377 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2493a1a1-4e0f-4395-85bc-04b12d19b4ea None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:38.180015 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee21790-15e9-4802-90c0-5f8a06866bb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:38.180828 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee21790-15e9-4802-90c0-5f8a06866bb7 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:38.181181 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee21790-15e9-4802-90c0-5f8a06866bb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:38.181453 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee21790-15e9-4802-90c0-5f8a06866bb7 None admin] PATH_INFO: `/v3/services` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:38.182303 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee21790-15e9-4802-90c0-5f8a06866bb7 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:28:38.182670 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee21790-15e9-4802-90c0-5f8a06866bb7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:38.184312 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee21790-15e9-4802-90c0-5f8a06866bb7 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:38.191734 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 453/908] 10.222.0.67 () {60 vars in 1141 bytes} [Wed May 25 14:28:37 2022] POST /identity/v3/services => generated 241 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 14:28:38.195451 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 456/909] 10.222.0.67 () {56 vars in 1126 bytes} [Wed May 25 14:28:38 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:28:38.196881 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2493a1a1-4e0f-4395-85bc-04b12d19b4ea None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:38.257359 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:38.324619 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2493a1a1-4e0f-4395-85bc-04b12d19b4ea None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:38.363052 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af83531-bbcd-4f55-86df-e0bbab234d1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:38.363740 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af83531-bbcd-4f55-86df-e0bbab234d1e None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:38.364023 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af83531-bbcd-4f55-86df-e0bbab234d1e None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:38.364298 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af83531-bbcd-4f55-86df-e0bbab234d1e None admin] PATH_INFO: `/v3/services` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:38.365025 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af83531-bbcd-4f55-86df-e0bbab234d1e None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:28:38.365334 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af83531-bbcd-4f55-86df-e0bbab234d1e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:38.366724 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af83531-bbcd-4f55-86df-e0bbab234d1e None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:38.373182 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 454/910] 10.222.0.67 () {56 vars in 1126 bytes} [Wed May 25 14:28:38 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:28:38.379256 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee21790-15e9-4802-90c0-5f8a06866bb7 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:38.404277 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:38.493335 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee21790-15e9-4802-90c0-5f8a06866bb7 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:38.528003 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa944363-cf97-4f76-909c-6e4a3538ee1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:38.528663 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa944363-cf97-4f76-909c-6e4a3538ee1b None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:38.528943 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa944363-cf97-4f76-909c-6e4a3538ee1b None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:38.529296 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa944363-cf97-4f76-909c-6e4a3538ee1b None admin] PATH_INFO: `/v3/endpoints` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:38.530782 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa944363-cf97-4f76-909c-6e4a3538ee1b None admin] RBAC: Adding query filter params (interface=public, service_id=25e1c4474bcf43019158cd0a9f343bd8, region_id=RegionOne) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:28:38.531131 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa944363-cf97-4f76-909c-6e4a3538ee1b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:38.532506 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa944363-cf97-4f76-909c-6e4a3538ee1b None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:38.538259 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 457/911] 10.222.0.67 () {56 vars in 1251 bytes} [Wed May 25 14:28:38 2022] GET /identity/v3/endpoints?service_id=25e1c4474bcf43019158cd0a9f343bd8&interface=public®ion_id=RegionOne => generated 194 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:28:38.543736 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af83531-bbcd-4f55-86df-e0bbab234d1e None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:38.660678 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af83531-bbcd-4f55-86df-e0bbab234d1e None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:38.672222 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:38.696454 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add23d05-bb93-41ff-be39-06add072b9af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:38.697232 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add23d05-bb93-41ff-be39-06add072b9af None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:38.697447 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add23d05-bb93-41ff-be39-06add072b9af None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:38.697666 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add23d05-bb93-41ff-be39-06add072b9af None admin] PATH_INFO: `/v3/services` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:38.698355 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add23d05-bb93-41ff-be39-06add072b9af None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:38.699742 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add23d05-bb93-41ff-be39-06add072b9af None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:38.708834 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 455/912] 10.222.0.67 () {56 vars in 1087 bytes} [Wed May 25 14:28:38 2022] GET /identity/v3/services => generated 1497 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:28:39.041933 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9443a7-0384-4cac-be80-280551391372 None None] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:39.042443 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9443a7-0384-4cac-be80-280551391372 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:39.042545 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9443a7-0384-4cac-be80-280551391372 None None] PATH_INFO: `/` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:39.044139 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 458/913] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 14:28:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:28:39.049386 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7677f9-1a2d-4369-968d-28f9465e0b98 None None] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:39.049688 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7677f9-1a2d-4369-968d-28f9465e0b98 None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:39.049978 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7677f9-1a2d-4369-968d-28f9465e0b98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:39.068920 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.auth.core [None req-cf7677f9-1a2d-4369-968d-28f9465e0b98 None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:28:39.070123 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-cf7677f9-1a2d-4369-968d-28f9465e0b98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:28:39.150827 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 456/914] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 14:28:39 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 14:28:39.174248 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9443a7-0384-4cac-be80-280551391372 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:39.267784 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:39.290780 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9443a7-0384-4cac-be80-280551391372 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:39.314322 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0438ed0a-b75a-439b-aabf-59130a55a6b0 None None] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:39.314645 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0438ed0a-b75a-439b-aabf-59130a55a6b0 None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:39.314885 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0438ed0a-b75a-439b-aabf-59130a55a6b0 None None] PATH_INFO: `/` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:39.316955 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 457/915] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 14:28:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 14:28:39.323206 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05d2cc5-f990-4159-8cbc-de40a2c2ffef None None] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:39.323737 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05d2cc5-f990-4159-8cbc-de40a2c2ffef None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:39.324230 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05d2cc5-f990-4159-8cbc-de40a2c2ffef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:39.333389 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ea48a0-dfba-40c9-9a73-37258cc6ee65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:39.334253 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ea48a0-dfba-40c9-9a73-37258cc6ee65 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:39.334538 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ea48a0-dfba-40c9-9a73-37258cc6ee65 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:39.334814 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ea48a0-dfba-40c9-9a73-37258cc6ee65 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:39.344403 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.auth.core [None req-a05d2cc5-f990-4159-8cbc-de40a2c2ffef None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:28:39.345927 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-a05d2cc5-f990-4159-8cbc-de40a2c2ffef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:28:39.347821 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ea48a0-dfba-40c9-9a73-37258cc6ee65 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:28:39.358027 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application [None req-e5ea48a0-dfba-40c9-9a73-37258cc6ee65 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 25 14:28:39.358027 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:28:39.358027 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:28:39.358027 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:28:39.358027 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:28:39.358027 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:28:39.358027 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:28:39.358027 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:28:39.358027 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:28:39.358027 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:28:39.358027 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:28:39.358027 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:28:39.358027 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:28:39.358027 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:28:39.358027 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:28:39.358027 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:28:39.359414 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:28:39.359414 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:28:39.359414 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:28:39.359414 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:28:39.359414 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:28:39.359414 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:28:39.359414 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:28:39.359414 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:28:39.359414 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:28:39.359414 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:28:39.359414 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:28:39.359414 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application with Lock( May 25 14:28:39.359414 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:28:39.359414 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._enter() May 25 14:28:39.359414 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:28:39.359414 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:28:39.360326 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:28:39.360326 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.creator() May 25 14:28:39.360326 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:28:39.360326 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application created_value = creator( May 25 14:28:39.360326 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:28:39.360326 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:28:39.360326 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:28:39.360326 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:28:39.360326 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:28:39.360326 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:28:39.360326 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 25 14:28:39.360326 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:28:39.360326 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 459/916] 10.222.0.67 () {56 vars in 1120 bytes} [Wed May 25 14:28:39 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:28:39.371344 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ea48a0-dfba-40c9-9a73-37258cc6ee65 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:39.431203 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 458/917] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 14:28:39 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 25 14:28:39.455613 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05d2cc5-f990-4159-8cbc-de40a2c2ffef None None] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:39.489701 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ea48a0-dfba-40c9-9a73-37258cc6ee65 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:39.494678 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:39.526660 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a4fde9-c7b3-4c63-b2a3-03f9460c4a64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:39.527377 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a4fde9-c7b3-4c63-b2a3-03f9460c4a64 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:39.528124 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a4fde9-c7b3-4c63-b2a3-03f9460c4a64 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:39.528411 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a4fde9-c7b3-4c63-b2a3-03f9460c4a64 None admin] PATH_INFO: `/v3/roles` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:39.529765 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a4fde9-c7b3-4c63-b2a3-03f9460c4a64 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:28:39.530616 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a4fde9-c7b3-4c63-b2a3-03f9460c4a64 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:39.532053 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a4fde9-c7b3-4c63-b2a3-03f9460c4a64 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:39.542095 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 460/918] 10.222.0.67 () {56 vars in 1115 bytes} [Wed May 25 14:28:39 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:28:39.548125 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a4fde9-c7b3-4c63-b2a3-03f9460c4a64 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:39.552961 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:39.582516 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05d2cc5-f990-4159-8cbc-de40a2c2ffef None None] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:39.630151 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ff9cd0-83c7-4dc8-98a9-b095f574ce9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:39.631520 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ff9cd0-83c7-4dc8-98a9-b095f574ce9a None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:39.632769 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ff9cd0-83c7-4dc8-98a9-b095f574ce9a None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:39.633207 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ff9cd0-83c7-4dc8-98a9-b095f574ce9a None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:39.634040 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ff9cd0-83c7-4dc8-98a9-b095f574ce9a None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:39.635712 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ff9cd0-83c7-4dc8-98a9-b095f574ce9a None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:39.652569 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application [None req-60ff9cd0-83c7-4dc8-98a9-b095f574ce9a None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 25 14:28:39.652569 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:28:39.652569 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 14:28:39.652569 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 14:28:39.652569 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 14:28:39.652569 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 14:28:39.652569 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 14:28:39.652569 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 14:28:39.652569 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 25 14:28:39.652569 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application May 25 14:28:39.652569 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 14:28:39.652569 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application May 25 14:28:39.652569 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:28:39.652569 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:28:39.652569 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:28:39.652569 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:28:39.652569 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:28:39.653806 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:28:39.653806 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:28:39.653806 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:28:39.653806 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:28:39.653806 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:28:39.653806 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:28:39.653806 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 14:28:39.653806 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 14:28:39.653806 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 14:28:39.653806 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 14:28:39.653806 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:28:39.653806 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:28:39.653806 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:28:39.653806 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:28:39.653806 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:28:39.653806 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:28:39.654807 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:28:39.654807 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application with Lock( May 25 14:28:39.654807 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:28:39.654807 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self._enter() May 25 14:28:39.654807 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:28:39.654807 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:28:39.654807 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:28:39.654807 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.creator() May 25 14:28:39.654807 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:28:39.654807 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application created_value = creator( May 25 14:28:39.654807 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 14:28:39.654807 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 14:28:39.654807 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 25 14:28:39.654807 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application May 25 14:28:39.656666 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 459/919] 10.222.0.67 () {56 vars in 1114 bytes} [Wed May 25 14:28:39 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 14:28:39.662287 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ff9cd0-83c7-4dc8-98a9-b095f574ce9a None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:39.673882 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a4fde9-c7b3-4c63-b2a3-03f9460c4a64 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:39.719546 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984336cd-75f3-4d12-8ed8-3a3d511d9852 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:39.721253 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984336cd-75f3-4d12-8ed8-3a3d511d9852 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:39.721709 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984336cd-75f3-4d12-8ed8-3a3d511d9852 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:39.722156 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984336cd-75f3-4d12-8ed8-3a3d511d9852 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:39.736861 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984336cd-75f3-4d12-8ed8-3a3d511d9852 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:39.738495 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984336cd-75f3-4d12-8ed8-3a3d511d9852 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:39.766420 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application [None req-984336cd-75f3-4d12-8ed8-3a3d511d9852 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:28:39.766420 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:28:39.766420 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:28:39.766420 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:28:39.766420 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:28:39.766420 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:28:39.766420 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:28:39.766420 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:28:39.766420 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:28:39.766420 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:28:39.766420 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:28:39.766420 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:28:39.766420 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 14:28:39.766420 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 14:28:39.766420 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 14:28:39.767396 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 14:28:39.767396 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:28:39.767396 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:28:39.767396 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:28:39.767396 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:28:39.767396 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:28:39.767396 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:28:39.767396 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:28:39.767396 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application with Lock( May 25 14:28:39.767396 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:28:39.767396 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._enter() May 25 14:28:39.767396 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:28:39.767396 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:28:39.767396 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:28:39.767396 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.creator() May 25 14:28:39.767396 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:28:39.767396 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application created_value = creator( May 25 14:28:39.768294 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 14:28:39.768294 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 14:28:39.768294 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:28:39.768294 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:28:39.775350 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 461/920] 10.222.0.67 () {56 vars in 1108 bytes} [Wed May 25 14:28:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:28:39.776450 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984336cd-75f3-4d12-8ed8-3a3d511d9852 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:39.786407 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:39.791313 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ff9cd0-83c7-4dc8-98a9-b095f574ce9a None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:39.846039 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b36766-6593-44eb-a0a9-523de726214d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:39.847085 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b36766-6593-44eb-a0a9-523de726214d None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:39.847471 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b36766-6593-44eb-a0a9-523de726214d None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:39.847915 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b36766-6593-44eb-a0a9-523de726214d None admin] PATH_INFO: `/v3/services` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:39.848787 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:39.849938 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b36766-6593-44eb-a0a9-523de726214d None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:28:39.850368 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b36766-6593-44eb-a0a9-523de726214d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:39.852108 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b36766-6593-44eb-a0a9-523de726214d None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:39.863168 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 460/921] 10.222.0.67 () {56 vars in 1114 bytes} [Wed May 25 14:28:39 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:28:39.866631 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b36766-6593-44eb-a0a9-523de726214d None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:39.905236 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984336cd-75f3-4d12-8ed8-3a3d511d9852 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:39.942567 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe16767-3cdc-41e6-9ca8-efb398d1404e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:39.943130 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe16767-3cdc-41e6-9ca8-efb398d1404e None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:39.943422 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe16767-3cdc-41e6-9ca8-efb398d1404e None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:39.943704 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe16767-3cdc-41e6-9ca8-efb398d1404e None admin] PATH_INFO: `/v3/domains` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:39.944440 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe16767-3cdc-41e6-9ca8-efb398d1404e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:28:39.944751 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe16767-3cdc-41e6-9ca8-efb398d1404e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:39.946133 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe16767-3cdc-41e6-9ca8-efb398d1404e None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:39.963650 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 462/922] 10.222.0.67 () {56 vars in 1109 bytes} [Wed May 25 14:28:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:28:39.964944 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe16767-3cdc-41e6-9ca8-efb398d1404e None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:40.009015 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b36766-6593-44eb-a0a9-523de726214d None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:40.055766 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e826e05-55ba-47ef-b9b1-d2221f3d4799 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:40.056717 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e826e05-55ba-47ef-b9b1-d2221f3d4799 None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:40.057456 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e826e05-55ba-47ef-b9b1-d2221f3d4799 None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:40.057882 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e826e05-55ba-47ef-b9b1-d2221f3d4799 None admin] PATH_INFO: `/v3/services` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:40.058767 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e826e05-55ba-47ef-b9b1-d2221f3d4799 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:28:40.059242 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e826e05-55ba-47ef-b9b1-d2221f3d4799 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:40.061904 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e826e05-55ba-47ef-b9b1-d2221f3d4799 None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:40.074047 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 461/923] 10.222.0.67 () {56 vars in 1114 bytes} [Wed May 25 14:28:39 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:28:40.074828 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e826e05-55ba-47ef-b9b1-d2221f3d4799 None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:40.079230 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe16767-3cdc-41e6-9ca8-efb398d1404e None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:40.097689 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:40.114720 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:40.118800 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96225135-7775-46d7-8682-ce044ceea61d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:40.119872 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96225135-7775-46d7-8682-ce044ceea61d None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:40.120857 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96225135-7775-46d7-8682-ce044ceea61d None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:40.121214 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96225135-7775-46d7-8682-ce044ceea61d None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:40.130474 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96225135-7775-46d7-8682-ce044ceea61d None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:40.132266 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96225135-7775-46d7-8682-ce044ceea61d None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:40.149195 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application [None req-96225135-7775-46d7-8682-ce044ceea61d None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 25 14:28:40.149195 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:28:40.149195 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:28:40.149195 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:28:40.149195 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:28:40.149195 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:28:40.149195 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:28:40.149195 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:28:40.149195 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:28:40.149195 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:28:40.149195 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:28:40.149195 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:28:40.149195 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 14:28:40.149195 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 14:28:40.149195 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 14:28:40.149195 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 14:28:40.150179 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:28:40.150179 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:28:40.150179 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 14:28:40.150179 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 14:28:40.150179 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 14:28:40.150179 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 14:28:40.150179 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:28:40.150179 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:28:40.150179 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:28:40.150179 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:28:40.150179 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:28:40.150179 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application with Lock( May 25 14:28:40.150179 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:28:40.150179 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._enter() May 25 14:28:40.150179 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:28:40.150179 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:28:40.150179 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:28:40.150179 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.creator() May 25 14:28:40.151153 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:28:40.151153 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application created_value = creator( May 25 14:28:40.151153 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 14:28:40.151153 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 14:28:40.151153 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 14:28:40.151153 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 14:28:40.151153 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 14:28:40.151153 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 14:28:40.151153 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 25 14:28:40.151153 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:28:40.155727 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 463/924] 10.222.0.67 () {56 vars in 1117 bytes} [Wed May 25 14:28:39 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:28:40.156955 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96225135-7775-46d7-8682-ce044ceea61d None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:40.206259 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e826e05-55ba-47ef-b9b1-d2221f3d4799 None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:40.242494 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb8527b-844f-4630-a0b6-2cfdce748262 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:40.243772 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb8527b-844f-4630-a0b6-2cfdce748262 None admin] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:40.243772 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb8527b-844f-4630-a0b6-2cfdce748262 None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:40.243973 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb8527b-844f-4630-a0b6-2cfdce748262 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:40.244768 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb8527b-844f-4630-a0b6-2cfdce748262 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:40.246219 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb8527b-844f-4630-a0b6-2cfdce748262 None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:40.275016 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 462/925] 10.222.0.67 () {60 vars in 1144 bytes} [Wed May 25 14:28:40 2022] POST /identity/v3/endpoints => generated 346 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:28:40.289137 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96225135-7775-46d7-8682-ce044ceea61d None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:40.336637 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e9a8ab-9930-4589-9b34-b807e616b610 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:40.337314 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e9a8ab-9930-4589-9b34-b807e616b610 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:40.337601 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e9a8ab-9930-4589-9b34-b807e616b610 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:40.337878 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e9a8ab-9930-4589-9b34-b807e616b610 None admin] PATH_INFO: `/v3/users` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:40.338788 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e9a8ab-9930-4589-9b34-b807e616b610 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:28:40.339193 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e9a8ab-9930-4589-9b34-b807e616b610 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:40.340718 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e9a8ab-9930-4589-9b34-b807e616b610 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:40.361969 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 464/926] 10.222.0.67 () {56 vars in 1149 bytes} [Wed May 25 14:28:40 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:28:40.367786 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb8527b-844f-4630-a0b6-2cfdce748262 None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:40.470653 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:40.491370 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb8527b-844f-4630-a0b6-2cfdce748262 None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:40.529902 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10bd135-dc23-4f47-a8fa-22b43bb62804 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:40.530699 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10bd135-dc23-4f47-a8fa-22b43bb62804 None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:40.531062 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10bd135-dc23-4f47-a8fa-22b43bb62804 None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:40.531298 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10bd135-dc23-4f47-a8fa-22b43bb62804 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:40.543689 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10bd135-dc23-4f47-a8fa-22b43bb62804 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:40.545916 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10bd135-dc23-4f47-a8fa-22b43bb62804 None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:40.566245 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application [None req-e10bd135-dc23-4f47-a8fa-22b43bb62804 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:28:40.566245 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:28:40.566245 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:28:40.566245 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:28:40.566245 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:28:40.566245 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:28:40.566245 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:28:40.566245 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:28:40.566245 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:28:40.566245 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:28:40.566245 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:28:40.566245 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:28:40.566245 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 14:28:40.566245 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 14:28:40.566245 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 14:28:40.567260 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 14:28:40.567260 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:28:40.567260 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:28:40.567260 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:28:40.567260 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:28:40.567260 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:28:40.567260 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:28:40.567260 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:28:40.567260 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application with Lock( May 25 14:28:40.567260 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:28:40.567260 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self._enter() May 25 14:28:40.567260 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:28:40.567260 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:28:40.567260 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:28:40.567260 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.creator() May 25 14:28:40.567260 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:28:40.567260 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application created_value = creator( May 25 14:28:40.568192 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 14:28:40.568192 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 14:28:40.568192 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:28:40.568192 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application May 25 14:28:40.570618 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 463/927] 10.222.0.67 () {56 vars in 1108 bytes} [Wed May 25 14:28:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:28:40.577335 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e9a8ab-9930-4589-9b34-b807e616b610 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:40.610619 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:40.618102 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582d867a-3aee-4c3a-9fc4-d920cc73cb78 None None] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:40.618400 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582d867a-3aee-4c3a-9fc4-d920cc73cb78 None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:40.618735 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582d867a-3aee-4c3a-9fc4-d920cc73cb78 None None] PATH_INFO: `/` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:40.620695 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 464/928] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 14:28:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:28:40.628818 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90089339-0d5d-4d77-ab05-e4c08731638f None None] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:40.629240 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90089339-0d5d-4d77-ab05-e4c08731638f None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:40.629621 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90089339-0d5d-4d77-ab05-e4c08731638f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:40.647305 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.auth.core [None req-90089339-0d5d-4d77-ab05-e4c08731638f None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:28:40.648608 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-90089339-0d5d-4d77-ab05-e4c08731638f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:28:40.696284 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e9a8ab-9930-4589-9b34-b807e616b610 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:40.731112 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 465/929] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 14:28:40 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 14:28:40.739755 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fec2096-3f84-4461-be18-8a1a7b4eb543 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:40.740718 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fec2096-3f84-4461-be18-8a1a7b4eb543 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:40.741184 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fec2096-3f84-4461-be18-8a1a7b4eb543 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:40.741636 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fec2096-3f84-4461-be18-8a1a7b4eb543 None admin] PATH_INFO: `/v3/domains` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:40.742616 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fec2096-3f84-4461-be18-8a1a7b4eb543 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:28:40.743129 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fec2096-3f84-4461-be18-8a1a7b4eb543 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:40.744706 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fec2096-3f84-4461-be18-8a1a7b4eb543 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:40.753901 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90089339-0d5d-4d77-ab05-e4c08731638f None None] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:40.760468 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 465/930] 10.222.0.67 () {56 vars in 1109 bytes} [Wed May 25 14:28:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:28:40.766517 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fec2096-3f84-4461-be18-8a1a7b4eb543 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:40.840345 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:40.885315 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90089339-0d5d-4d77-ab05-e4c08731638f None None] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:40.903407 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:40.919577 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fec2096-3f84-4461-be18-8a1a7b4eb543 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:40.925969 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67301a2-2abd-485c-8b4b-63a332ad779e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:40.926802 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67301a2-2abd-485c-8b4b-63a332ad779e None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:40.927116 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67301a2-2abd-485c-8b4b-63a332ad779e None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:40.927397 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67301a2-2abd-485c-8b4b-63a332ad779e None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:40.928066 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67301a2-2abd-485c-8b4b-63a332ad779e None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:40.929439 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67301a2-2abd-485c-8b4b-63a332ad779e None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:40.942629 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application [None req-d67301a2-2abd-485c-8b4b-63a332ad779e None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 25 14:28:40.942629 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:28:40.942629 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 14:28:40.942629 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 14:28:40.942629 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 14:28:40.942629 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 14:28:40.942629 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 14:28:40.942629 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 14:28:40.942629 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 25 14:28:40.942629 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application May 25 14:28:40.942629 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 14:28:40.942629 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application May 25 14:28:40.942629 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:28:40.942629 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:28:40.942629 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:28:40.942629 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:28:40.942629 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:28:40.943716 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:28:40.943716 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:28:40.943716 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:28:40.943716 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:28:40.943716 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:28:40.943716 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:28:40.943716 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 14:28:40.943716 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 14:28:40.943716 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 14:28:40.943716 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 14:28:40.943716 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:28:40.943716 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:28:40.943716 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:28:40.943716 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:28:40.943716 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:28:40.943716 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:28:40.944578 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:28:40.944578 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application with Lock( May 25 14:28:40.944578 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:28:40.944578 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self._enter() May 25 14:28:40.944578 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:28:40.944578 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:28:40.944578 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:28:40.944578 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.creator() May 25 14:28:40.944578 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:28:40.944578 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application created_value = creator( May 25 14:28:40.944578 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 14:28:40.944578 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 14:28:40.944578 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 25 14:28:40.944578 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application May 25 14:28:40.948907 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 466/931] 10.222.0.67 () {56 vars in 1126 bytes} [Wed May 25 14:28:40 2022] GET /identity/v3/services/object-store => generated 93 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 14:28:40.949915 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67301a2-2abd-485c-8b4b-63a332ad779e None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:40.969784 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b769210d-41e5-49fe-bdb5-e7e08d46d691 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:40.971248 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b769210d-41e5-49fe-bdb5-e7e08d46d691 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:40.972137 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b769210d-41e5-49fe-bdb5-e7e08d46d691 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:40.972597 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b769210d-41e5-49fe-bdb5-e7e08d46d691 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:40.982345 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b769210d-41e5-49fe-bdb5-e7e08d46d691 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:40.984950 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b769210d-41e5-49fe-bdb5-e7e08d46d691 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:41.005705 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application [None req-b769210d-41e5-49fe-bdb5-e7e08d46d691 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 14:28:41.005705 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:28:41.005705 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:28:41.005705 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:28:41.005705 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:28:41.005705 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:28:41.005705 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:28:41.005705 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:28:41.005705 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:28:41.005705 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:28:41.005705 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:28:41.005705 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:28:41.005705 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 14:28:41.005705 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 14:28:41.005705 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 14:28:41.006714 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 14:28:41.006714 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:28:41.006714 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:28:41.006714 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:28:41.006714 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:28:41.006714 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:28:41.006714 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:28:41.006714 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:28:41.006714 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application with Lock( May 25 14:28:41.006714 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:28:41.006714 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._enter() May 25 14:28:41.006714 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:28:41.006714 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:28:41.006714 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:28:41.006714 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.creator() May 25 14:28:41.006714 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:28:41.006714 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application created_value = creator( May 25 14:28:41.007682 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 14:28:41.007682 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 14:28:41.007682 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 14:28:41.007682 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 14:28:41.007682 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 14:28:41.007682 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 14:28:41.007682 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 14:28:41.007682 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:28:41.013331 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 466/932] 10.222.0.67 () {56 vars in 1111 bytes} [Wed May 25 14:28:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:28:41.015170 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b769210d-41e5-49fe-bdb5-e7e08d46d691 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:41.079931 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67301a2-2abd-485c-8b4b-63a332ad779e None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:41.109055 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:41.118372 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3f27e0-e003-4d40-88ad-2d0d9c930a6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:41.119062 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3f27e0-e003-4d40-88ad-2d0d9c930a6b None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:41.119354 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3f27e0-e003-4d40-88ad-2d0d9c930a6b None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:41.119633 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3f27e0-e003-4d40-88ad-2d0d9c930a6b None admin] PATH_INFO: `/v3/services` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:41.120340 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3f27e0-e003-4d40-88ad-2d0d9c930a6b None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:28:41.120649 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3f27e0-e003-4d40-88ad-2d0d9c930a6b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:41.122192 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b769210d-41e5-49fe-bdb5-e7e08d46d691 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:41.122632 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3f27e0-e003-4d40-88ad-2d0d9c930a6b None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:41.128002 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 467/933] 10.222.0.67 () {56 vars in 1122 bytes} [Wed May 25 14:28:40 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:28:41.129274 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44470119-4004-43b3-ab75-df67f45ccf10 None None] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:41.129564 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44470119-4004-43b3-ab75-df67f45ccf10 None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:41.129844 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44470119-4004-43b3-ab75-df67f45ccf10 None None] PATH_INFO: `/` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:41.135209 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 468/934] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 14:28:41 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:28:41.136014 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44470119-4004-43b3-ab75-df67f45ccf10 None None] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:41.170535 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc860d28-2aca-4ead-9409-be2274bca820 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:41.171440 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc860d28-2aca-4ead-9409-be2274bca820 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:41.171573 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc860d28-2aca-4ead-9409-be2274bca820 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:41.171777 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc860d28-2aca-4ead-9409-be2274bca820 None admin] PATH_INFO: `/v3/projects` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:41.172579 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc860d28-2aca-4ead-9409-be2274bca820 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:28:41.172892 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc860d28-2aca-4ead-9409-be2274bca820 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:41.174345 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc860d28-2aca-4ead-9409-be2274bca820 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:41.192159 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 467/935] 10.222.0.67 () {56 vars in 1148 bytes} [Wed May 25 14:28:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:28:41.192159 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7f0025-45b8-4c9a-baf5-7b48dc0329af None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:41.192159 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7f0025-45b8-4c9a-baf5-7b48dc0329af None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:41.192159 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7f0025-45b8-4c9a-baf5-7b48dc0329af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:41.208938 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-dd7f0025-45b8-4c9a-baf5-7b48dc0329af None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:28:41.210133 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-dd7f0025-45b8-4c9a-baf5-7b48dc0329af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:28:41.213197 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:41.253340 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44470119-4004-43b3-ab75-df67f45ccf10 None None] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:41.284591 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 468/936] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 14:28:41 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 14:28:41.285323 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7f0025-45b8-4c9a-baf5-7b48dc0329af None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:41.302930 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1716db74-8d8c-4457-b902-787fedf87343 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:41.304430 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1716db74-8d8c-4457-b902-787fedf87343 None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:41.304976 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1716db74-8d8c-4457-b902-787fedf87343 None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:41.305461 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1716db74-8d8c-4457-b902-787fedf87343 None admin] PATH_INFO: `/v3/services` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:41.306983 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1716db74-8d8c-4457-b902-787fedf87343 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:28:41.307356 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1716db74-8d8c-4457-b902-787fedf87343 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:41.309068 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1716db74-8d8c-4457-b902-787fedf87343 None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:41.318403 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 469/937] 10.222.0.67 () {56 vars in 1122 bytes} [Wed May 25 14:28:41 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:28:41.319529 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1716db74-8d8c-4457-b902-787fedf87343 None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:41.382611 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:41.399317 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7f0025-45b8-4c9a-baf5-7b48dc0329af None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:41.430466 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1716db74-8d8c-4457-b902-787fedf87343 None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:41.436531 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45eef7d-7efd-4f4a-a7ab-16776ca97a4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:41.437424 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45eef7d-7efd-4f4a-a7ab-16776ca97a4f None admin] REQUEST_METHOD: `PUT` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:41.437710 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45eef7d-7efd-4f4a-a7ab-16776ca97a4f None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:41.438115 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45eef7d-7efd-4f4a-a7ab-16776ca97a4f None admin] PATH_INFO: `/v3/projects/bfe93ee8d32a441295efc0b885de4bd7/users/e03f5bb82ffb41a1b1dde935d093e6f4/roles/a45d5a067e824fa18ca4428cff2a3889` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:41.440506 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45eef7d-7efd-4f4a-a7ab-16776ca97a4f None admin] RBAC: Authorizing `identity:create_grant(project_id=bfe93ee8d32a441295efc0b885de4bd7, user_id=e03f5bb82ffb41a1b1dde935d093e6f4, role_id=a45d5a067e824fa18ca4428cff2a3889)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:41.442099 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45eef7d-7efd-4f4a-a7ab-16776ca97a4f None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:41.454371 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:41.462071 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 469/938] 10.222.0.67 () {58 vars in 1439 bytes} [Wed May 25 14:28:41 2022] PUT /identity/v3/projects/bfe93ee8d32a441295efc0b885de4bd7/users/e03f5bb82ffb41a1b1dde935d093e6f4/roles/a45d5a067e824fa18ca4428cff2a3889 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:28:41.462946 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45eef7d-7efd-4f4a-a7ab-16776ca97a4f None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:41.484131 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8955b591-1b4c-416f-bf86-322e726d864c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:41.484642 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8955b591-1b4c-416f-bf86-322e726d864c None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:41.484987 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8955b591-1b4c-416f-bf86-322e726d864c None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:41.485272 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8955b591-1b4c-416f-bf86-322e726d864c None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:41.486015 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8955b591-1b4c-416f-bf86-322e726d864c None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:41.487531 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8955b591-1b4c-416f-bf86-322e726d864c None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:41.502856 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application [None req-8955b591-1b4c-416f-bf86-322e726d864c None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 25 14:28:41.502856 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:28:41.502856 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 14:28:41.502856 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 14:28:41.502856 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 14:28:41.502856 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 14:28:41.502856 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 14:28:41.502856 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 14:28:41.502856 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 25 14:28:41.502856 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application May 25 14:28:41.502856 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 14:28:41.502856 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application May 25 14:28:41.502856 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:28:41.502856 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:28:41.502856 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:28:41.502856 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:28:41.504100 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:28:41.504100 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:28:41.504100 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:28:41.504100 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:28:41.504100 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:28:41.504100 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:28:41.504100 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:28:41.504100 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 14:28:41.504100 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 14:28:41.504100 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 14:28:41.504100 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 14:28:41.504100 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:28:41.504100 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:28:41.504100 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:28:41.504100 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:28:41.504100 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:28:41.504989 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:28:41.504989 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:28:41.504989 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application with Lock( May 25 14:28:41.504989 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:28:41.504989 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self._enter() May 25 14:28:41.504989 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:28:41.504989 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:28:41.504989 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:28:41.504989 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.creator() May 25 14:28:41.504989 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:28:41.504989 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application created_value = creator( May 25 14:28:41.504989 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 14:28:41.504989 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 14:28:41.504989 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 25 14:28:41.504989 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application May 25 14:28:41.509455 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 470/939] 10.222.0.67 () {56 vars in 1132 bytes} [Wed May 25 14:28:41 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:28:41.510851 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8955b591-1b4c-416f-bf86-322e726d864c None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:41.606589 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45eef7d-7efd-4f4a-a7ab-16776ca97a4f None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:41.653739 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68ad0ae-4a8f-42ca-8e11-f69b982da2a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:41.654902 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68ad0ae-4a8f-42ca-8e11-f69b982da2a2 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:41.655323 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68ad0ae-4a8f-42ca-8e11-f69b982da2a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:41.655598 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68ad0ae-4a8f-42ca-8e11-f69b982da2a2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:41.656410 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68ad0ae-4a8f-42ca-8e11-f69b982da2a2 None admin] RBAC: Adding query filter params (interface=public, service_id=3c432d03d5154e4b998fd63282c8f97c, region_id=RegionOne) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:28:41.656720 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68ad0ae-4a8f-42ca-8e11-f69b982da2a2 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:41.657107 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8955b591-1b4c-416f-bf86-322e726d864c None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:41.658240 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68ad0ae-4a8f-42ca-8e11-f69b982da2a2 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:41.669548 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 470/940] 10.222.0.67 () {56 vars in 1251 bytes} [Wed May 25 14:28:41 2022] GET /identity/v3/endpoints?service_id=3c432d03d5154e4b998fd63282c8f97c&interface=public®ion_id=RegionOne => generated 194 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:28:41.671268 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68ad0ae-4a8f-42ca-8e11-f69b982da2a2 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:41.688504 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:41.705210 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d09858-8b34-4fd7-bf70-f945788d66c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:41.705993 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d09858-8b34-4fd7-bf70-f945788d66c7 None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:41.706335 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d09858-8b34-4fd7-bf70-f945788d66c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:41.706818 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d09858-8b34-4fd7-bf70-f945788d66c7 None admin] PATH_INFO: `/v3/services` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:41.707494 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d09858-8b34-4fd7-bf70-f945788d66c7 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:28:41.707783 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d09858-8b34-4fd7-bf70-f945788d66c7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:41.709361 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d09858-8b34-4fd7-bf70-f945788d66c7 None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:41.719227 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 471/941] 10.222.0.67 () {56 vars in 1126 bytes} [Wed May 25 14:28:41 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:28:41.721322 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d09858-8b34-4fd7-bf70-f945788d66c7 None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:41.755897 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:41.797596 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68ad0ae-4a8f-42ca-8e11-f69b982da2a2 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:41.840863 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459d6c45-d5c4-494b-a228-c03281218744 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:41.842291 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459d6c45-d5c4-494b-a228-c03281218744 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:41.842752 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459d6c45-d5c4-494b-a228-c03281218744 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:41.843231 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459d6c45-d5c4-494b-a228-c03281218744 None admin] PATH_INFO: `/v3/services` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:41.844094 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459d6c45-d5c4-494b-a228-c03281218744 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:41.845686 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459d6c45-d5c4-494b-a228-c03281218744 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:41.856106 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 471/942] 10.222.0.67 () {56 vars in 1087 bytes} [Wed May 25 14:28:41 2022] GET /identity/v3/services => generated 1497 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:28:41.857967 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d09858-8b34-4fd7-bf70-f945788d66c7 None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:41.902792 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c357f9-c7fa-4415-abff-5803b4977020 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:41.904014 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c357f9-c7fa-4415-abff-5803b4977020 None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:41.905147 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c357f9-c7fa-4415-abff-5803b4977020 None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:41.905612 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c357f9-c7fa-4415-abff-5803b4977020 None admin] PATH_INFO: `/v3/services` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:41.906581 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c357f9-c7fa-4415-abff-5803b4977020 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:28:41.907092 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c357f9-c7fa-4415-abff-5803b4977020 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:41.908654 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c357f9-c7fa-4415-abff-5803b4977020 None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:41.915425 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 472/943] 10.222.0.67 () {56 vars in 1126 bytes} [Wed May 25 14:28:41 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:28:41.925390 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459d6c45-d5c4-494b-a228-c03281218744 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:42.045827 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459d6c45-d5c4-494b-a228-c03281218744 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:42.075517 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:42.086009 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225e10e7-dbec-498c-acc8-7744dee148eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:42.086683 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225e10e7-dbec-498c-acc8-7744dee148eb None admin] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:42.086969 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225e10e7-dbec-498c-acc8-7744dee148eb None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:42.087277 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225e10e7-dbec-498c-acc8-7744dee148eb None admin] PATH_INFO: `/v3/endpoints` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:42.088033 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225e10e7-dbec-498c-acc8-7744dee148eb None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:42.089420 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225e10e7-dbec-498c-acc8-7744dee148eb None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:42.111054 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 472/944] 10.222.0.67 () {60 vars in 1144 bytes} [Wed May 25 14:28:41 2022] POST /identity/v3/endpoints => generated 347 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:28:42.707651 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629db7cf-6408-4c0a-87e9-55cdf0507932 None None] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:42.708029 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629db7cf-6408-4c0a-87e9-55cdf0507932 None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:42.708244 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629db7cf-6408-4c0a-87e9-55cdf0507932 None None] PATH_INFO: `/` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:42.709967 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 473/945] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 14:28:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:28:42.715581 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b86dd1-3965-4728-a26f-1bb8334fe607 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:42.716015 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b86dd1-3965-4728-a26f-1bb8334fe607 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:42.716190 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b86dd1-3965-4728-a26f-1bb8334fe607 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:42.734653 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-b1b86dd1-3965-4728-a26f-1bb8334fe607 None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:28:42.735874 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-b1b86dd1-3965-4728-a26f-1bb8334fe607 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:28:42.819106 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 473/946] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 14:28:42 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 25 14:28:42.838396 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629db7cf-6408-4c0a-87e9-55cdf0507932 None None] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:42.897481 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:42.952593 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629db7cf-6408-4c0a-87e9-55cdf0507932 None None] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:42.988052 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4861a952-5d7a-40bd-a781-84ff757bd31d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:42.988642 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4861a952-5d7a-40bd-a781-84ff757bd31d None admin] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:42.988932 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4861a952-5d7a-40bd-a781-84ff757bd31d None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:42.989215 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4861a952-5d7a-40bd-a781-84ff757bd31d None admin] PATH_INFO: `/v3/projects` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:42.989939 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4861a952-5d7a-40bd-a781-84ff757bd31d None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:42.991403 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4861a952-5d7a-40bd-a781-84ff757bd31d None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:42.992772 dv-cinder-787296-9-smb devstack@keystone.service[80474]: WARNING keystone.server.flask.common [None req-4861a952-5d7a-40bd-a781-84ff757bd31d None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. May 25 14:28:43.013582 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.sql.core [None req-4861a952-5d7a-40bd-a781-84ff757bd31d None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 25 14:28:43.013582 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 25 14:28:43.013582 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [parameters: {'id': '5e4af324c9674c7e9937ebf88cc3127d', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 25 14:28:43.013582 dv-cinder-787296-9-smb devstack@keystone.service[80474]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80474) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 25 14:28:43.036849 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application [None req-4861a952-5d7a-40bd-a781-84ff757bd31d None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 5e4af324c9674c7e9937ebf88cc3127d.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 5e4af324c9674c7e9937ebf88cc3127d. May 25 14:28:43.036849 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:28:43.036849 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 25 14:28:43.036849 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application self.dialect.do_execute( May 25 14:28:43.036849 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 25 14:28:43.036849 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 25 14:28:43.036849 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 25 14:28:43.036849 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application result = self._query(query) May 25 14:28:43.036849 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 25 14:28:43.036849 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application conn.query(q) May 25 14:28:43.036849 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 25 14:28:43.036849 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 25 14:28:43.036849 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 25 14:28:43.037739 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application result.read() May 25 14:28:43.037739 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 25 14:28:43.037739 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 25 14:28:43.037739 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 25 14:28:43.037739 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application packet.raise_for_error() May 25 14:28:43.037739 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 25 14:28:43.037739 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 25 14:28:43.037739 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 25 14:28:43.037739 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 25 14:28:43.037739 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 25 14:28:43.037739 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application May 25 14:28:43.037739 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 25 14:28:43.037739 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application May 25 14:28:43.037739 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:28:43.037739 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 25 14:28:43.037739 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 25 14:28:43.037739 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project May 25 14:28:43.037739 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return project_ref.to_dict() May 25 14:28:43.038760 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 25 14:28:43.038760 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application next(self.gen) May 25 14:28:43.038760 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 25 14:28:43.038760 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application yield resource May 25 14:28:43.038760 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 25 14:28:43.038760 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application next(self.gen) May 25 14:28:43.038760 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 25 14:28:43.038760 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application self.session.rollback() May 25 14:28:43.038760 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 25 14:28:43.038760 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application self.force_reraise() May 25 14:28:43.038760 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 25 14:28:43.038760 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application raise self.value May 25 14:28:43.038760 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 25 14:28:43.038760 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 25 14:28:43.038760 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 25 14:28:43.038760 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application session.commit() May 25 14:28:43.038760 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 25 14:28:43.039714 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 25 14:28:43.039714 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 25 14:28:43.039714 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application self._prepare_impl() May 25 14:28:43.039714 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 25 14:28:43.039714 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application self.session.flush() May 25 14:28:43.039714 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 25 14:28:43.039714 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application self._flush(objects) May 25 14:28:43.039714 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 25 14:28:43.039714 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 25 14:28:43.039714 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 25 14:28:43.039714 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application compat.raise_( May 25 14:28:43.039714 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 25 14:28:43.039714 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application raise exception May 25 14:28:43.039714 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 25 14:28:43.039714 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application flush_context.execute() May 25 14:28:43.039714 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 25 14:28:43.039714 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application rec.execute(self) May 25 14:28:43.040700 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 25 14:28:43.040700 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 25 14:28:43.040700 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 25 14:28:43.040700 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application _emit_insert_statements( May 25 14:28:43.040700 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 25 14:28:43.040700 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application c = connection._execute_20( May 25 14:28:43.040700 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 25 14:28:43.040700 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 25 14:28:43.040700 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 25 14:28:43.040700 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 25 14:28:43.040700 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 25 14:28:43.040700 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application ret = self._execute_context( May 25 14:28:43.040700 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 25 14:28:43.040700 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 25 14:28:43.040700 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 25 14:28:43.041512 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 25 14:28:43.041512 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 25 14:28:43.041512 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application raise exception May 25 14:28:43.041512 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 25 14:28:43.041512 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application self.dialect.do_execute( May 25 14:28:43.041512 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 25 14:28:43.041512 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 25 14:28:43.041512 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 25 14:28:43.041512 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application result = self._query(query) May 25 14:28:43.041512 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 25 14:28:43.041512 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application conn.query(q) May 25 14:28:43.041512 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 25 14:28:43.041512 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 25 14:28:43.041512 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 25 14:28:43.041512 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application result.read() May 25 14:28:43.041512 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 25 14:28:43.041512 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 25 14:28:43.042386 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 25 14:28:43.042386 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application packet.raise_for_error() May 25 14:28:43.042386 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 25 14:28:43.042386 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 25 14:28:43.042386 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 25 14:28:43.042386 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 25 14:28:43.042386 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 25 14:28:43.042386 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 25 14:28:43.042386 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application [parameters: {'id': '5e4af324c9674c7e9937ebf88cc3127d', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 25 14:28:43.042386 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 25 14:28:43.042386 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application May 25 14:28:43.042386 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 14:28:43.042386 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application May 25 14:28:43.042386 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:28:43.042386 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project May 25 14:28:43.047594 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) May 25 14:28:43.047594 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 25 14:28:43.047594 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 25 14:28:43.047594 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. May 25 14:28:43.047594 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application May 25 14:28:43.047594 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 14:28:43.047594 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application May 25 14:28:43.047594 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:28:43.047594 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:28:43.047594 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:28:43.047594 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:28:43.047594 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:28:43.047594 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:28:43.047594 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:28:43.047594 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:28:43.047594 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:28:43.047594 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:28:43.048578 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:28:43.048578 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post May 25 14:28:43.048578 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( May 25 14:28:43.048578 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:28:43.048578 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:28:43.048578 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project May 25 14:28:43.048578 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application raise exception.Conflict( May 25 14:28:43.048578 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 5e4af324c9674c7e9937ebf88cc3127d. May 25 14:28:43.048578 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application May 25 14:28:43.048578 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 474/947] 10.222.0.67 () {60 vars in 1140 bytes} [Wed May 25 14:28:42 2022] POST /identity/v3/projects => generated 262 bytes in 201 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) May 25 14:28:43.050400 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b86dd1-3965-4728-a26f-1bb8334fe607 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:43.158654 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b86dd1-3965-4728-a26f-1bb8334fe607 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:43.170740 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:43.197186 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db86926-938f-47db-9bf8-dc65ac082edf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:43.197984 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db86926-938f-47db-9bf8-dc65ac082edf None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:43.198265 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db86926-938f-47db-9bf8-dc65ac082edf None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:43.198538 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db86926-938f-47db-9bf8-dc65ac082edf None admin] PATH_INFO: `/v3/projects/service` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:43.205985 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db86926-938f-47db-9bf8-dc65ac082edf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:43.207455 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db86926-938f-47db-9bf8-dc65ac082edf None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:43.221806 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application [None req-3db86926-938f-47db-9bf8-dc65ac082edf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 14:28:43.221806 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:28:43.221806 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:28:43.221806 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:28:43.221806 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:28:43.221806 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:28:43.221806 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:28:43.221806 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:28:43.221806 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:28:43.221806 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:28:43.221806 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:28:43.221806 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:28:43.221806 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 14:28:43.221806 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 14:28:43.221806 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 14:28:43.222877 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 14:28:43.222877 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:28:43.222877 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:28:43.222877 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:28:43.222877 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:28:43.222877 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:28:43.222877 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:28:43.222877 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:28:43.222877 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application with Lock( May 25 14:28:43.222877 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:28:43.222877 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._enter() May 25 14:28:43.222877 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:28:43.222877 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:28:43.222877 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:28:43.222877 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.creator() May 25 14:28:43.222877 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:28:43.222877 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application created_value = creator( May 25 14:28:43.224124 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 14:28:43.224124 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 14:28:43.224124 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 14:28:43.224124 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 14:28:43.224124 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 14:28:43.224124 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 14:28:43.224124 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 14:28:43.224124 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:28:43.224124 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 474/948] 10.222.0.67 () {56 vars in 1111 bytes} [Wed May 25 14:28:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:28:43.230887 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4861a952-5d7a-40bd-a781-84ff757bd31d None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:43.344687 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4861a952-5d7a-40bd-a781-84ff757bd31d None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:43.355530 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:43.382964 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07cdd74-57c0-4232-80a4-8b52c3a1177a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:43.383698 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07cdd74-57c0-4232-80a4-8b52c3a1177a None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:43.383984 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07cdd74-57c0-4232-80a4-8b52c3a1177a None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:43.384316 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07cdd74-57c0-4232-80a4-8b52c3a1177a None admin] PATH_INFO: `/v3/projects` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:43.385095 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07cdd74-57c0-4232-80a4-8b52c3a1177a None admin] RBAC: Adding query filter params (name=service) {{(pid=80474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:28:43.385409 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07cdd74-57c0-4232-80a4-8b52c3a1177a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:43.387084 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07cdd74-57c0-4232-80a4-8b52c3a1177a None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:43.413363 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 475/949] 10.222.0.67 () {56 vars in 1112 bytes} [Wed May 25 14:28:43 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:28:43.819165 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4386954-2cea-4514-ac02-b9e7de37ff26 None None] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:43.819690 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4386954-2cea-4514-ac02-b9e7de37ff26 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:43.819690 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4386954-2cea-4514-ac02-b9e7de37ff26 None None] PATH_INFO: `/` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:43.821302 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 475/950] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 14:28:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:28:43.827538 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5631ff1-5445-4d90-b8e8-4869ff31c278 None None] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:43.827834 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5631ff1-5445-4d90-b8e8-4869ff31c278 None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:43.828113 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5631ff1-5445-4d90-b8e8-4869ff31c278 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:43.851802 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.auth.core [None req-f5631ff1-5445-4d90-b8e8-4869ff31c278 None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:28:43.853319 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-f5631ff1-5445-4d90-b8e8-4869ff31c278 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:28:43.926044 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 476/951] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 14:28:43 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 14:28:43.949264 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4386954-2cea-4514-ac02-b9e7de37ff26 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:44.066419 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4386954-2cea-4514-ac02-b9e7de37ff26 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:44.102596 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822da963-fd17-47e0-b64e-1a92404b30f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:44.103364 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822da963-fd17-47e0-b64e-1a92404b30f4 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:44.103647 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822da963-fd17-47e0-b64e-1a92404b30f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:44.103921 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822da963-fd17-47e0-b64e-1a92404b30f4 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:44.115257 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822da963-fd17-47e0-b64e-1a92404b30f4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:28:44.124378 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application [None req-822da963-fd17-47e0-b64e-1a92404b30f4 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 25 14:28:44.124378 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:28:44.124378 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:28:44.124378 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:28:44.124378 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:28:44.124378 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:28:44.124378 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:28:44.124378 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:28:44.124378 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:28:44.124378 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:28:44.124378 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:28:44.124378 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:28:44.124378 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:28:44.124378 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:28:44.124378 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:28:44.124378 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:28:44.125499 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:28:44.125499 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:28:44.125499 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:28:44.125499 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:28:44.125499 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:28:44.125499 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:28:44.125499 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:28:44.125499 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:28:44.125499 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:28:44.125499 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:28:44.125499 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:28:44.125499 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application with Lock( May 25 14:28:44.125499 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:28:44.125499 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._enter() May 25 14:28:44.125499 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:28:44.125499 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:28:44.127063 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:28:44.127063 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.creator() May 25 14:28:44.127063 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:28:44.127063 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application created_value = creator( May 25 14:28:44.127063 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:28:44.127063 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:28:44.127063 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:28:44.127063 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:28:44.127063 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:28:44.127063 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:28:44.127063 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 25 14:28:44.127063 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:28:44.127063 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 476/952] 10.222.0.67 () {56 vars in 1120 bytes} [Wed May 25 14:28:43 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:28:44.131818 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5631ff1-5445-4d90-b8e8-4869ff31c278 None None] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:44.221081 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e69a4aa-3056-4a5a-b8a5-57557bb41bd6 None None] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:44.221413 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e69a4aa-3056-4a5a-b8a5-57557bb41bd6 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:44.221642 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e69a4aa-3056-4a5a-b8a5-57557bb41bd6 None None] PATH_INFO: `/` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:44.223307 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 477/953] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 14:28:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 14:28:44.228404 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e5c03e-7575-4bce-9377-32cfbcf30cda None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:44.228691 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e5c03e-7575-4bce-9377-32cfbcf30cda None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:44.228968 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e5c03e-7575-4bce-9377-32cfbcf30cda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:44.230100 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:44.239592 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5631ff1-5445-4d90-b8e8-4869ff31c278 None None] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:44.247049 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-21e5c03e-7575-4bce-9377-32cfbcf30cda None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:28:44.249303 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-21e5c03e-7575-4bce-9377-32cfbcf30cda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:28:44.275903 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:44.286150 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df43cd7-6138-4d86-962d-a2e142c5f9a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:44.286830 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df43cd7-6138-4d86-962d-a2e142c5f9a6 None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:44.287220 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df43cd7-6138-4d86-962d-a2e142c5f9a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:44.287499 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df43cd7-6138-4d86-962d-a2e142c5f9a6 None admin] PATH_INFO: `/v3/roles` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:44.288263 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df43cd7-6138-4d86-962d-a2e142c5f9a6 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:28:44.288572 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df43cd7-6138-4d86-962d-a2e142c5f9a6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:44.291002 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df43cd7-6138-4d86-962d-a2e142c5f9a6 None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:44.302517 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 477/954] 10.222.0.67 () {56 vars in 1115 bytes} [Wed May 25 14:28:44 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:28:44.308024 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df43cd7-6138-4d86-962d-a2e142c5f9a6 None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:44.335159 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 478/955] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 14:28:44 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 14:28:44.355285 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e5c03e-7575-4bce-9377-32cfbcf30cda None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:44.444202 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df43cd7-6138-4d86-962d-a2e142c5f9a6 None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:44.467740 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e5c03e-7575-4bce-9377-32cfbcf30cda None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:44.489712 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52dbb979-f6a1-4384-b5af-a594194cc756 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:44.491170 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dbb979-f6a1-4384-b5af-a594194cc756 None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:44.491833 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dbb979-f6a1-4384-b5af-a594194cc756 None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:44.492231 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dbb979-f6a1-4384-b5af-a594194cc756 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:44.505293 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09c4ca0-ae5a-4a92-92df-44c038d6df40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:44.506145 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09c4ca0-ae5a-4a92-92df-44c038d6df40 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:44.506425 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09c4ca0-ae5a-4a92-92df-44c038d6df40 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:44.506787 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09c4ca0-ae5a-4a92-92df-44c038d6df40 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:44.507487 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09c4ca0-ae5a-4a92-92df-44c038d6df40 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:44.507664 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52dbb979-f6a1-4384-b5af-a594194cc756 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:44.508914 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09c4ca0-ae5a-4a92-92df-44c038d6df40 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:44.509126 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52dbb979-f6a1-4384-b5af-a594194cc756 None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:44.522104 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application [None req-c09c4ca0-ae5a-4a92-92df-44c038d6df40 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 25 14:28:44.522104 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:28:44.522104 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 14:28:44.522104 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 14:28:44.522104 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 14:28:44.522104 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 14:28:44.522104 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 14:28:44.522104 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 14:28:44.522104 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 25 14:28:44.522104 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:28:44.522104 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 14:28:44.522104 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:28:44.522104 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:28:44.522104 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:28:44.522104 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:28:44.522104 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:28:44.522104 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:28:44.524692 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:28:44.524692 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:28:44.524692 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:28:44.524692 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:28:44.524692 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:28:44.524692 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:28:44.524692 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 14:28:44.524692 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 14:28:44.524692 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 14:28:44.524692 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 14:28:44.524692 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:28:44.524692 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:28:44.524692 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:28:44.524692 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:28:44.524692 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:28:44.524692 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:28:44.526787 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:28:44.526787 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application with Lock( May 25 14:28:44.526787 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:28:44.526787 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._enter() May 25 14:28:44.526787 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:28:44.526787 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:28:44.526787 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:28:44.526787 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.creator() May 25 14:28:44.526787 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:28:44.526787 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application created_value = creator( May 25 14:28:44.526787 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 14:28:44.526787 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 14:28:44.526787 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 25 14:28:44.526787 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:28:44.526787 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 479/956] 10.222.0.67 () {56 vars in 1126 bytes} [Wed May 25 14:28:44 2022] GET /identity/v3/services/object-store => generated 93 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:28:44.530284 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b66c00-4633-4c42-ae29-514e3ac2ceca None None] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:44.530284 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b66c00-4633-4c42-ae29-514e3ac2ceca None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:44.530284 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b66c00-4633-4c42-ae29-514e3ac2ceca None None] PATH_INFO: `/` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:44.533526 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application [None req-52dbb979-f6a1-4384-b5af-a594194cc756 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:28:44.533526 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:28:44.533526 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:28:44.533526 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:28:44.533526 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:28:44.533526 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:28:44.533526 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:28:44.533526 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:28:44.533526 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:28:44.533526 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:28:44.533526 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:28:44.533526 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:28:44.533526 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 14:28:44.533526 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 14:28:44.533526 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 14:28:44.535158 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 14:28:44.535158 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:28:44.535158 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:28:44.535158 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:28:44.535158 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:28:44.535158 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:28:44.535158 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:28:44.535158 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:28:44.535158 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application with Lock( May 25 14:28:44.535158 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:28:44.535158 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self._enter() May 25 14:28:44.535158 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:28:44.535158 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:28:44.535158 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:28:44.535158 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.creator() May 25 14:28:44.535158 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:28:44.535158 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application created_value = creator( May 25 14:28:44.537331 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 14:28:44.537331 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 14:28:44.537331 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:28:44.537331 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application May 25 14:28:44.537834 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 480/957] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 14:28:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:28:44.537834 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b66c00-4633-4c42-ae29-514e3ac2ceca None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:44.538102 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 478/958] 10.222.0.67 () {56 vars in 1108 bytes} [Wed May 25 14:28:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:28:44.538102 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e288098-fc60-430a-a818-8348f99f4acc None None] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:44.538102 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e288098-fc60-430a-a818-8348f99f4acc None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:44.538102 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e288098-fc60-430a-a818-8348f99f4acc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:44.554491 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.auth.core [None req-3e288098-fc60-430a-a818-8348f99f4acc None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:28:44.555707 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-3e288098-fc60-430a-a818-8348f99f4acc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:28:44.557885 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:44.560046 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:44.633764 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 479/959] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 14:28:44 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 14:28:44.635047 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e288098-fc60-430a-a818-8348f99f4acc None None] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:44.650697 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b66c00-4633-4c42-ae29-514e3ac2ceca None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:44.694185 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7414ff17-8919-4009-b4df-3816c493f699 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:44.694959 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7414ff17-8919-4009-b4df-3816c493f699 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:44.695333 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7414ff17-8919-4009-b4df-3816c493f699 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:44.695675 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7414ff17-8919-4009-b4df-3816c493f699 None admin] PATH_INFO: `/v3/services` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:44.696451 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7414ff17-8919-4009-b4df-3816c493f699 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:28:44.696749 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7414ff17-8919-4009-b4df-3816c493f699 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:44.698126 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7414ff17-8919-4009-b4df-3816c493f699 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:44.708011 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 481/960] 10.222.0.67 () {56 vars in 1122 bytes} [Wed May 25 14:28:44 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:28:44.708755 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7414ff17-8919-4009-b4df-3816c493f699 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:44.745604 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e288098-fc60-430a-a818-8348f99f4acc None None] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:44.788843 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699af102-4c05-4016-93e4-59415659cfe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:44.789955 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699af102-4c05-4016-93e4-59415659cfe0 None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:44.790484 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699af102-4c05-4016-93e4-59415659cfe0 None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:44.790847 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699af102-4c05-4016-93e4-59415659cfe0 None admin] PATH_INFO: `/v3/domains` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:44.791618 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699af102-4c05-4016-93e4-59415659cfe0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:28:44.791933 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699af102-4c05-4016-93e4-59415659cfe0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:44.793315 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699af102-4c05-4016-93e4-59415659cfe0 None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:44.801793 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:44.805547 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:44.807913 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 480/961] 10.222.0.67 () {56 vars in 1109 bytes} [Wed May 25 14:28:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:28:44.808736 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699af102-4c05-4016-93e4-59415659cfe0 None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:44.822239 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7414ff17-8919-4009-b4df-3816c493f699 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:44.858224 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bd13d9-4ed9-4a8a-bf44-6257c5094976 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:44.859047 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bd13d9-4ed9-4a8a-bf44-6257c5094976 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:44.859333 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bd13d9-4ed9-4a8a-bf44-6257c5094976 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:44.859614 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bd13d9-4ed9-4a8a-bf44-6257c5094976 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:44.860277 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bd13d9-4ed9-4a8a-bf44-6257c5094976 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:44.861658 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bd13d9-4ed9-4a8a-bf44-6257c5094976 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:44.874528 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application [None req-68bd13d9-4ed9-4a8a-bf44-6257c5094976 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 25 14:28:44.874528 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:28:44.874528 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 14:28:44.874528 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 14:28:44.874528 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 14:28:44.874528 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 14:28:44.874528 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 14:28:44.874528 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 14:28:44.874528 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 25 14:28:44.874528 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:28:44.874528 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 14:28:44.874528 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:28:44.874528 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:28:44.874528 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:28:44.874528 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:28:44.874528 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:28:44.874528 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:28:44.875617 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:28:44.875617 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:28:44.875617 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:28:44.875617 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:28:44.875617 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:28:44.875617 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:28:44.875617 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 14:28:44.875617 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 14:28:44.875617 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 14:28:44.875617 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 14:28:44.875617 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:28:44.875617 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:28:44.875617 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:28:44.875617 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:28:44.875617 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:28:44.875617 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:28:44.876483 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:28:44.876483 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application with Lock( May 25 14:28:44.876483 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:28:44.876483 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._enter() May 25 14:28:44.876483 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:28:44.876483 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:28:44.876483 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:28:44.876483 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.creator() May 25 14:28:44.876483 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:28:44.876483 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application created_value = creator( May 25 14:28:44.876483 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 14:28:44.876483 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 14:28:44.876483 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 25 14:28:44.876483 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:28:44.876483 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 482/962] 10.222.0.67 () {56 vars in 1111 bytes} [Wed May 25 14:28:44 2022] GET /identity/v3/services/compute => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:28:44.877344 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bd13d9-4ed9-4a8a-bf44-6257c5094976 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:44.935698 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699af102-4c05-4016-93e4-59415659cfe0 None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:44.971756 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b211a8-6ede-40c4-bb43-8fe94b3320b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:44.972418 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b211a8-6ede-40c4-bb43-8fe94b3320b7 None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:44.972700 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b211a8-6ede-40c4-bb43-8fe94b3320b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:44.972974 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b211a8-6ede-40c4-bb43-8fe94b3320b7 None admin] PATH_INFO: `/v3/services` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:44.973792 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b211a8-6ede-40c4-bb43-8fe94b3320b7 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:28:44.974101 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b211a8-6ede-40c4-bb43-8fe94b3320b7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:44.975522 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b211a8-6ede-40c4-bb43-8fe94b3320b7 None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:44.985998 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 481/963] 10.222.0.67 () {56 vars in 1122 bytes} [Wed May 25 14:28:44 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:28:44.985998 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b211a8-6ede-40c4-bb43-8fe94b3320b7 None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:44.990921 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bd13d9-4ed9-4a8a-bf44-6257c5094976 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:45.024883 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32e87a8-1a7f-4987-a4f0-b721eae6ead1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:45.025699 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32e87a8-1a7f-4987-a4f0-b721eae6ead1 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:45.025987 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32e87a8-1a7f-4987-a4f0-b721eae6ead1 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:45.026327 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32e87a8-1a7f-4987-a4f0-b721eae6ead1 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:45.034629 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32e87a8-1a7f-4987-a4f0-b721eae6ead1 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:45.036107 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32e87a8-1a7f-4987-a4f0-b721eae6ead1 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:45.050907 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:45.051713 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application [None req-c32e87a8-1a7f-4987-a4f0-b721eae6ead1 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 25 14:28:45.051713 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:28:45.051713 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:28:45.051713 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:28:45.051713 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:28:45.051713 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:28:45.051713 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:28:45.051713 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:28:45.051713 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:28:45.051713 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:28:45.051713 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:28:45.051713 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:28:45.051713 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 14:28:45.051713 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 14:28:45.051713 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 14:28:45.051713 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 14:28:45.052746 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:28:45.052746 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:28:45.052746 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 14:28:45.052746 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 14:28:45.052746 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 14:28:45.052746 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 14:28:45.052746 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:28:45.052746 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:28:45.052746 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:28:45.052746 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:28:45.052746 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:28:45.052746 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application with Lock( May 25 14:28:45.052746 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:28:45.052746 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._enter() May 25 14:28:45.052746 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:28:45.052746 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:28:45.052746 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:28:45.052746 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.creator() May 25 14:28:45.054372 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:28:45.054372 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application created_value = creator( May 25 14:28:45.054372 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 14:28:45.054372 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 14:28:45.054372 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 14:28:45.054372 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 14:28:45.054372 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 14:28:45.054372 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 14:28:45.054372 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 25 14:28:45.054372 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:28:45.054372 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 483/964] 10.222.0.67 () {56 vars in 1117 bytes} [Wed May 25 14:28:44 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:28:45.054372 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32e87a8-1a7f-4987-a4f0-b721eae6ead1 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:45.070973 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:45.100583 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b211a8-6ede-40c4-bb43-8fe94b3320b7 None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:45.139881 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb40154-b317-4709-8b21-f97ca1437553 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:45.140690 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb40154-b317-4709-8b21-f97ca1437553 None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:45.140975 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb40154-b317-4709-8b21-f97ca1437553 None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:45.141250 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb40154-b317-4709-8b21-f97ca1437553 None admin] PATH_INFO: `/v3/services` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:45.141959 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb40154-b317-4709-8b21-f97ca1437553 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:28:45.142262 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb40154-b317-4709-8b21-f97ca1437553 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:45.143668 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb40154-b317-4709-8b21-f97ca1437553 None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:45.149760 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 482/965] 10.222.0.67 () {56 vars in 1112 bytes} [Wed May 25 14:28:44 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:28:45.150563 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb40154-b317-4709-8b21-f97ca1437553 None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:45.166973 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32e87a8-1a7f-4987-a4f0-b721eae6ead1 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:45.203900 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97148c83-99f8-4d40-a5b4-a7319e133f31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:45.204486 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97148c83-99f8-4d40-a5b4-a7319e133f31 None admin] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:45.204773 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97148c83-99f8-4d40-a5b4-a7319e133f31 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:45.205054 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97148c83-99f8-4d40-a5b4-a7319e133f31 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:45.205806 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97148c83-99f8-4d40-a5b4-a7319e133f31 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:45.207205 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97148c83-99f8-4d40-a5b4-a7319e133f31 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:45.227176 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 484/966] 10.222.0.67 () {60 vars in 1144 bytes} [Wed May 25 14:28:45 2022] POST /identity/v3/endpoints => generated 349 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:28:45.228010 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97148c83-99f8-4d40-a5b4-a7319e133f31 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:45.286044 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb40154-b317-4709-8b21-f97ca1437553 None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:45.315870 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:45.347417 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:45.352382 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b247965c-a7f4-49fa-9a31-021a8a784c2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:45.354132 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b247965c-a7f4-49fa-9a31-021a8a784c2f None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:45.354616 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b247965c-a7f4-49fa-9a31-021a8a784c2f None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:45.355672 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b247965c-a7f4-49fa-9a31-021a8a784c2f None admin] PATH_INFO: `/v3/users` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:45.358050 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b247965c-a7f4-49fa-9a31-021a8a784c2f None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:28:45.358684 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b247965c-a7f4-49fa-9a31-021a8a784c2f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:45.360700 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b247965c-a7f4-49fa-9a31-021a8a784c2f None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:45.367691 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97148c83-99f8-4d40-a5b4-a7319e133f31 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:45.386360 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 483/967] 10.222.0.67 () {56 vars in 1149 bytes} [Wed May 25 14:28:45 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:28:45.392482 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b247965c-a7f4-49fa-9a31-021a8a784c2f None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:45.417862 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b535e0e-0901-4dc3-b310-f2a930aeff1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:45.419173 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b535e0e-0901-4dc3-b310-f2a930aeff1e None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:45.419467 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b535e0e-0901-4dc3-b310-f2a930aeff1e None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:45.420279 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b535e0e-0901-4dc3-b310-f2a930aeff1e None admin] PATH_INFO: `/v3/services` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:45.421006 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b535e0e-0901-4dc3-b310-f2a930aeff1e None admin] RBAC: Adding query filter params (type=compute) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:28:45.421626 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b535e0e-0901-4dc3-b310-f2a930aeff1e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:45.423097 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b535e0e-0901-4dc3-b310-f2a930aeff1e None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:45.428817 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 485/968] 10.222.0.67 () {56 vars in 1112 bytes} [Wed May 25 14:28:45 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:28:45.527178 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b247965c-a7f4-49fa-9a31-021a8a784c2f None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:45.570147 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9d17ab-71e3-4ea6-b227-fe1486da6566 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:45.570835 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9d17ab-71e3-4ea6-b227-fe1486da6566 None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:45.571159 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9d17ab-71e3-4ea6-b227-fe1486da6566 None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:45.571443 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9d17ab-71e3-4ea6-b227-fe1486da6566 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:45.627966 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:45.651250 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9d17ab-71e3-4ea6-b227-fe1486da6566 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:45.652723 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9d17ab-71e3-4ea6-b227-fe1486da6566 None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:45.755546 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baaf9d6-5601-4936-9bbf-d6878b98a1ad None None] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:45.756359 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baaf9d6-5601-4936-9bbf-d6878b98a1ad None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:45.756893 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baaf9d6-5601-4936-9bbf-d6878b98a1ad None None] PATH_INFO: `/` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:45.759222 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 486/969] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 14:28:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:28:45.763481 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 484/970] 10.222.0.67 () {58 vars in 1282 bytes} [Wed May 25 14:28:45 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 25 14:28:45.767394 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a52ee0-ddd6-460c-8f7e-af061d4bfd01 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:45.767688 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a52ee0-ddd6-460c-8f7e-af061d4bfd01 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:45.767973 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a52ee0-ddd6-460c-8f7e-af061d4bfd01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:45.769786 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9d17ab-71e3-4ea6-b227-fe1486da6566 None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:45.789721 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-75a52ee0-ddd6-460c-8f7e-af061d4bfd01 None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:28:45.790872 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-75a52ee0-ddd6-460c-8f7e-af061d4bfd01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:28:45.870387 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 487/971] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 14:28:45 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 14:28:45.891062 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:45.897981 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a52ee0-ddd6-460c-8f7e-af061d4bfd01 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:45.901297 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9d17ab-71e3-4ea6-b227-fe1486da6566 None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:45.939307 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03653643-536f-42a5-8280-1368b8bdc443 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:45.940118 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03653643-536f-42a5-8280-1368b8bdc443 None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:45.940408 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03653643-536f-42a5-8280-1368b8bdc443 None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:45.940689 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03653643-536f-42a5-8280-1368b8bdc443 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:45.952624 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03653643-536f-42a5-8280-1368b8bdc443 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:45.954096 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03653643-536f-42a5-8280-1368b8bdc443 None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:45.969911 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:45.975161 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application [None req-03653643-536f-42a5-8280-1368b8bdc443 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:28:45.975161 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:28:45.975161 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:28:45.975161 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:28:45.975161 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:28:45.975161 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:28:45.975161 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:28:45.975161 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:28:45.975161 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:28:45.975161 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:28:45.975161 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:28:45.975161 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:28:45.975161 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 14:28:45.975161 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 14:28:45.975161 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 14:28:45.976289 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 14:28:45.976289 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:28:45.976289 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:28:45.976289 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:28:45.976289 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:28:45.976289 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:28:45.976289 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:28:45.976289 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:28:45.976289 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application with Lock( May 25 14:28:45.976289 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:28:45.976289 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self._enter() May 25 14:28:45.976289 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:28:45.976289 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:28:45.976289 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:28:45.976289 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.creator() May 25 14:28:45.976289 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:28:45.976289 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application created_value = creator( May 25 14:28:45.977193 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 14:28:45.977193 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 14:28:45.977193 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:28:45.977193 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application May 25 14:28:45.981206 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 485/972] 10.222.0.67 () {56 vars in 1108 bytes} [Wed May 25 14:28:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 14:28:45.982827 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03653643-536f-42a5-8280-1368b8bdc443 None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:46.015034 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a52ee0-ddd6-460c-8f7e-af061d4bfd01 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:46.053579 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fc9f18-fbb3-4417-a840-d8b7ebb1e6a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:46.054305 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fc9f18-fbb3-4417-a840-d8b7ebb1e6a0 None admin] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:46.054656 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fc9f18-fbb3-4417-a840-d8b7ebb1e6a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:46.055020 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fc9f18-fbb3-4417-a840-d8b7ebb1e6a0 None admin] PATH_INFO: `/v3/users` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:46.055949 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fc9f18-fbb3-4417-a840-d8b7ebb1e6a0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:46.057757 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fc9f18-fbb3-4417-a840-d8b7ebb1e6a0 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:46.059220 dv-cinder-787296-9-smb devstack@keystone.service[80475]: WARNING keystone.server.flask.common [None req-97fc9f18-fbb3-4417-a840-d8b7ebb1e6a0 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. May 25 14:28:46.074973 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.sql.core [None req-97fc9f18-fbb3-4417-a840-d8b7ebb1e6a0 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 25 14:28:46.074973 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 25 14:28:46.074973 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [parameters: {'user_id': 'b851528dff6e4fd48dab0e08950599c5', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 25 14:28:46.074973 dv-cinder-787296-9-smb devstack@keystone.service[80475]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80475) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 25 14:28:46.082717 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application [None req-97fc9f18-fbb3-4417-a840-d8b7ebb1e6a0 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 25 14:28:46.082717 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:28:46.082717 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 25 14:28:46.082717 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application self.dialect.do_execute( May 25 14:28:46.082717 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 25 14:28:46.082717 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 25 14:28:46.082717 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 25 14:28:46.082717 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application result = self._query(query) May 25 14:28:46.082717 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 25 14:28:46.082717 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application conn.query(q) May 25 14:28:46.082717 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 25 14:28:46.082717 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 25 14:28:46.082717 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 25 14:28:46.082717 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application result.read() May 25 14:28:46.082717 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 25 14:28:46.084710 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 25 14:28:46.084710 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 25 14:28:46.084710 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application packet.raise_for_error() May 25 14:28:46.084710 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 25 14:28:46.084710 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 25 14:28:46.084710 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 25 14:28:46.084710 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 25 14:28:46.084710 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 25 14:28:46.084710 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:28:46.084710 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 25 14:28:46.084710 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:28:46.084710 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:28:46.084710 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 25 14:28:46.084710 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 25 14:28:46.084710 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user May 25 14:28:46.084710 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) May 25 14:28:46.084710 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 25 14:28:46.084710 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application next(self.gen) May 25 14:28:46.086933 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 25 14:28:46.086933 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application yield resource May 25 14:28:46.086933 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 25 14:28:46.086933 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application next(self.gen) May 25 14:28:46.086933 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 25 14:28:46.086933 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application self.session.rollback() May 25 14:28:46.086933 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 25 14:28:46.086933 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application self.force_reraise() May 25 14:28:46.086933 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 25 14:28:46.086933 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application raise self.value May 25 14:28:46.086933 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 25 14:28:46.086933 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 25 14:28:46.086933 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 25 14:28:46.086933 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application session.commit() May 25 14:28:46.086933 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 25 14:28:46.086933 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 25 14:28:46.086933 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 25 14:28:46.089420 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application self._prepare_impl() May 25 14:28:46.089420 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 25 14:28:46.089420 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application self.session.flush() May 25 14:28:46.089420 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 25 14:28:46.089420 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application self._flush(objects) May 25 14:28:46.089420 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 25 14:28:46.089420 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 25 14:28:46.089420 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 25 14:28:46.089420 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application compat.raise_( May 25 14:28:46.089420 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 25 14:28:46.089420 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application raise exception May 25 14:28:46.089420 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 25 14:28:46.089420 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application flush_context.execute() May 25 14:28:46.089420 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 25 14:28:46.089420 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application rec.execute(self) May 25 14:28:46.089420 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 25 14:28:46.089420 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 25 14:28:46.100120 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 25 14:28:46.100120 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application _emit_insert_statements( May 25 14:28:46.100120 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements May 25 14:28:46.100120 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application result = connection._execute_20( May 25 14:28:46.100120 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 25 14:28:46.100120 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 25 14:28:46.100120 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 25 14:28:46.100120 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 25 14:28:46.100120 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 25 14:28:46.100120 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application ret = self._execute_context( May 25 14:28:46.100120 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 25 14:28:46.100120 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 25 14:28:46.100120 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 25 14:28:46.100120 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 25 14:28:46.100120 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 25 14:28:46.100120 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application raise exception May 25 14:28:46.101209 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 25 14:28:46.101209 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application self.dialect.do_execute( May 25 14:28:46.101209 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 25 14:28:46.101209 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 25 14:28:46.101209 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 25 14:28:46.101209 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application result = self._query(query) May 25 14:28:46.101209 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 25 14:28:46.101209 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application conn.query(q) May 25 14:28:46.101209 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 25 14:28:46.101209 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 25 14:28:46.101209 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 25 14:28:46.101209 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application result.read() May 25 14:28:46.101209 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 25 14:28:46.101209 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 25 14:28:46.101209 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 25 14:28:46.101209 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application packet.raise_for_error() May 25 14:28:46.102252 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 25 14:28:46.102252 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 25 14:28:46.102252 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 25 14:28:46.102252 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 25 14:28:46.102252 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 25 14:28:46.102252 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 25 14:28:46.102252 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application [parameters: {'user_id': 'b851528dff6e4fd48dab0e08950599c5', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 25 14:28:46.102252 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 25 14:28:46.102252 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:28:46.102252 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 14:28:46.102252 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:28:46.102252 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:28:46.102252 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:28:46.102252 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:28:46.102252 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:28:46.103277 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:28:46.103277 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:28:46.103277 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:28:46.103277 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:28:46.103277 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:28:46.103277 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:28:46.103277 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:28:46.103277 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post May 25 14:28:46.103277 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( May 25 14:28:46.103277 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:28:46.103277 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:28:46.103277 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 14:28:46.103277 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 14:28:46.103277 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 14:28:46.103277 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 14:28:46.103277 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user May 25 14:28:46.103277 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) May 25 14:28:46.104382 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects May 25 14:28:46.104382 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) May 25 14:28:46.104382 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 25 14:28:46.104382 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 25 14:28:46.104382 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 25 14:28:46.104382 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:28:46.104382 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 488/973] 10.222.0.67 () {60 vars in 1131 bytes} [Wed May 25 14:28:45 2022] POST /identity/v3/users => generated 160 bytes in 188 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) May 25 14:28:46.104382 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fc9f18-fbb3-4417-a840-d8b7ebb1e6a0 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:46.105209 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03653643-536f-42a5-8280-1368b8bdc443 None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:46.137179 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:46.143763 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215a817e-bfe0-4adc-8776-e072ed5cf936 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:46.144916 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215a817e-bfe0-4adc-8776-e072ed5cf936 None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:46.145207 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215a817e-bfe0-4adc-8776-e072ed5cf936 None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:46.145488 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215a817e-bfe0-4adc-8776-e072ed5cf936 None admin] PATH_INFO: `/v3/domains` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:46.146653 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215a817e-bfe0-4adc-8776-e072ed5cf936 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:28:46.147258 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215a817e-bfe0-4adc-8776-e072ed5cf936 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:46.148914 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215a817e-bfe0-4adc-8776-e072ed5cf936 None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:46.167165 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 486/974] 10.222.0.67 () {56 vars in 1109 bytes} [Wed May 25 14:28:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:28:46.172083 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215a817e-bfe0-4adc-8776-e072ed5cf936 None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:46.218535 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fc9f18-fbb3-4417-a840-d8b7ebb1e6a0 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:46.244762 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:46.260122 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96d4d48-4316-4443-8c96-679114dab905 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:46.261247 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96d4d48-4316-4443-8c96-679114dab905 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:46.261541 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96d4d48-4316-4443-8c96-679114dab905 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:46.261928 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96d4d48-4316-4443-8c96-679114dab905 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:46.270931 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96d4d48-4316-4443-8c96-679114dab905 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:46.272748 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96d4d48-4316-4443-8c96-679114dab905 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:46.288882 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application [None req-b96d4d48-4316-4443-8c96-679114dab905 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 25 14:28:46.288882 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:28:46.288882 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:28:46.288882 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:28:46.288882 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:28:46.288882 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:28:46.288882 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:28:46.288882 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:28:46.288882 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:28:46.288882 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:28:46.288882 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:28:46.288882 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:28:46.288882 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 14:28:46.288882 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 14:28:46.288882 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 14:28:46.288882 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 14:28:46.290010 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:28:46.290010 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:28:46.290010 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 14:28:46.290010 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 14:28:46.290010 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 14:28:46.290010 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 14:28:46.290010 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:28:46.290010 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:28:46.290010 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:28:46.290010 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:28:46.290010 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:28:46.290010 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application with Lock( May 25 14:28:46.290010 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:28:46.290010 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._enter() May 25 14:28:46.290010 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:28:46.290010 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:28:46.290010 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:28:46.290010 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.creator() May 25 14:28:46.291017 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:28:46.291017 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application created_value = creator( May 25 14:28:46.291017 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 14:28:46.291017 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 14:28:46.291017 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 14:28:46.291017 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 14:28:46.291017 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 14:28:46.291017 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 14:28:46.291017 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 25 14:28:46.291017 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:28:46.296199 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 489/975] 10.222.0.67 () {56 vars in 1099 bytes} [Wed May 25 14:28:46 2022] GET /identity/v3/users/cinder => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 14:28:46.297500 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96d4d48-4316-4443-8c96-679114dab905 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:46.316443 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215a817e-bfe0-4adc-8776-e072ed5cf936 None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:46.365264 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef808fd-ceaa-4f97-a1be-df3e0fdcc48e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:46.367177 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef808fd-ceaa-4f97-a1be-df3e0fdcc48e None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:46.367610 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef808fd-ceaa-4f97-a1be-df3e0fdcc48e None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:46.368036 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef808fd-ceaa-4f97-a1be-df3e0fdcc48e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:46.380607 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef808fd-ceaa-4f97-a1be-df3e0fdcc48e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:46.382397 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef808fd-ceaa-4f97-a1be-df3e0fdcc48e None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:46.398642 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application [None req-aef808fd-ceaa-4f97-a1be-df3e0fdcc48e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 14:28:46.398642 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:28:46.398642 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:28:46.398642 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:28:46.398642 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:28:46.398642 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:28:46.398642 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:28:46.398642 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:28:46.398642 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:28:46.398642 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:28:46.398642 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:28:46.398642 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:28:46.398642 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 14:28:46.398642 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 14:28:46.398642 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 14:28:46.399628 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 14:28:46.399628 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:28:46.399628 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:28:46.399628 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:28:46.399628 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:28:46.399628 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:28:46.399628 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:28:46.399628 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:28:46.399628 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application with Lock( May 25 14:28:46.399628 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:28:46.399628 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self._enter() May 25 14:28:46.399628 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:28:46.399628 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:28:46.399628 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:28:46.399628 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.creator() May 25 14:28:46.399628 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:28:46.399628 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application created_value = creator( May 25 14:28:46.400575 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 14:28:46.400575 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 14:28:46.400575 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 14:28:46.400575 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 14:28:46.400575 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 14:28:46.400575 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 14:28:46.400575 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 14:28:46.400575 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application May 25 14:28:46.407878 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 487/976] 10.222.0.67 () {56 vars in 1111 bytes} [Wed May 25 14:28:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 14:28:46.408884 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96d4d48-4316-4443-8c96-679114dab905 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:46.409102 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef808fd-ceaa-4f97-a1be-df3e0fdcc48e None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:46.452467 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fa6a7f-0654-478c-9c33-818ac72d1803 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:46.453188 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fa6a7f-0654-478c-9c33-818ac72d1803 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:46.453475 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fa6a7f-0654-478c-9c33-818ac72d1803 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:46.453753 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fa6a7f-0654-478c-9c33-818ac72d1803 None admin] PATH_INFO: `/v3/users` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:46.454575 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fa6a7f-0654-478c-9c33-818ac72d1803 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:28:46.455210 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fa6a7f-0654-478c-9c33-818ac72d1803 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:46.456899 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fa6a7f-0654-478c-9c33-818ac72d1803 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:46.467370 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:46.506984 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 490/977] 10.222.0.67 () {56 vars in 1101 bytes} [Wed May 25 14:28:46 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:28:46.518344 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef808fd-ceaa-4f97-a1be-df3e0fdcc48e None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:46.560971 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89dbaae9-21d6-4f28-b5b6-3643b5854930 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:46.562068 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dbaae9-21d6-4f28-b5b6-3643b5854930 None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:46.562588 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dbaae9-21d6-4f28-b5b6-3643b5854930 None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:46.563089 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dbaae9-21d6-4f28-b5b6-3643b5854930 None admin] PATH_INFO: `/v3/projects` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:46.564105 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89dbaae9-21d6-4f28-b5b6-3643b5854930 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:28:46.564608 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89dbaae9-21d6-4f28-b5b6-3643b5854930 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:46.566285 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89dbaae9-21d6-4f28-b5b6-3643b5854930 None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:46.581988 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 488/978] 10.222.0.67 () {56 vars in 1148 bytes} [Wed May 25 14:28:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:28:46.588576 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fa6a7f-0654-478c-9c33-818ac72d1803 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:46.637542 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:46.709141 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fa6a7f-0654-478c-9c33-818ac72d1803 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:46.753841 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e12071-fa3a-4bd4-98d8-25a8043915ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:46.754801 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e12071-fa3a-4bd4-98d8-25a8043915ff None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:46.755343 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e12071-fa3a-4bd4-98d8-25a8043915ff None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:46.755801 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e12071-fa3a-4bd4-98d8-25a8043915ff None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:46.756812 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e12071-fa3a-4bd4-98d8-25a8043915ff None admin] RBAC: Adding query filter params (role.id=a45d5a067e824fa18ca4428cff2a3889, scope.project.id=bfe93ee8d32a441295efc0b885de4bd7, user.id=e03f5bb82ffb41a1b1dde935d093e6f4) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:28:46.757304 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e12071-fa3a-4bd4-98d8-25a8043915ff None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:46.758928 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e12071-fa3a-4bd4-98d8-25a8043915ff None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:46.766279 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 491/979] 10.222.0.67 () {56 vars in 1374 bytes} [Wed May 25 14:28:46 2022] GET /identity/v3/role_assignments?user.id=e03f5bb82ffb41a1b1dde935d093e6f4&scope.project.id=bfe93ee8d32a441295efc0b885de4bd7&role.id=a45d5a067e824fa18ca4428cff2a3889 => generated 608 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:28:47.649416 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c87a7c-3c72-4e6a-9f30-ad32811626ce None None] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:47.650110 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c87a7c-3c72-4e6a-9f30-ad32811626ce None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:47.650110 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c87a7c-3c72-4e6a-9f30-ad32811626ce None None] PATH_INFO: `/` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:47.651495 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 489/980] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 14:28:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:28:47.657412 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5631a6-8c46-4a40-b427-031c54736710 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:47.657843 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5631a6-8c46-4a40-b427-031c54736710 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:47.658011 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5631a6-8c46-4a40-b427-031c54736710 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:47.674928 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-3c5631a6-8c46-4a40-b427-031c54736710 None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:28:47.676459 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-3c5631a6-8c46-4a40-b427-031c54736710 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:28:47.693605 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba68f284-e73c-4932-95fb-caeb456cf677 None None] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:47.693897 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba68f284-e73c-4932-95fb-caeb456cf677 None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:47.694165 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba68f284-e73c-4932-95fb-caeb456cf677 None None] PATH_INFO: `/` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:47.695686 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 490/981] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 14:28:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 14:28:47.700291 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1159f18f-2c97-405a-92ea-ec5a8ce7aac5 None None] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:47.700611 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1159f18f-2c97-405a-92ea-ec5a8ce7aac5 None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:47.700855 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1159f18f-2c97-405a-92ea-ec5a8ce7aac5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:47.718495 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.auth.core [None req-1159f18f-2c97-405a-92ea-ec5a8ce7aac5 None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:28:47.719693 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-1159f18f-2c97-405a-92ea-ec5a8ce7aac5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:28:47.751922 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 492/982] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 14:28:47 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 14:28:47.774194 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5631a6-8c46-4a40-b427-031c54736710 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:47.795473 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 491/983] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 14:28:47 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 25 14:28:47.813450 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:47.817777 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1159f18f-2c97-405a-92ea-ec5a8ce7aac5 None None] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:47.872707 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:47.892865 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5631a6-8c46-4a40-b427-031c54736710 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:47.932919 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21f1120-bdc9-4934-bdd2-f07761ae116c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:47.933647 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21f1120-bdc9-4934-bdd2-f07761ae116c None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:47.933939 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21f1120-bdc9-4934-bdd2-f07761ae116c None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:47.934215 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21f1120-bdc9-4934-bdd2-f07761ae116c None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:47.934905 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21f1120-bdc9-4934-bdd2-f07761ae116c None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:47.937082 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21f1120-bdc9-4934-bdd2-f07761ae116c None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:47.937496 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1159f18f-2c97-405a-92ea-ec5a8ce7aac5 None None] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:47.949440 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application [None req-a21f1120-bdc9-4934-bdd2-f07761ae116c None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 25 14:28:47.949440 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:28:47.949440 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 14:28:47.949440 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 14:28:47.949440 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 14:28:47.949440 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 14:28:47.949440 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 14:28:47.949440 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 14:28:47.949440 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 25 14:28:47.949440 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:28:47.949440 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 14:28:47.949440 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:28:47.949440 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:28:47.949440 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:28:47.949440 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:28:47.949440 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:28:47.949440 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:28:47.950586 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:28:47.950586 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:28:47.950586 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:28:47.950586 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:28:47.950586 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:28:47.950586 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:28:47.950586 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 14:28:47.950586 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 14:28:47.950586 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 14:28:47.950586 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 14:28:47.950586 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:28:47.950586 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:28:47.950586 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:28:47.950586 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:28:47.950586 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:28:47.950586 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:28:47.951561 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:28:47.951561 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application with Lock( May 25 14:28:47.951561 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:28:47.951561 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._enter() May 25 14:28:47.951561 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:28:47.951561 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:28:47.951561 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:28:47.951561 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.creator() May 25 14:28:47.951561 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:28:47.951561 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application created_value = creator( May 25 14:28:47.951561 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 14:28:47.951561 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 14:28:47.951561 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 25 14:28:47.951561 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:28:47.951561 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 493/984] 10.222.0.67 () {56 vars in 1126 bytes} [Wed May 25 14:28:47 2022] GET /identity/v3/services/object-store => generated 93 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:28:47.956514 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21f1120-bdc9-4934-bdd2-f07761ae116c None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:47.984575 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2839e5-bfd6-4574-abb4-cf2c46bec923 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:47.985629 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2839e5-bfd6-4574-abb4-cf2c46bec923 None admin] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:47.986009 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2839e5-bfd6-4574-abb4-cf2c46bec923 None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:47.986379 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2839e5-bfd6-4574-abb4-cf2c46bec923 None admin] PATH_INFO: `/v3/services` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:47.987195 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2839e5-bfd6-4574-abb4-cf2c46bec923 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:47.988636 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2839e5-bfd6-4574-abb4-cf2c46bec923 None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:48.002861 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 492/985] 10.222.0.67 () {60 vars in 1141 bytes} [Wed May 25 14:28:47 2022] POST /identity/v3/services => generated 242 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 14:28:48.071534 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:48.075600 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21f1120-bdc9-4934-bdd2-f07761ae116c None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:48.120817 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0936f587-9776-4e05-832a-3c4eaef62b8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:48.122009 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0936f587-9776-4e05-832a-3c4eaef62b8e None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:48.122449 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0936f587-9776-4e05-832a-3c4eaef62b8e None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:48.122942 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0936f587-9776-4e05-832a-3c4eaef62b8e None admin] PATH_INFO: `/v3/services` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:48.123853 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0936f587-9776-4e05-832a-3c4eaef62b8e None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:28:48.124316 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0936f587-9776-4e05-832a-3c4eaef62b8e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:48.125868 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0936f587-9776-4e05-832a-3c4eaef62b8e None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:48.131671 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 494/986] 10.222.0.67 () {56 vars in 1122 bytes} [Wed May 25 14:28:47 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:28:48.137464 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2839e5-bfd6-4574-abb4-cf2c46bec923 None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:48.246305 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2839e5-bfd6-4574-abb4-cf2c46bec923 None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:48.248912 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:48.284380 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f93e938-f6a2-4905-a9f8-63ce9e15832b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:48.285054 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f93e938-f6a2-4905-a9f8-63ce9e15832b None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:48.285341 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f93e938-f6a2-4905-a9f8-63ce9e15832b None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:48.285621 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f93e938-f6a2-4905-a9f8-63ce9e15832b None admin] PATH_INFO: `/v3/services` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:48.286336 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f93e938-f6a2-4905-a9f8-63ce9e15832b None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:28:48.286647 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f93e938-f6a2-4905-a9f8-63ce9e15832b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:48.288040 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f93e938-f6a2-4905-a9f8-63ce9e15832b None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:48.293352 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 493/987] 10.222.0.67 () {56 vars in 1122 bytes} [Wed May 25 14:28:48 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:28:48.299535 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0936f587-9776-4e05-832a-3c4eaef62b8e None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:48.402405 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0936f587-9776-4e05-832a-3c4eaef62b8e None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:48.437673 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe86bd0-10c8-47f7-afa6-e83b499802df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:48.438330 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe86bd0-10c8-47f7-afa6-e83b499802df None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:48.438614 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe86bd0-10c8-47f7-afa6-e83b499802df None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:48.438892 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe86bd0-10c8-47f7-afa6-e83b499802df None admin] PATH_INFO: `/v3/endpoints` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:48.439723 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe86bd0-10c8-47f7-afa6-e83b499802df None admin] RBAC: Adding query filter params (interface=admin, service_id=3c432d03d5154e4b998fd63282c8f97c, region_id=RegionOne) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:28:48.440039 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe86bd0-10c8-47f7-afa6-e83b499802df None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:48.441404 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe86bd0-10c8-47f7-afa6-e83b499802df None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:48.451519 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 495/988] 10.222.0.67 () {56 vars in 1249 bytes} [Wed May 25 14:28:48 2022] GET /identity/v3/endpoints?service_id=3c432d03d5154e4b998fd63282c8f97c&interface=admin®ion_id=RegionOne => generated 193 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:28:48.453405 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f93e938-f6a2-4905-a9f8-63ce9e15832b None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:48.574209 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f93e938-f6a2-4905-a9f8-63ce9e15832b None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:48.611216 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8e9a90-49e6-4c11-a994-25d676b5c56e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:48.611893 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8e9a90-49e6-4c11-a994-25d676b5c56e None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:48.612176 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8e9a90-49e6-4c11-a994-25d676b5c56e None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:48.612450 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8e9a90-49e6-4c11-a994-25d676b5c56e None admin] PATH_INFO: `/v3/services` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:48.613135 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8e9a90-49e6-4c11-a994-25d676b5c56e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:48.614509 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8e9a90-49e6-4c11-a994-25d676b5c56e None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:48.627017 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 494/989] 10.222.0.67 () {56 vars in 1087 bytes} [Wed May 25 14:28:48 2022] GET /identity/v3/services => generated 1727 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 25 14:28:49.053860 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194759d5-df00-4f2f-b22a-9cc8cdc8dcb2 None None] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:49.054379 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194759d5-df00-4f2f-b22a-9cc8cdc8dcb2 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:49.054456 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194759d5-df00-4f2f-b22a-9cc8cdc8dcb2 None None] PATH_INFO: `/` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:49.055949 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 496/990] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 14:28:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:28:49.061335 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4c45d0-9e35-4ea9-b300-067f217655a9 None None] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:49.061744 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4c45d0-9e35-4ea9-b300-067f217655a9 None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:49.061954 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4c45d0-9e35-4ea9-b300-067f217655a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:49.079396 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.auth.core [None req-2e4c45d0-9e35-4ea9-b300-067f217655a9 None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:28:49.080575 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-2e4c45d0-9e35-4ea9-b300-067f217655a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:28:49.105756 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:49.151766 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 495/991] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 14:28:49 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 14:28:49.175248 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194759d5-df00-4f2f-b22a-9cc8cdc8dcb2 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:49.202852 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:49.283147 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194759d5-df00-4f2f-b22a-9cc8cdc8dcb2 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:49.317700 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c1e2b7-e096-4941-8d1c-010ff284690e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:49.318491 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c1e2b7-e096-4941-8d1c-010ff284690e None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:49.318777 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c1e2b7-e096-4941-8d1c-010ff284690e None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:49.319080 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c1e2b7-e096-4941-8d1c-010ff284690e None admin] PATH_INFO: `/v3/services/image` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:49.319738 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c1e2b7-e096-4941-8d1c-010ff284690e None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:49.321109 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c1e2b7-e096-4941-8d1c-010ff284690e None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:49.332779 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application [None req-04c1e2b7-e096-4941-8d1c-010ff284690e None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 25 14:28:49.332779 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:28:49.332779 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 14:28:49.332779 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 14:28:49.332779 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 14:28:49.332779 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 14:28:49.332779 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 14:28:49.332779 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 14:28:49.332779 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 25 14:28:49.332779 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:28:49.332779 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 14:28:49.332779 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:28:49.332779 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:28:49.332779 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:28:49.332779 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:28:49.332779 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:28:49.332779 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:28:49.333770 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:28:49.333770 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:28:49.333770 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:28:49.333770 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:28:49.333770 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:28:49.333770 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:28:49.333770 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 14:28:49.333770 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 14:28:49.333770 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 14:28:49.333770 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 14:28:49.333770 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:28:49.333770 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:28:49.333770 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:28:49.333770 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:28:49.333770 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:28:49.333770 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:28:49.334659 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:28:49.334659 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application with Lock( May 25 14:28:49.334659 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:28:49.334659 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._enter() May 25 14:28:49.334659 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:28:49.334659 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:28:49.334659 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:28:49.334659 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.creator() May 25 14:28:49.334659 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:28:49.334659 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application created_value = creator( May 25 14:28:49.334659 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 14:28:49.334659 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 14:28:49.334659 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 25 14:28:49.334659 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:28:49.338851 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 497/992] 10.222.0.67 () {56 vars in 1105 bytes} [Wed May 25 14:28:49 2022] GET /identity/v3/services/image => generated 86 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:28:49.340210 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4c45d0-9e35-4ea9-b300-067f217655a9 None None] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:49.440953 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4c45d0-9e35-4ea9-b300-067f217655a9 None None] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:49.478554 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871b4d39-1f5b-41da-a348-ae7362c9d208 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:49.479252 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871b4d39-1f5b-41da-a348-ae7362c9d208 None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:49.479546 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871b4d39-1f5b-41da-a348-ae7362c9d208 None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:49.479823 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871b4d39-1f5b-41da-a348-ae7362c9d208 None admin] PATH_INFO: `/v3/services` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:49.480534 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871b4d39-1f5b-41da-a348-ae7362c9d208 None admin] RBAC: Adding query filter params (name=image) {{(pid=80474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:28:49.480897 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871b4d39-1f5b-41da-a348-ae7362c9d208 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:49.483239 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871b4d39-1f5b-41da-a348-ae7362c9d208 None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:49.488314 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 496/993] 10.222.0.67 () {56 vars in 1108 bytes} [Wed May 25 14:28:49 2022] GET /identity/v3/services?name=image => generated 122 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:28:49.493863 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c1e2b7-e096-4941-8d1c-010ff284690e None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:49.583941 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:49.597526 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c1e2b7-e096-4941-8d1c-010ff284690e None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:49.631389 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab163cf-8bd5-40f5-a2e8-65d5da15fea4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:49.632053 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab163cf-8bd5-40f5-a2e8-65d5da15fea4 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:49.632337 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab163cf-8bd5-40f5-a2e8-65d5da15fea4 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:49.632613 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab163cf-8bd5-40f5-a2e8-65d5da15fea4 None admin] PATH_INFO: `/v3/services` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:49.633321 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab163cf-8bd5-40f5-a2e8-65d5da15fea4 None admin] RBAC: Adding query filter params (type=image) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:28:49.633631 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab163cf-8bd5-40f5-a2e8-65d5da15fea4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:49.635026 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab163cf-8bd5-40f5-a2e8-65d5da15fea4 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:49.640314 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 498/994] 10.222.0.67 () {56 vars in 1108 bytes} [Wed May 25 14:28:49 2022] GET /identity/v3/services?type=image => generated 122 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:28:50.271177 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb1ecb5-6d33-4107-8810-5c88d57980a1 None None] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:50.271679 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb1ecb5-6d33-4107-8810-5c88d57980a1 None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:50.271757 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb1ecb5-6d33-4107-8810-5c88d57980a1 None None] PATH_INFO: `/` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:50.273370 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 497/995] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 14:28:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:28:50.278437 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49106335-313b-48e8-8cf6-70f798ef2b87 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:50.278890 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49106335-313b-48e8-8cf6-70f798ef2b87 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:50.279613 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49106335-313b-48e8-8cf6-70f798ef2b87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:50.297162 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-49106335-313b-48e8-8cf6-70f798ef2b87 None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:28:50.298340 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-49106335-313b-48e8-8cf6-70f798ef2b87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:28:50.368613 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 499/996] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 14:28:50 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 14:28:50.391422 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb1ecb5-6d33-4107-8810-5c88d57980a1 None None] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:50.417282 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:50.504458 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb1ecb5-6d33-4107-8810-5c88d57980a1 None None] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:50.538334 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717964ae-512f-480a-99de-5f9a4c0e25db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:50.539084 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717964ae-512f-480a-99de-5f9a4c0e25db None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:50.539371 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717964ae-512f-480a-99de-5f9a4c0e25db None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:50.539646 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717964ae-512f-480a-99de-5f9a4c0e25db None admin] PATH_INFO: `/v3/services/compute` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:50.540299 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717964ae-512f-480a-99de-5f9a4c0e25db None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:50.541654 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717964ae-512f-480a-99de-5f9a4c0e25db None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:50.554436 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application [None req-717964ae-512f-480a-99de-5f9a4c0e25db None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 25 14:28:50.554436 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:28:50.554436 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 14:28:50.554436 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 14:28:50.554436 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 14:28:50.554436 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 14:28:50.554436 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 14:28:50.554436 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 14:28:50.554436 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 25 14:28:50.554436 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application May 25 14:28:50.554436 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 14:28:50.554436 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application May 25 14:28:50.554436 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:28:50.554436 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:28:50.554436 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:28:50.554436 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:28:50.554436 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:28:50.555797 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:28:50.555797 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:28:50.555797 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:28:50.555797 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:28:50.555797 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:28:50.555797 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:28:50.555797 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 14:28:50.555797 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 14:28:50.555797 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 14:28:50.555797 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 14:28:50.555797 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:28:50.555797 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:28:50.555797 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:28:50.555797 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:28:50.555797 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:28:50.555797 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:28:50.557038 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:28:50.557038 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application with Lock( May 25 14:28:50.557038 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:28:50.557038 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self._enter() May 25 14:28:50.557038 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:28:50.557038 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:28:50.557038 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:28:50.557038 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.creator() May 25 14:28:50.557038 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:28:50.557038 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application created_value = creator( May 25 14:28:50.557038 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 14:28:50.557038 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 14:28:50.557038 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 25 14:28:50.557038 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application May 25 14:28:50.564579 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 498/997] 10.222.0.67 () {56 vars in 1111 bytes} [Wed May 25 14:28:50 2022] GET /identity/v3/services/compute => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:28:50.564726 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49106335-313b-48e8-8cf6-70f798ef2b87 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:50.646354 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:50.665998 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49106335-313b-48e8-8cf6-70f798ef2b87 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:50.703378 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9a55ec-60d7-4c7c-be37-47cc95317ac0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:50.704144 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9a55ec-60d7-4c7c-be37-47cc95317ac0 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:50.704433 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9a55ec-60d7-4c7c-be37-47cc95317ac0 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:50.704716 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9a55ec-60d7-4c7c-be37-47cc95317ac0 None admin] PATH_INFO: `/v3/services` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:50.705507 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9a55ec-60d7-4c7c-be37-47cc95317ac0 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:28:50.705824 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9a55ec-60d7-4c7c-be37-47cc95317ac0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:50.707780 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9a55ec-60d7-4c7c-be37-47cc95317ac0 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:50.719085 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 500/998] 10.222.0.67 () {56 vars in 1112 bytes} [Wed May 25 14:28:50 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:28:50.721024 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717964ae-512f-480a-99de-5f9a4c0e25db None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:50.815193 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:50.831187 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717964ae-512f-480a-99de-5f9a4c0e25db None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:50.869375 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230bd427-37b9-4c3f-94b5-0e501eff4ccc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:50.870044 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230bd427-37b9-4c3f-94b5-0e501eff4ccc None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:50.870329 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230bd427-37b9-4c3f-94b5-0e501eff4ccc None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:50.870606 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230bd427-37b9-4c3f-94b5-0e501eff4ccc None admin] PATH_INFO: `/v3/services` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:50.871361 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230bd427-37b9-4c3f-94b5-0e501eff4ccc None admin] RBAC: Adding query filter params (type=compute) {{(pid=80474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:28:50.871673 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230bd427-37b9-4c3f-94b5-0e501eff4ccc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:50.873524 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230bd427-37b9-4c3f-94b5-0e501eff4ccc None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:50.878908 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 499/999] 10.222.0.67 () {56 vars in 1112 bytes} [Wed May 25 14:28:50 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:28:50.884399 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9a55ec-60d7-4c7c-be37-47cc95317ac0 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:50.893380 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc9f302-0b42-498b-b2f6-8f3c0c0a7c30 None None] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:50.893674 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc9f302-0b42-498b-b2f6-8f3c0c0a7c30 None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:50.893956 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc9f302-0b42-498b-b2f6-8f3c0c0a7c30 None None] PATH_INFO: `/` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:50.895590 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 500/1000] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 14:28:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 14:28:50.900306 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba50c90-c61e-46c2-ac1a-5f200c14c2fa None None] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:50.900596 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba50c90-c61e-46c2-ac1a-5f200c14c2fa None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:50.900869 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba50c90-c61e-46c2-ac1a-5f200c14c2fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:50.922761 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.auth.core [None req-eba50c90-c61e-46c2-ac1a-5f200c14c2fa None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:28:50.924000 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-eba50c90-c61e-46c2-ac1a-5f200c14c2fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:28:50.989519 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9a55ec-60d7-4c7c-be37-47cc95317ac0 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:51.000673 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 501/1001] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 14:28:50 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 25 14:28:51.022282 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba50c90-c61e-46c2-ac1a-5f200c14c2fa None None] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:51.024987 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0f7bf8-9c99-4579-a5d7-8e59585f29ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:51.025958 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0f7bf8-9c99-4579-a5d7-8e59585f29ec None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:51.025958 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0f7bf8-9c99-4579-a5d7-8e59585f29ec None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:51.026242 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0f7bf8-9c99-4579-a5d7-8e59585f29ec None admin] PATH_INFO: `/v3/endpoints` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:51.026986 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0f7bf8-9c99-4579-a5d7-8e59585f29ec None admin] RBAC: Adding query filter params (interface=public, service_id=e745f56cdae04f8f8e8279724a9fc686, region_id=RegionOne) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:28:51.027327 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0f7bf8-9c99-4579-a5d7-8e59585f29ec None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:51.028703 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0f7bf8-9c99-4579-a5d7-8e59585f29ec None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:51.039074 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 501/1002] 10.222.0.67 () {56 vars in 1251 bytes} [Wed May 25 14:28:50 2022] GET /identity/v3/endpoints?service_id=e745f56cdae04f8f8e8279724a9fc686&interface=public®ion_id=RegionOne => generated 194 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:28:51.040050 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0f7bf8-9c99-4579-a5d7-8e59585f29ec None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:51.053053 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:51.111764 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:51.132893 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba50c90-c61e-46c2-ac1a-5f200c14c2fa None None] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:51.145660 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0f7bf8-9c99-4579-a5d7-8e59585f29ec None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:51.171519 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8663474-8e2d-4d71-a398-5b037781df08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:51.172472 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8663474-8e2d-4d71-a398-5b037781df08 None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:51.172760 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8663474-8e2d-4d71-a398-5b037781df08 None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:51.173043 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8663474-8e2d-4d71-a398-5b037781df08 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:51.173709 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8663474-8e2d-4d71-a398-5b037781df08 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:51.175119 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8663474-8e2d-4d71-a398-5b037781df08 None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:51.189505 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application [None req-c8663474-8e2d-4d71-a398-5b037781df08 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 25 14:28:51.189505 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:28:51.189505 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 14:28:51.189505 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 14:28:51.189505 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 14:28:51.189505 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 14:28:51.189505 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 14:28:51.189505 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 14:28:51.189505 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 25 14:28:51.189505 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application May 25 14:28:51.189505 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 14:28:51.189505 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application May 25 14:28:51.189505 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:28:51.189505 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:28:51.189505 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:28:51.189505 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:28:51.189505 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:28:51.190545 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:28:51.190545 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:28:51.190545 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:28:51.190545 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:28:51.190545 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:28:51.190545 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:28:51.190545 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 14:28:51.190545 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 14:28:51.190545 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 14:28:51.190545 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 14:28:51.190545 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:28:51.190545 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:28:51.190545 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:28:51.190545 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:28:51.190545 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:28:51.190545 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:28:51.191442 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:28:51.191442 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application with Lock( May 25 14:28:51.191442 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:28:51.191442 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self._enter() May 25 14:28:51.191442 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:28:51.191442 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:28:51.191442 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:28:51.191442 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.creator() May 25 14:28:51.191442 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:28:51.191442 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application created_value = creator( May 25 14:28:51.191442 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 14:28:51.191442 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 14:28:51.191442 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 25 14:28:51.191442 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application May 25 14:28:51.191442 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 502/1003] 10.222.0.67 () {56 vars in 1126 bytes} [Wed May 25 14:28:51 2022] GET /identity/v3/services/object-store => generated 93 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 14:28:51.193714 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158f30b0-235b-4a49-98cc-c5e8363c664f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:51.194383 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158f30b0-235b-4a49-98cc-c5e8363c664f None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:51.194665 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158f30b0-235b-4a49-98cc-c5e8363c664f None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:51.194934 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158f30b0-235b-4a49-98cc-c5e8363c664f None admin] PATH_INFO: `/v3/services` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:51.195893 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158f30b0-235b-4a49-98cc-c5e8363c664f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:51.196695 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8663474-8e2d-4d71-a398-5b037781df08 None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:51.197067 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158f30b0-235b-4a49-98cc-c5e8363c664f None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:51.211863 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 502/1004] 10.222.0.67 () {56 vars in 1087 bytes} [Wed May 25 14:28:51 2022] GET /identity/v3/services => generated 1727 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:28:51.315342 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8663474-8e2d-4d71-a398-5b037781df08 None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:51.351255 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3289a4-306a-4d3f-a005-50ec2512b492 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:51.351945 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3289a4-306a-4d3f-a005-50ec2512b492 None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:51.352233 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3289a4-306a-4d3f-a005-50ec2512b492 None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:51.352513 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3289a4-306a-4d3f-a005-50ec2512b492 None admin] PATH_INFO: `/v3/services` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:51.353242 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3289a4-306a-4d3f-a005-50ec2512b492 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:28:51.353555 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3289a4-306a-4d3f-a005-50ec2512b492 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:51.354954 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3289a4-306a-4d3f-a005-50ec2512b492 None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:51.361555 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 503/1005] 10.222.0.67 () {56 vars in 1122 bytes} [Wed May 25 14:28:51 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:28:51.367518 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158f30b0-235b-4a49-98cc-c5e8363c664f None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:51.450874 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:51.480469 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158f30b0-235b-4a49-98cc-c5e8363c664f None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:51.516687 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf643259-6743-42db-87d7-42dc8cb23473 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:51.517359 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf643259-6743-42db-87d7-42dc8cb23473 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:51.517648 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf643259-6743-42db-87d7-42dc8cb23473 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:51.517930 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf643259-6743-42db-87d7-42dc8cb23473 None admin] PATH_INFO: `/v3/services` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:51.518645 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf643259-6743-42db-87d7-42dc8cb23473 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:28:51.518959 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf643259-6743-42db-87d7-42dc8cb23473 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:51.520380 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf643259-6743-42db-87d7-42dc8cb23473 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:51.525765 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 503/1006] 10.222.0.67 () {56 vars in 1122 bytes} [Wed May 25 14:28:51 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:28:51.531823 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3289a4-306a-4d3f-a005-50ec2512b492 None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:51.545703 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:51.639601 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3289a4-306a-4d3f-a005-50ec2512b492 None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:51.674024 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff30d43-c5a7-4ecd-922e-5b3ec48bad46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:51.674718 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff30d43-c5a7-4ecd-922e-5b3ec48bad46 None admin] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:51.675041 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff30d43-c5a7-4ecd-922e-5b3ec48bad46 None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:51.675330 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff30d43-c5a7-4ecd-922e-5b3ec48bad46 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:51.676124 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff30d43-c5a7-4ecd-922e-5b3ec48bad46 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:51.677545 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff30d43-c5a7-4ecd-922e-5b3ec48bad46 None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:51.702230 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 504/1007] 10.222.0.67 () {60 vars in 1144 bytes} [Wed May 25 14:28:51 2022] POST /identity/v3/endpoints => generated 325 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:28:51.871716 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbd7102-2fab-480f-9951-0a6fd66883a2 None None] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:51.872336 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbd7102-2fab-480f-9951-0a6fd66883a2 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:51.872536 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbd7102-2fab-480f-9951-0a6fd66883a2 None None] PATH_INFO: `/` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:51.874501 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 504/1008] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 14:28:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:28:51.880104 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f7534b-8e05-4244-9cf6-93306ef7f94c None None] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:51.880486 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f7534b-8e05-4244-9cf6-93306ef7f94c None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:51.880838 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f7534b-8e05-4244-9cf6-93306ef7f94c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:51.899415 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.auth.core [None req-77f7534b-8e05-4244-9cf6-93306ef7f94c None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:28:51.900526 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-77f7534b-8e05-4244-9cf6-93306ef7f94c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:28:51.967991 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:51.981142 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 505/1009] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 14:28:51 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 14:28:52.003967 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbd7102-2fab-480f-9951-0a6fd66883a2 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:52.111875 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbd7102-2fab-480f-9951-0a6fd66883a2 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:52.146721 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579eda06-a1cc-4e8d-a700-30fc41b5c021 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:52.147461 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579eda06-a1cc-4e8d-a700-30fc41b5c021 None admin] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:52.147748 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579eda06-a1cc-4e8d-a700-30fc41b5c021 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:52.148020 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579eda06-a1cc-4e8d-a700-30fc41b5c021 None admin] PATH_INFO: `/v3/services` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:52.148743 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579eda06-a1cc-4e8d-a700-30fc41b5c021 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:52.150148 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579eda06-a1cc-4e8d-a700-30fc41b5c021 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:52.158622 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:52.175304 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 505/1010] 10.222.0.67 () {60 vars in 1141 bytes} [Wed May 25 14:28:52 2022] POST /identity/v3/services => generated 242 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:28:53.490432 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f4b705-397c-47ba-b05a-42396049056f None None] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:53.490955 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f4b705-397c-47ba-b05a-42396049056f None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:53.491085 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f4b705-397c-47ba-b05a-42396049056f None None] PATH_INFO: `/` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:53.492430 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 506/1011] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 14:28:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:28:53.497885 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbef2f8-9155-4910-9a51-a8fead3c1a90 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:53.498706 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbef2f8-9155-4910-9a51-a8fead3c1a90 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:53.499023 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbef2f8-9155-4910-9a51-a8fead3c1a90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:53.516630 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-adbef2f8-9155-4910-9a51-a8fead3c1a90 None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:28:53.517823 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-adbef2f8-9155-4910-9a51-a8fead3c1a90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:28:53.594445 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 506/1012] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 14:28:53 2022] POST /identity/v3/auth/tokens => generated 1803 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 14:28:53.616769 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f4b705-397c-47ba-b05a-42396049056f None None] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:53.722536 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f4b705-397c-47ba-b05a-42396049056f None None] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:53.762421 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874840fb-4c0f-4e50-b00a-03eaf29962c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:53.762421 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874840fb-4c0f-4e50-b00a-03eaf29962c5 None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:53.762421 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874840fb-4c0f-4e50-b00a-03eaf29962c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:53.762421 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874840fb-4c0f-4e50-b00a-03eaf29962c5 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:53.762848 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874840fb-4c0f-4e50-b00a-03eaf29962c5 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:53.765169 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874840fb-4c0f-4e50-b00a-03eaf29962c5 None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:53.778028 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application [None req-874840fb-4c0f-4e50-b00a-03eaf29962c5 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 25 14:28:53.778028 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:28:53.778028 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 14:28:53.778028 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 14:28:53.778028 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 14:28:53.778028 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 14:28:53.778028 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 14:28:53.778028 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 14:28:53.778028 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 25 14:28:53.778028 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application May 25 14:28:53.778028 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 14:28:53.778028 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application May 25 14:28:53.778028 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:28:53.778028 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:28:53.778028 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:28:53.778028 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:28:53.778028 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:28:53.779202 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:28:53.779202 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:28:53.779202 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:28:53.779202 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:28:53.779202 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:28:53.779202 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:28:53.779202 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 14:28:53.779202 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 14:28:53.779202 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 14:28:53.779202 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 14:28:53.779202 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:28:53.779202 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:28:53.779202 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:28:53.779202 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:28:53.779202 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:28:53.779202 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:28:53.780069 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:28:53.780069 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application with Lock( May 25 14:28:53.780069 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:28:53.780069 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self._enter() May 25 14:28:53.780069 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:28:53.780069 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:28:53.780069 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:28:53.780069 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.creator() May 25 14:28:53.780069 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:28:53.780069 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application created_value = creator( May 25 14:28:53.780069 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 14:28:53.780069 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 14:28:53.780069 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 25 14:28:53.780069 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application May 25 14:28:53.783418 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 507/1013] 10.222.0.67 () {56 vars in 1111 bytes} [Wed May 25 14:28:53 2022] GET /identity/v3/services/compute => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:28:53.786300 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbef2f8-9155-4910-9a51-a8fead3c1a90 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:53.898725 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbef2f8-9155-4910-9a51-a8fead3c1a90 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:53.923329 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:53.935775 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eeccda9-87c8-4b28-9cc8-4d4a0f65b77a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:53.936456 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eeccda9-87c8-4b28-9cc8-4d4a0f65b77a None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:53.936751 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eeccda9-87c8-4b28-9cc8-4d4a0f65b77a None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:53.937031 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eeccda9-87c8-4b28-9cc8-4d4a0f65b77a None admin] PATH_INFO: `/v3/services` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:53.937742 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eeccda9-87c8-4b28-9cc8-4d4a0f65b77a None admin] RBAC: Adding query filter params (name=compute) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:28:53.938052 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eeccda9-87c8-4b28-9cc8-4d4a0f65b77a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:53.939459 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eeccda9-87c8-4b28-9cc8-4d4a0f65b77a None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:53.948995 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 507/1014] 10.222.0.67 () {56 vars in 1112 bytes} [Wed May 25 14:28:53 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:28:53.950262 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874840fb-4c0f-4e50-b00a-03eaf29962c5 None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:53.956337 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966f1177-29c8-4853-a4b1-815e4da0a6c7 None None] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:53.956633 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966f1177-29c8-4853-a4b1-815e4da0a6c7 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:53.956917 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966f1177-29c8-4853-a4b1-815e4da0a6c7 None None] PATH_INFO: `/` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:53.958427 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 508/1015] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 14:28:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:28:53.963829 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5032f331-1e12-4663-b180-7d30fb9df25e None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:53.964240 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5032f331-1e12-4663-b180-7d30fb9df25e None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:53.964526 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5032f331-1e12-4663-b180-7d30fb9df25e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:53.981850 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-5032f331-1e12-4663-b180-7d30fb9df25e None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:28:53.983161 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-5032f331-1e12-4663-b180-7d30fb9df25e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:28:54.017423 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:54.056621 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 509/1016] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 14:28:53 2022] POST /identity/v3/auth/tokens => generated 1803 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 25 14:28:54.064599 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874840fb-4c0f-4e50-b00a-03eaf29962c5 None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:54.079738 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5032f331-1e12-4663-b180-7d30fb9df25e None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:54.105297 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba7e33f-eb22-4afe-b704-9ab38a299563 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:54.105297 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba7e33f-eb22-4afe-b704-9ab38a299563 None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:54.105297 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba7e33f-eb22-4afe-b704-9ab38a299563 None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:54.105687 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba7e33f-eb22-4afe-b704-9ab38a299563 None admin] PATH_INFO: `/v3/services` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:54.106073 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba7e33f-eb22-4afe-b704-9ab38a299563 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:28:54.106415 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba7e33f-eb22-4afe-b704-9ab38a299563 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:54.108555 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba7e33f-eb22-4afe-b704-9ab38a299563 None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:54.123236 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 508/1017] 10.222.0.67 () {56 vars in 1112 bytes} [Wed May 25 14:28:53 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:28:54.125794 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba7e33f-eb22-4afe-b704-9ab38a299563 None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:54.209197 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5032f331-1e12-4663-b180-7d30fb9df25e None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:54.229103 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:54.240590 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba7e33f-eb22-4afe-b704-9ab38a299563 None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:54.249807 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee43cb7-1a39-467d-b49e-30a5053c329c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:54.250617 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee43cb7-1a39-467d-b49e-30a5053c329c None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:54.250906 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee43cb7-1a39-467d-b49e-30a5053c329c None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:54.251216 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee43cb7-1a39-467d-b49e-30a5053c329c None admin] PATH_INFO: `/v3/domains/default` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:54.252410 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee43cb7-1a39-467d-b49e-30a5053c329c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:54.253874 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee43cb7-1a39-467d-b49e-30a5053c329c None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:54.259061 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 510/1018] 10.222.0.67 () {56 vars in 1108 bytes} [Wed May 25 14:28:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:28:54.261073 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee43cb7-1a39-467d-b49e-30a5053c329c None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:54.268832 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:54.282367 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f724d86-3b7b-42e8-8d36-d4fcb099bb4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:54.283061 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f724d86-3b7b-42e8-8d36-d4fcb099bb4e None admin] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:54.283352 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f724d86-3b7b-42e8-8d36-d4fcb099bb4e None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:54.283630 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f724d86-3b7b-42e8-8d36-d4fcb099bb4e None admin] PATH_INFO: `/v3/endpoints` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:54.284405 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f724d86-3b7b-42e8-8d36-d4fcb099bb4e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:54.285750 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f724d86-3b7b-42e8-8d36-d4fcb099bb4e None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:54.306453 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 509/1019] 10.222.0.67 () {60 vars in 1144 bytes} [Wed May 25 14:28:54 2022] POST /identity/v3/endpoints => generated 334 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 14:28:54.371332 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee43cb7-1a39-467d-b49e-30a5053c329c None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:54.407298 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f65915-437e-473a-aa29-ed58973efc3b None None] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:54.407608 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f65915-437e-473a-aa29-ed58973efc3b None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:54.407877 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f65915-437e-473a-aa29-ed58973efc3b None None] PATH_INFO: `/` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:54.409486 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 510/1020] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 14:28:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 14:28:54.414865 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20eb9fc9-4bfd-4608-927a-f2f15520fca8 None None] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:54.415196 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20eb9fc9-4bfd-4608-927a-f2f15520fca8 None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:54.415473 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20eb9fc9-4bfd-4608-927a-f2f15520fca8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:54.417186 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633935ad-0e95-4889-a82f-898b7bd168f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:54.417856 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633935ad-0e95-4889-a82f-898b7bd168f2 None admin] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:54.418140 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633935ad-0e95-4889-a82f-898b7bd168f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:54.418418 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633935ad-0e95-4889-a82f-898b7bd168f2 None admin] PATH_INFO: `/v3/projects` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:54.419160 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633935ad-0e95-4889-a82f-898b7bd168f2 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:54.421160 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633935ad-0e95-4889-a82f-898b7bd168f2 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:54.434565 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.auth.core [None req-20eb9fc9-4bfd-4608-927a-f2f15520fca8 None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:28:54.436660 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-20eb9fc9-4bfd-4608-927a-f2f15520fca8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:28:54.463076 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 511/1021] 10.222.0.67 () {60 vars in 1141 bytes} [Wed May 25 14:28:54 2022] POST /identity/v3/projects => generated 311 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:28:54.531180 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 511/1022] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 14:28:54 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 25 14:28:54.554698 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633935ad-0e95-4889-a82f-898b7bd168f2 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:54.595040 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:54.674069 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633935ad-0e95-4889-a82f-898b7bd168f2 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:54.709237 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a08d2c-7e84-4b77-b21b-adadf1364e1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:54.710034 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a08d2c-7e84-4b77-b21b-adadf1364e1b None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:54.710317 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a08d2c-7e84-4b77-b21b-adadf1364e1b None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:54.710593 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a08d2c-7e84-4b77-b21b-adadf1364e1b None admin] PATH_INFO: `/v3/services/image` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:54.711283 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a08d2c-7e84-4b77-b21b-adadf1364e1b None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:54.712660 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a08d2c-7e84-4b77-b21b-adadf1364e1b None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:54.726026 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application [None req-d4a08d2c-7e84-4b77-b21b-adadf1364e1b None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 25 14:28:54.726026 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:28:54.726026 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 14:28:54.726026 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 14:28:54.726026 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 14:28:54.726026 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 14:28:54.726026 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 14:28:54.726026 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 14:28:54.726026 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 25 14:28:54.726026 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:28:54.726026 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 14:28:54.726026 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:28:54.726026 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:28:54.726026 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:28:54.726026 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:28:54.726026 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:28:54.726026 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:28:54.727130 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:28:54.727130 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:28:54.727130 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:28:54.727130 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:28:54.727130 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:28:54.727130 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:28:54.727130 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 14:28:54.727130 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 14:28:54.727130 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 14:28:54.727130 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 14:28:54.727130 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:28:54.727130 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:28:54.727130 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:28:54.727130 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:28:54.727130 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:28:54.727130 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:28:54.728513 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:28:54.728513 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application with Lock( May 25 14:28:54.728513 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:28:54.728513 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._enter() May 25 14:28:54.728513 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:28:54.728513 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:28:54.728513 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:28:54.728513 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.creator() May 25 14:28:54.728513 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:28:54.728513 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application created_value = creator( May 25 14:28:54.728513 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 14:28:54.728513 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 14:28:54.728513 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 25 14:28:54.728513 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:28:54.728513 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 512/1023] 10.222.0.67 () {56 vars in 1105 bytes} [Wed May 25 14:28:54 2022] GET /identity/v3/services/image => generated 86 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:28:54.733708 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20eb9fc9-4bfd-4608-927a-f2f15520fca8 None None] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:54.844530 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20eb9fc9-4bfd-4608-927a-f2f15520fca8 None None] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:54.856045 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:54.884640 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b3d352-facd-43a0-a03d-df2408fcb75f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:54.885324 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b3d352-facd-43a0-a03d-df2408fcb75f None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:54.885609 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b3d352-facd-43a0-a03d-df2408fcb75f None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:54.885893 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b3d352-facd-43a0-a03d-df2408fcb75f None admin] PATH_INFO: `/v3/services` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:54.886621 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b3d352-facd-43a0-a03d-df2408fcb75f None admin] RBAC: Adding query filter params (name=image) {{(pid=80474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:28:54.886931 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b3d352-facd-43a0-a03d-df2408fcb75f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:54.888364 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b3d352-facd-43a0-a03d-df2408fcb75f None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:54.894035 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 512/1024] 10.222.0.67 () {56 vars in 1108 bytes} [Wed May 25 14:28:54 2022] GET /identity/v3/services?name=image => generated 122 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:28:54.899697 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a08d2c-7e84-4b77-b21b-adadf1364e1b None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:55.003527 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:55.008004 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a08d2c-7e84-4b77-b21b-adadf1364e1b None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:55.045042 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731b8ae3-4b78-4970-87bc-145300a54392 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:55.045712 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731b8ae3-4b78-4970-87bc-145300a54392 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:55.046097 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731b8ae3-4b78-4970-87bc-145300a54392 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:55.046384 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731b8ae3-4b78-4970-87bc-145300a54392 None admin] PATH_INFO: `/v3/services` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:55.047120 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731b8ae3-4b78-4970-87bc-145300a54392 None admin] RBAC: Adding query filter params (type=image) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:28:55.047438 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731b8ae3-4b78-4970-87bc-145300a54392 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:55.048822 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731b8ae3-4b78-4970-87bc-145300a54392 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:55.058563 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 513/1025] 10.222.0.67 () {56 vars in 1108 bytes} [Wed May 25 14:28:54 2022] GET /identity/v3/services?type=image => generated 350 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:28:55.059632 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b3d352-facd-43a0-a03d-df2408fcb75f None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:55.165420 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b3d352-facd-43a0-a03d-df2408fcb75f None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:55.200435 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5ac0b0-f15c-42a5-ab69-11390c4394be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:55.201932 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5ac0b0-f15c-42a5-ab69-11390c4394be None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:55.202217 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5ac0b0-f15c-42a5-ab69-11390c4394be None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:55.202500 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5ac0b0-f15c-42a5-ab69-11390c4394be None admin] PATH_INFO: `/v3/endpoints` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:55.203343 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5ac0b0-f15c-42a5-ab69-11390c4394be None admin] RBAC: Adding query filter params (interface=public, service_id=6e39564b241b4225aa554b1e866869d7, region_id=RegionOne) {{(pid=80474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:28:55.203662 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5ac0b0-f15c-42a5-ab69-11390c4394be None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:55.205029 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5ac0b0-f15c-42a5-ab69-11390c4394be None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:55.214886 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 513/1026] 10.222.0.67 () {56 vars in 1251 bytes} [Wed May 25 14:28:55 2022] GET /identity/v3/endpoints?service_id=6e39564b241b4225aa554b1e866869d7&interface=public®ion_id=RegionOne => generated 194 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:28:55.216124 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731b8ae3-4b78-4970-87bc-145300a54392 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:55.320943 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731b8ae3-4b78-4970-87bc-145300a54392 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:55.354861 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b347288d-82a4-4405-89c1-a0b2ddbce5c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:55.355553 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b347288d-82a4-4405-89c1-a0b2ddbce5c3 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:55.355839 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b347288d-82a4-4405-89c1-a0b2ddbce5c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:55.356115 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b347288d-82a4-4405-89c1-a0b2ddbce5c3 None admin] PATH_INFO: `/v3/services` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:55.356794 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b347288d-82a4-4405-89c1-a0b2ddbce5c3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:55.358377 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b347288d-82a4-4405-89c1-a0b2ddbce5c3 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:55.371214 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 514/1027] 10.222.0.67 () {56 vars in 1087 bytes} [Wed May 25 14:28:55 2022] GET /identity/v3/services => generated 1957 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:28:56.630862 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817d8b31-4750-4a74-b04b-7034ab4b0940 None None] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:56.631410 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817d8b31-4750-4a74-b04b-7034ab4b0940 None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:56.631489 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817d8b31-4750-4a74-b04b-7034ab4b0940 None None] PATH_INFO: `/` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:56.632945 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 514/1028] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 14:28:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:28:56.637948 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddff743-7a89-4d25-b29a-f7c46b2c45a9 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:56.638892 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddff743-7a89-4d25-b29a-f7c46b2c45a9 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:56.639089 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddff743-7a89-4d25-b29a-f7c46b2c45a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:56.656563 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-7ddff743-7a89-4d25-b29a-f7c46b2c45a9 None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:28:56.657764 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-7ddff743-7a89-4d25-b29a-f7c46b2c45a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:28:56.679025 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:56.728400 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 515/1029] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 14:28:56 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 14:28:56.752079 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817d8b31-4750-4a74-b04b-7034ab4b0940 None None] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:56.760305 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424a7f03-9e1f-4ada-aee9-0b779584ae71 None None] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:56.760603 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424a7f03-9e1f-4ada-aee9-0b779584ae71 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:56.760886 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424a7f03-9e1f-4ada-aee9-0b779584ae71 None None] PATH_INFO: `/` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:56.762389 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 516/1030] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 14:28:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 14:28:56.767939 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f224660e-7def-4c50-99c9-0a03883be0ba None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:56.768227 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f224660e-7def-4c50-99c9-0a03883be0ba None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:56.768504 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f224660e-7def-4c50-99c9-0a03883be0ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:56.786808 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-f224660e-7def-4c50-99c9-0a03883be0ba None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:28:56.788030 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-f224660e-7def-4c50-99c9-0a03883be0ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:28:56.794923 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:56.862730 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 517/1031] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 14:28:56 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 25 14:28:56.870733 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817d8b31-4750-4a74-b04b-7034ab4b0940 None None] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:56.887817 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f224660e-7def-4c50-99c9-0a03883be0ba None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:56.907079 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c884471-4e8a-43f6-b8f4-1c5bf1c4d3d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:56.907892 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c884471-4e8a-43f6-b8f4-1c5bf1c4d3d1 None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:56.908177 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c884471-4e8a-43f6-b8f4-1c5bf1c4d3d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:56.908453 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c884471-4e8a-43f6-b8f4-1c5bf1c4d3d1 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:56.919473 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c884471-4e8a-43f6-b8f4-1c5bf1c4d3d1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:28:56.927708 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application [None req-5c884471-4e8a-43f6-b8f4-1c5bf1c4d3d1 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 25 14:28:56.927708 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:28:56.927708 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:28:56.927708 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:28:56.927708 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:28:56.927708 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:28:56.927708 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:28:56.927708 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:28:56.927708 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:28:56.927708 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:28:56.927708 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:28:56.927708 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:28:56.927708 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:28:56.927708 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:28:56.927708 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:28:56.927708 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:28:56.928641 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:28:56.928641 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:28:56.928641 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:28:56.928641 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:28:56.928641 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:28:56.928641 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:28:56.928641 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:28:56.928641 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:28:56.928641 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:28:56.928641 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:28:56.928641 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:28:56.928641 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application with Lock( May 25 14:28:56.928641 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:28:56.928641 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self._enter() May 25 14:28:56.928641 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:28:56.928641 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:28:56.929498 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:28:56.929498 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.creator() May 25 14:28:56.929498 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:28:56.929498 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application created_value = creator( May 25 14:28:56.929498 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:28:56.929498 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:28:56.929498 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:28:56.929498 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:28:56.929498 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:28:56.929498 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:28:56.929498 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 25 14:28:56.929498 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application May 25 14:28:56.929498 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 515/1032] 10.222.0.67 () {56 vars in 1120 bytes} [Wed May 25 14:28:56 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:28:56.934633 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c884471-4e8a-43f6-b8f4-1c5bf1c4d3d1 None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:56.988421 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:57.005396 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f224660e-7def-4c50-99c9-0a03883be0ba None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:57.034437 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:57.039665 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c884471-4e8a-43f6-b8f4-1c5bf1c4d3d1 None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:57.040749 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c45ed55-b39f-45ae-8844-9ce159c08d66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:57.041661 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c45ed55-b39f-45ae-8844-9ce159c08d66 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:57.042068 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c45ed55-b39f-45ae-8844-9ce159c08d66 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:57.042339 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c45ed55-b39f-45ae-8844-9ce159c08d66 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:57.043546 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c45ed55-b39f-45ae-8844-9ce159c08d66 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:57.045099 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c45ed55-b39f-45ae-8844-9ce159c08d66 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:57.047069 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 518/1033] 10.222.0.67 () {56 vars in 1108 bytes} [Wed May 25 14:28:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:28:57.052514 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c45ed55-b39f-45ae-8844-9ce159c08d66 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:57.079347 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc8a8a8-9702-41ff-8ef8-54ff80f2229b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:57.080044 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc8a8a8-9702-41ff-8ef8-54ff80f2229b None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:57.080333 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc8a8a8-9702-41ff-8ef8-54ff80f2229b None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:57.080612 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc8a8a8-9702-41ff-8ef8-54ff80f2229b None admin] PATH_INFO: `/v3/roles` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:57.081384 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc8a8a8-9702-41ff-8ef8-54ff80f2229b None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:28:57.081682 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc8a8a8-9702-41ff-8ef8-54ff80f2229b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:57.083080 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc8a8a8-9702-41ff-8ef8-54ff80f2229b None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:57.092448 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 516/1034] 10.222.0.67 () {56 vars in 1115 bytes} [Wed May 25 14:28:56 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:28:57.097935 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc8a8a8-9702-41ff-8ef8-54ff80f2229b None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:57.159051 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c45ed55-b39f-45ae-8844-9ce159c08d66 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:57.196676 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c045acf-58a4-4131-ad89-bb930eaad8de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:57.197348 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c045acf-58a4-4131-ad89-bb930eaad8de None admin] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:57.197638 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c045acf-58a4-4131-ad89-bb930eaad8de None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:57.197903 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c045acf-58a4-4131-ad89-bb930eaad8de None admin] PATH_INFO: `/v3/users` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:57.198613 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c045acf-58a4-4131-ad89-bb930eaad8de None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:57.200083 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c045acf-58a4-4131-ad89-bb930eaad8de None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:57.203187 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc8a8a8-9702-41ff-8ef8-54ff80f2229b None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:57.221889 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 519/1035] 10.222.0.67 () {60 vars in 1132 bytes} [Wed May 25 14:28:57 2022] POST /identity/v3/users => generated 285 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 14:28:57.244888 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5833cc0d-f59c-4e4e-a961-e9843f7da962 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:57.245715 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5833cc0d-f59c-4e4e-a961-e9843f7da962 None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:57.245995 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5833cc0d-f59c-4e4e-a961-e9843f7da962 None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:57.246268 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5833cc0d-f59c-4e4e-a961-e9843f7da962 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:57.259113 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5833cc0d-f59c-4e4e-a961-e9843f7da962 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:57.260597 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5833cc0d-f59c-4e4e-a961-e9843f7da962 None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:57.280679 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application [None req-5833cc0d-f59c-4e4e-a961-e9843f7da962 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:28:57.280679 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:28:57.280679 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:28:57.280679 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:28:57.280679 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:28:57.280679 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:28:57.280679 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:28:57.280679 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:28:57.280679 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:28:57.280679 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:28:57.280679 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:28:57.280679 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:28:57.280679 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 14:28:57.280679 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 14:28:57.280679 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 14:28:57.281673 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 14:28:57.281673 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:28:57.281673 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:28:57.281673 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:28:57.281673 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:28:57.281673 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:28:57.281673 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:28:57.281673 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:28:57.281673 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application with Lock( May 25 14:28:57.281673 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:28:57.281673 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self._enter() May 25 14:28:57.281673 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:28:57.281673 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:28:57.281673 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:28:57.281673 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.creator() May 25 14:28:57.281673 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:28:57.281673 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application created_value = creator( May 25 14:28:57.287587 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 14:28:57.287587 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 14:28:57.287587 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:28:57.287587 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application May 25 14:28:57.287587 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 517/1036] 10.222.0.67 () {56 vars in 1108 bytes} [Wed May 25 14:28:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 14:28:57.289411 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c045acf-58a4-4131-ad89-bb930eaad8de None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:57.303425 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:57.401017 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c045acf-58a4-4131-ad89-bb930eaad8de None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:57.437616 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8001c9a-5265-48bd-aeee-82cee3c26957 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:57.438203 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8001c9a-5265-48bd-aeee-82cee3c26957 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:57.438492 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8001c9a-5265-48bd-aeee-82cee3c26957 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:57.438764 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8001c9a-5265-48bd-aeee-82cee3c26957 None admin] PATH_INFO: `/v3/domains` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:57.439563 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8001c9a-5265-48bd-aeee-82cee3c26957 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:28:57.439875 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8001c9a-5265-48bd-aeee-82cee3c26957 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:57.441271 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8001c9a-5265-48bd-aeee-82cee3c26957 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:57.455987 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 520/1037] 10.222.0.67 () {56 vars in 1109 bytes} [Wed May 25 14:28:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:28:57.461549 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5833cc0d-f59c-4e4e-a961-e9843f7da962 None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:57.481634 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:57.577793 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5833cc0d-f59c-4e4e-a961-e9843f7da962 None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:57.613423 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c55347-723a-487d-9972-bc7af841cf68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:57.614211 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c55347-723a-487d-9972-bc7af841cf68 None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:57.614499 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c55347-723a-487d-9972-bc7af841cf68 None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:57.614776 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c55347-723a-487d-9972-bc7af841cf68 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:57.622768 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c55347-723a-487d-9972-bc7af841cf68 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:57.624276 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c55347-723a-487d-9972-bc7af841cf68 None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:57.638471 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application [None req-19c55347-723a-487d-9972-bc7af841cf68 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 25 14:28:57.638471 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:28:57.638471 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:28:57.638471 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:28:57.638471 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:28:57.638471 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:28:57.638471 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:28:57.638471 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:28:57.638471 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:28:57.638471 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:28:57.638471 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:28:57.638471 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:28:57.638471 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 14:28:57.638471 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 14:28:57.638471 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 14:28:57.638471 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 14:28:57.639922 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:28:57.639922 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:28:57.639922 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 14:28:57.639922 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 14:28:57.639922 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 14:28:57.639922 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 14:28:57.639922 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:28:57.639922 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:28:57.639922 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:28:57.639922 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:28:57.639922 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:28:57.639922 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application with Lock( May 25 14:28:57.639922 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:28:57.639922 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self._enter() May 25 14:28:57.639922 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:28:57.639922 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:28:57.639922 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:28:57.639922 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.creator() May 25 14:28:57.641523 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:28:57.641523 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application created_value = creator( May 25 14:28:57.641523 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 14:28:57.641523 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 14:28:57.641523 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 14:28:57.641523 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 14:28:57.641523 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 14:28:57.641523 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 14:28:57.641523 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 25 14:28:57.641523 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application May 25 14:28:57.641523 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 518/1038] 10.222.0.67 () {56 vars in 1093 bytes} [Wed May 25 14:28:57 2022] GET /identity/v3/users/nova => generated 82 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:28:57.645676 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8001c9a-5265-48bd-aeee-82cee3c26957 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:57.654893 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a5233b-d87a-41a2-8b2b-a678ab0f9d8a None None] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:57.654893 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a5233b-d87a-41a2-8b2b-a678ab0f9d8a None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:57.655579 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a5233b-d87a-41a2-8b2b-a678ab0f9d8a None None] PATH_INFO: `/` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:57.656954 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 519/1039] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 14:28:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 14:28:57.662019 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adacbe4-d238-4b86-a41b-c4ced25c4641 None None] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:57.662550 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adacbe4-d238-4b86-a41b-c4ced25c4641 None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:57.662839 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adacbe4-d238-4b86-a41b-c4ced25c4641 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:57.680370 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.auth.core [None req-2adacbe4-d238-4b86-a41b-c4ced25c4641 None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:28:57.681595 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-2adacbe4-d238-4b86-a41b-c4ced25c4641 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:28:57.724571 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:57.761356 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8001c9a-5265-48bd-aeee-82cee3c26957 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:57.763364 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 520/1040] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 14:28:57 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 25 14:28:57.780715 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adacbe4-d238-4b86-a41b-c4ced25c4641 None None] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:57.782982 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:57.799670 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a49c36-4d76-4222-a168-199ec94c357b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:57.800350 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a49c36-4d76-4222-a168-199ec94c357b None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:57.800638 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a49c36-4d76-4222-a168-199ec94c357b None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:57.800918 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a49c36-4d76-4222-a168-199ec94c357b None admin] PATH_INFO: `/v3/users` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:57.801767 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a49c36-4d76-4222-a168-199ec94c357b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:28:57.802081 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a49c36-4d76-4222-a168-199ec94c357b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:57.803554 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a49c36-4d76-4222-a168-199ec94c357b None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:57.826767 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 521/1041] 10.222.0.67 () {56 vars in 1133 bytes} [Wed May 25 14:28:57 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:28:57.832715 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a49c36-4d76-4222-a168-199ec94c357b None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:57.899279 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adacbe4-d238-4b86-a41b-c4ced25c4641 None None] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:57.934825 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacb105b-ecb4-4d41-9fd6-ff9e7d0c48b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:57.936699 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacb105b-ecb4-4d41-9fd6-ff9e7d0c48b7 None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:57.936987 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacb105b-ecb4-4d41-9fd6-ff9e7d0c48b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:57.937264 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacb105b-ecb4-4d41-9fd6-ff9e7d0c48b7 None admin] PATH_INFO: `/v3/services/image` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:57.937925 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacb105b-ecb4-4d41-9fd6-ff9e7d0c48b7 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:57.939327 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacb105b-ecb4-4d41-9fd6-ff9e7d0c48b7 None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:57.945097 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a49c36-4d76-4222-a168-199ec94c357b None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:57.950906 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application [None req-aacb105b-ecb4-4d41-9fd6-ff9e7d0c48b7 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 25 14:28:57.950906 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:28:57.950906 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 14:28:57.950906 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 14:28:57.950906 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 14:28:57.950906 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 14:28:57.950906 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 14:28:57.950906 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 14:28:57.950906 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 25 14:28:57.950906 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application May 25 14:28:57.950906 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 14:28:57.950906 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application May 25 14:28:57.950906 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:28:57.950906 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:28:57.950906 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:28:57.950906 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:28:57.950906 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:28:57.952191 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:28:57.952191 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:28:57.952191 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:28:57.952191 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:28:57.952191 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:28:57.952191 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:28:57.952191 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 14:28:57.952191 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 14:28:57.952191 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 14:28:57.952191 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 14:28:57.952191 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:28:57.952191 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:28:57.952191 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:28:57.952191 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:28:57.952191 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:28:57.952191 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:28:57.955611 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:28:57.955611 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application with Lock( May 25 14:28:57.955611 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:28:57.955611 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self._enter() May 25 14:28:57.955611 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:28:57.955611 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:28:57.955611 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:28:57.955611 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.creator() May 25 14:28:57.955611 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:28:57.955611 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application created_value = creator( May 25 14:28:57.955611 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 14:28:57.955611 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 14:28:57.955611 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 25 14:28:57.955611 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application May 25 14:28:57.955611 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 521/1042] 10.222.0.67 () {56 vars in 1105 bytes} [Wed May 25 14:28:57 2022] GET /identity/v3/services/image => generated 86 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 14:28:57.958547 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacb105b-ecb4-4d41-9fd6-ff9e7d0c48b7 None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:57.979420 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:57.988795 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1f216d-a638-44b4-8fcc-952c1a21f447 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:57.989448 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1f216d-a638-44b4-8fcc-952c1a21f447 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:57.989744 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1f216d-a638-44b4-8fcc-952c1a21f447 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:57.990023 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1f216d-a638-44b4-8fcc-952c1a21f447 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:58.031218 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:58.067370 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1f216d-a638-44b4-8fcc-952c1a21f447 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:58.068831 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1f216d-a638-44b4-8fcc-952c1a21f447 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:58.071611 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacb105b-ecb4-4d41-9fd6-ff9e7d0c48b7 None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:58.108486 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db8deca-ec5d-4331-b013-e196bb7283a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:58.109162 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db8deca-ec5d-4331-b013-e196bb7283a3 None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:58.109449 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db8deca-ec5d-4331-b013-e196bb7283a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:58.109728 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db8deca-ec5d-4331-b013-e196bb7283a3 None admin] PATH_INFO: `/v3/services` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:58.110805 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db8deca-ec5d-4331-b013-e196bb7283a3 None admin] RBAC: Adding query filter params (name=image) {{(pid=80474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:28:58.110805 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db8deca-ec5d-4331-b013-e196bb7283a3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:58.112160 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db8deca-ec5d-4331-b013-e196bb7283a3 None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:58.117418 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 522/1043] 10.222.0.67 () {56 vars in 1108 bytes} [Wed May 25 14:28:57 2022] GET /identity/v3/services?name=image => generated 122 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:28:58.124646 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db8deca-ec5d-4331-b013-e196bb7283a3 None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:58.186217 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 522/1044] 10.222.0.67 () {58 vars in 1282 bytes} [Wed May 25 14:28:57 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 25 14:28:58.187849 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1f216d-a638-44b4-8fcc-952c1a21f447 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:58.217168 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:58.242696 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db8deca-ec5d-4331-b013-e196bb7283a3 None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:58.281975 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:58.290376 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c682a6ff-2b42-4077-bc25-70aebd83b145 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:58.291434 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c682a6ff-2b42-4077-bc25-70aebd83b145 None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:58.291980 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c682a6ff-2b42-4077-bc25-70aebd83b145 None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:58.292389 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c682a6ff-2b42-4077-bc25-70aebd83b145 None admin] PATH_INFO: `/v3/services` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:58.293369 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c682a6ff-2b42-4077-bc25-70aebd83b145 None admin] RBAC: Adding query filter params (type=image) {{(pid=80474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:28:58.293898 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c682a6ff-2b42-4077-bc25-70aebd83b145 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:58.295916 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c682a6ff-2b42-4077-bc25-70aebd83b145 None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:58.302382 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1f216d-a638-44b4-8fcc-952c1a21f447 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:58.307607 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 523/1045] 10.222.0.67 () {56 vars in 1108 bytes} [Wed May 25 14:28:58 2022] GET /identity/v3/services?type=image => generated 350 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:28:58.308427 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c682a6ff-2b42-4077-bc25-70aebd83b145 None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:58.343951 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205e3c01-01e2-4271-a102-486494125248 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:58.344738 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205e3c01-01e2-4271-a102-486494125248 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:58.345021 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205e3c01-01e2-4271-a102-486494125248 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:58.345293 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205e3c01-01e2-4271-a102-486494125248 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:58.355712 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205e3c01-01e2-4271-a102-486494125248 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:58.357229 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205e3c01-01e2-4271-a102-486494125248 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:58.376544 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application [None req-205e3c01-01e2-4271-a102-486494125248 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:28:58.376544 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:28:58.376544 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:28:58.376544 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:28:58.376544 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:28:58.376544 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:28:58.376544 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:28:58.376544 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:28:58.376544 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:28:58.376544 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:28:58.376544 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:28:58.376544 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:28:58.376544 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 14:28:58.376544 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 14:28:58.376544 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 14:28:58.377498 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 14:28:58.377498 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:28:58.377498 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:28:58.377498 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:28:58.377498 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:28:58.377498 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:28:58.377498 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:28:58.377498 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:28:58.377498 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application with Lock( May 25 14:28:58.377498 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:28:58.377498 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._enter() May 25 14:28:58.377498 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:28:58.377498 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:28:58.377498 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:28:58.377498 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.creator() May 25 14:28:58.377498 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:28:58.377498 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application created_value = creator( May 25 14:28:58.378452 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 14:28:58.378452 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 14:28:58.378452 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:28:58.378452 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:28:58.378452 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 523/1046] 10.222.0.67 () {56 vars in 1108 bytes} [Wed May 25 14:28:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:28:58.383329 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205e3c01-01e2-4271-a102-486494125248 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:58.420384 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c682a6ff-2b42-4077-bc25-70aebd83b145 None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:58.461662 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066d4846-e6e6-4896-8c17-8c08606f272f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:58.462323 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066d4846-e6e6-4896-8c17-8c08606f272f None admin] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:58.462676 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066d4846-e6e6-4896-8c17-8c08606f272f None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:58.462960 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066d4846-e6e6-4896-8c17-8c08606f272f None admin] PATH_INFO: `/v3/endpoints` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:58.463775 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066d4846-e6e6-4896-8c17-8c08606f272f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:58.465148 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066d4846-e6e6-4896-8c17-8c08606f272f None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:58.481295 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:58.486915 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 524/1047] 10.222.0.67 () {60 vars in 1144 bytes} [Wed May 25 14:28:58 2022] POST /identity/v3/endpoints => generated 327 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:28:58.504983 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205e3c01-01e2-4271-a102-486494125248 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:58.552258 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f3d806-9fd6-42da-b71e-cafac1214eeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:58.552974 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f3d806-9fd6-42da-b71e-cafac1214eeb None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:58.553286 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f3d806-9fd6-42da-b71e-cafac1214eeb None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:58.553574 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f3d806-9fd6-42da-b71e-cafac1214eeb None admin] PATH_INFO: `/v3/domains` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:58.554390 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f3d806-9fd6-42da-b71e-cafac1214eeb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:28:58.554718 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f3d806-9fd6-42da-b71e-cafac1214eeb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:58.556308 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f3d806-9fd6-42da-b71e-cafac1214eeb None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:58.574640 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 524/1048] 10.222.0.67 () {56 vars in 1109 bytes} [Wed May 25 14:28:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:28:58.576929 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066d4846-e6e6-4896-8c17-8c08606f272f None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:58.633489 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:58.693739 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066d4846-e6e6-4896-8c17-8c08606f272f None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:58.728483 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4dd597-f55d-4fcd-bf8a-6d52375608d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:58.729284 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4dd597-f55d-4fcd-bf8a-6d52375608d5 None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:58.729571 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4dd597-f55d-4fcd-bf8a-6d52375608d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:58.729849 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4dd597-f55d-4fcd-bf8a-6d52375608d5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:58.737391 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4dd597-f55d-4fcd-bf8a-6d52375608d5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:58.738834 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4dd597-f55d-4fcd-bf8a-6d52375608d5 None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:58.753920 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application [None req-5e4dd597-f55d-4fcd-bf8a-6d52375608d5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 14:28:58.753920 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:28:58.753920 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:28:58.753920 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:28:58.753920 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:28:58.753920 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:28:58.753920 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:28:58.753920 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:28:58.753920 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:28:58.753920 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:28:58.753920 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:28:58.753920 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:28:58.753920 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 14:28:58.753920 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 14:28:58.753920 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 14:28:58.755101 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 14:28:58.755101 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:28:58.755101 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:28:58.755101 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:28:58.755101 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:28:58.755101 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:28:58.755101 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:28:58.755101 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:28:58.755101 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application with Lock( May 25 14:28:58.755101 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:28:58.755101 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self._enter() May 25 14:28:58.755101 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:28:58.755101 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:28:58.755101 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:28:58.755101 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.creator() May 25 14:28:58.755101 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:28:58.755101 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application created_value = creator( May 25 14:28:58.756252 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 14:28:58.756252 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 14:28:58.756252 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 14:28:58.756252 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 14:28:58.756252 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 14:28:58.756252 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 14:28:58.756252 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 14:28:58.756252 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application May 25 14:28:58.756252 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 525/1049] 10.222.0.67 () {56 vars in 1111 bytes} [Wed May 25 14:28:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 14:28:58.762685 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f3d806-9fd6-42da-b71e-cafac1214eeb None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:58.869803 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f3d806-9fd6-42da-b71e-cafac1214eeb None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:58.905460 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4196bb-59af-4488-953f-087d38be2791 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:58.906133 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4196bb-59af-4488-953f-087d38be2791 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:58.906416 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4196bb-59af-4488-953f-087d38be2791 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:58.906690 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4196bb-59af-4488-953f-087d38be2791 None admin] PATH_INFO: `/v3/projects` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:58.907547 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4196bb-59af-4488-953f-087d38be2791 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:28:58.907861 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4196bb-59af-4488-953f-087d38be2791 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:58.909296 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4196bb-59af-4488-953f-087d38be2791 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:58.912416 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:58.927148 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 525/1050] 10.222.0.67 () {56 vars in 1148 bytes} [Wed May 25 14:28:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:28:58.932964 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4dd597-f55d-4fcd-bf8a-6d52375608d5 None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:59.037000 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4dd597-f55d-4fcd-bf8a-6d52375608d5 None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:59.048306 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:59.074627 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e85160-b96e-445d-9822-fa156e95a2ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:59.075571 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e85160-b96e-445d-9822-fa156e95a2ed None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:59.076567 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e85160-b96e-445d-9822-fa156e95a2ed None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:59.077030 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e85160-b96e-445d-9822-fa156e95a2ed None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:59.078136 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e85160-b96e-445d-9822-fa156e95a2ed None admin] RBAC: Adding query filter params (role.id=a45d5a067e824fa18ca4428cff2a3889, scope.project.id=bfe93ee8d32a441295efc0b885de4bd7, user.id=428ec99478284743943ed41e9d24a603) {{(pid=80474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:28:59.078602 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e85160-b96e-445d-9822-fa156e95a2ed None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:59.080215 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e85160-b96e-445d-9822-fa156e95a2ed None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:59.086605 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 526/1051] 10.222.0.67 () {56 vars in 1374 bytes} [Wed May 25 14:28:58 2022] GET /identity/v3/role_assignments?user.id=428ec99478284743943ed41e9d24a603&scope.project.id=bfe93ee8d32a441295efc0b885de4bd7&role.id=a45d5a067e824fa18ca4428cff2a3889 => generated 259 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:28:59.509885 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fce59e-179f-4f7c-af60-d48cc25b7cb6 None None] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:59.510071 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fce59e-179f-4f7c-af60-d48cc25b7cb6 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:59.510355 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fce59e-179f-4f7c-af60-d48cc25b7cb6 None None] PATH_INFO: `/` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:59.511753 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 526/1052] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 14:28:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:28:59.517518 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd4ff7a-2488-4917-9a01-e0c0d712c4b3 None None] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:59.517816 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd4ff7a-2488-4917-9a01-e0c0d712c4b3 None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:59.518093 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd4ff7a-2488-4917-9a01-e0c0d712c4b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:59.535520 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.auth.core [None req-fdd4ff7a-2488-4917-9a01-e0c0d712c4b3 None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:28:59.536716 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-fdd4ff7a-2488-4917-9a01-e0c0d712c4b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:28:59.610607 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 527/1053] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 14:28:59 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 14:28:59.634419 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fce59e-179f-4f7c-af60-d48cc25b7cb6 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:59.741542 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fce59e-179f-4f7c-af60-d48cc25b7cb6 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:59.776180 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ebd6be-8dfa-4667-a645-5ff99b4d552a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:59.776980 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ebd6be-8dfa-4667-a645-5ff99b4d552a None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:59.777265 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ebd6be-8dfa-4667-a645-5ff99b4d552a None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:59.777543 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ebd6be-8dfa-4667-a645-5ff99b4d552a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:59.788449 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ebd6be-8dfa-4667-a645-5ff99b4d552a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:28:59.796951 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application [None req-b6ebd6be-8dfa-4667-a645-5ff99b4d552a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 14:28:59.796951 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:28:59.796951 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:28:59.796951 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:28:59.796951 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:28:59.796951 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:28:59.796951 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:28:59.796951 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:28:59.796951 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:28:59.796951 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:28:59.796951 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:28:59.796951 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:28:59.796951 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:28:59.796951 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:28:59.796951 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:28:59.796951 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:28:59.797893 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:28:59.797893 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:28:59.797893 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:28:59.797893 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:28:59.797893 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:28:59.797893 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:28:59.797893 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:28:59.797893 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:28:59.797893 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:28:59.797893 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:28:59.797893 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:28:59.797893 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application with Lock( May 25 14:28:59.797893 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:28:59.797893 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._enter() May 25 14:28:59.797893 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:28:59.797893 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:28:59.798744 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:28:59.798744 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.creator() May 25 14:28:59.798744 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:28:59.798744 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application created_value = creator( May 25 14:28:59.798744 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:28:59.798744 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:28:59.798744 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:28:59.798744 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:28:59.798744 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:28:59.798744 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:28:59.798744 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 14:28:59.798744 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:28:59.806236 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 527/1054] 10.222.0.67 () {56 vars in 1096 bytes} [Wed May 25 14:28:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:28:59.806383 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd4ff7a-2488-4917-9a01-e0c0d712c4b3 None None] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:59.914666 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd4ff7a-2488-4917-9a01-e0c0d712c4b3 None None] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:59.917808 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:59.951703 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0986ce15-ce7d-487a-bff9-bde3b80eb137 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:59.952316 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0986ce15-ce7d-487a-bff9-bde3b80eb137 None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:59.952600 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0986ce15-ce7d-487a-bff9-bde3b80eb137 None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:59.952875 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0986ce15-ce7d-487a-bff9-bde3b80eb137 None admin] PATH_INFO: `/v3/roles` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:59.953616 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0986ce15-ce7d-487a-bff9-bde3b80eb137 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:28:59.953923 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0986ce15-ce7d-487a-bff9-bde3b80eb137 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:59.955296 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0986ce15-ce7d-487a-bff9-bde3b80eb137 None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:59.963755 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 528/1055] 10.222.0.67 () {56 vars in 1099 bytes} [Wed May 25 14:28:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:28:59.969434 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ebd6be-8dfa-4667-a645-5ff99b4d552a None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:00.025831 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:00.072417 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ebd6be-8dfa-4667-a645-5ff99b4d552a None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:00.105798 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59992049-3419-4959-b2d9-9c5308d7f803 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:00.106659 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59992049-3419-4959-b2d9-9c5308d7f803 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:00.106944 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59992049-3419-4959-b2d9-9c5308d7f803 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:00.107768 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59992049-3419-4959-b2d9-9c5308d7f803 None admin] PATH_INFO: `/v3/users/4456e115599c41fcae42ec073dd289d4` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:00.121111 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59992049-3419-4959-b2d9-9c5308d7f803 None admin] RBAC: Authorizing `identity:get_user(user_id=4456e115599c41fcae42ec073dd289d4)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:00.123422 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59992049-3419-4959-b2d9-9c5308d7f803 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:00.125349 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 528/1056] 10.222.0.67 () {56 vars in 1177 bytes} [Wed May 25 14:28:59 2022] GET /identity/v3/users/4456e115599c41fcae42ec073dd289d4 => generated 285 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:29:00.130768 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0986ce15-ce7d-487a-bff9-bde3b80eb137 None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:00.233839 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0986ce15-ce7d-487a-bff9-bde3b80eb137 None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:00.268313 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963bd438-ad07-4001-ab8a-0cfc6724268b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:00.268963 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963bd438-ad07-4001-ab8a-0cfc6724268b None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:00.269244 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963bd438-ad07-4001-ab8a-0cfc6724268b None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:00.269523 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963bd438-ad07-4001-ab8a-0cfc6724268b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:00.303576 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:00.339316 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963bd438-ad07-4001-ab8a-0cfc6724268b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:00.340680 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963bd438-ad07-4001-ab8a-0cfc6724268b None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:00.438827 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 529/1057] 10.222.0.67 () {58 vars in 1282 bytes} [Wed May 25 14:29:00 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 25 14:29:00.444417 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59992049-3419-4959-b2d9-9c5308d7f803 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:00.547262 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59992049-3419-4959-b2d9-9c5308d7f803 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:00.562381 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:00.586726 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d191f5a-5985-4810-9817-b8e380f74ee5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:00.587714 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d191f5a-5985-4810-9817-b8e380f74ee5 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:00.588003 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d191f5a-5985-4810-9817-b8e380f74ee5 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:00.588281 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d191f5a-5985-4810-9817-b8e380f74ee5 None admin] PATH_INFO: `/v3/projects/4dc3bba175574309a5e7a9a57fdba146` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:00.589628 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d191f5a-5985-4810-9817-b8e380f74ee5 None admin] RBAC: Authorizing `identity:get_project(project_id=4dc3bba175574309a5e7a9a57fdba146)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:00.591093 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d191f5a-5985-4810-9817-b8e380f74ee5 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:00.594361 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 529/1058] 10.222.0.67 () {56 vars in 1186 bytes} [Wed May 25 14:29:00 2022] GET /identity/v3/projects/4dc3bba175574309a5e7a9a57fdba146 => generated 311 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:29:00.600485 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963bd438-ad07-4001-ab8a-0cfc6724268b None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:00.671646 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:00.709274 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963bd438-ad07-4001-ab8a-0cfc6724268b None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:00.745832 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffcdf1d-1da1-40ec-9de7-0d1c584c806f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:00.746497 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffcdf1d-1da1-40ec-9de7-0d1c584c806f None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:00.746783 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffcdf1d-1da1-40ec-9de7-0d1c584c806f None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:00.747340 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffcdf1d-1da1-40ec-9de7-0d1c584c806f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:00.748814 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffcdf1d-1da1-40ec-9de7-0d1c584c806f None admin] RBAC: Adding query filter params (role.id=399893e19eac4ab5a8e596f7c07be13c, scope.project.id=4dc3bba175574309a5e7a9a57fdba146, user.id=4456e115599c41fcae42ec073dd289d4) {{(pid=80474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:29:00.749128 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffcdf1d-1da1-40ec-9de7-0d1c584c806f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:00.750555 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffcdf1d-1da1-40ec-9de7-0d1c584c806f None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:00.763258 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 530/1059] 10.222.0.67 () {56 vars in 1374 bytes} [Wed May 25 14:29:00 2022] GET /identity/v3/role_assignments?user.id=4456e115599c41fcae42ec073dd289d4&scope.project.id=4dc3bba175574309a5e7a9a57fdba146&role.id=399893e19eac4ab5a8e596f7c07be13c => generated 259 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:29:00.774223 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf92db50-aa94-4f82-bcf3-aca7d693a629 None None] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:00.774513 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf92db50-aa94-4f82-bcf3-aca7d693a629 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:00.774789 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf92db50-aa94-4f82-bcf3-aca7d693a629 None None] PATH_INFO: `/` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:00.776285 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 530/1060] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 14:29:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:29:00.782839 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe48d17-b296-48f0-ab66-a0698a4dcce1 None None] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:00.783177 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe48d17-b296-48f0-ab66-a0698a4dcce1 None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:00.783465 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe48d17-b296-48f0-ab66-a0698a4dcce1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:00.802481 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.auth.core [None req-5fe48d17-b296-48f0-ab66-a0698a4dcce1 None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:29:00.803743 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-5fe48d17-b296-48f0-ab66-a0698a4dcce1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:29:00.883533 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 531/1061] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 14:29:00 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 14:29:00.907267 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf92db50-aa94-4f82-bcf3-aca7d693a629 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:01.019358 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf92db50-aa94-4f82-bcf3-aca7d693a629 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:01.053964 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234cd2b4-89ff-41ae-b5a1-a70cd43f33ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:01.054626 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234cd2b4-89ff-41ae-b5a1-a70cd43f33ac None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:01.054914 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234cd2b4-89ff-41ae-b5a1-a70cd43f33ac None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:01.055218 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234cd2b4-89ff-41ae-b5a1-a70cd43f33ac None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:01.106779 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:01.129379 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234cd2b4-89ff-41ae-b5a1-a70cd43f33ac None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:01.130888 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234cd2b4-89ff-41ae-b5a1-a70cd43f33ac None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:01.232581 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 531/1062] 10.222.0.67 () {58 vars in 1282 bytes} [Wed May 25 14:29:00 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 25 14:29:01.238322 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe48d17-b296-48f0-ab66-a0698a4dcce1 None None] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:01.299242 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d43305b-7fd7-4ac1-94b3-a06d47b82acb None None] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:01.299577 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d43305b-7fd7-4ac1-94b3-a06d47b82acb None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:01.299812 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d43305b-7fd7-4ac1-94b3-a06d47b82acb None None] PATH_INFO: `/` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:01.301218 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 532/1063] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 14:29:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 14:29:01.304156 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:01.306586 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0aa45df-c37a-461d-ae2c-3f3675a90991 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:01.306866 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0aa45df-c37a-461d-ae2c-3f3675a90991 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:01.307174 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0aa45df-c37a-461d-ae2c-3f3675a90991 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:01.329375 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-b0aa45df-c37a-461d-ae2c-3f3675a90991 None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:29:01.330724 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-b0aa45df-c37a-461d-ae2c-3f3675a90991 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:29:01.349191 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe48d17-b296-48f0-ab66-a0698a4dcce1 None None] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:01.385401 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c138d1-5e44-4c62-af74-4b9a34d14cd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:01.386227 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c138d1-5e44-4c62-af74-4b9a34d14cd8 None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:01.386507 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c138d1-5e44-4c62-af74-4b9a34d14cd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:01.387030 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c138d1-5e44-4c62-af74-4b9a34d14cd8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:01.398759 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c138d1-5e44-4c62-af74-4b9a34d14cd8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:01.400342 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c138d1-5e44-4c62-af74-4b9a34d14cd8 None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:01.407036 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 533/1064] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 14:29:01 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 25 14:29:01.425334 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application [None req-91c138d1-5e44-4c62-af74-4b9a34d14cd8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:29:01.425334 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:29:01.425334 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:29:01.425334 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:29:01.425334 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:29:01.425334 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:29:01.425334 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:29:01.425334 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:29:01.425334 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:29:01.425334 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:29:01.425334 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:29:01.425334 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:29:01.425334 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 14:29:01.425334 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 14:29:01.425334 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 14:29:01.426374 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 14:29:01.426374 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:29:01.426374 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:29:01.426374 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:29:01.426374 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:29:01.426374 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:29:01.426374 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:29:01.426374 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:29:01.426374 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application with Lock( May 25 14:29:01.426374 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:29:01.426374 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self._enter() May 25 14:29:01.426374 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:29:01.426374 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:29:01.426374 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:29:01.426374 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.creator() May 25 14:29:01.426374 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:29:01.426374 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application created_value = creator( May 25 14:29:01.428110 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 14:29:01.428110 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 14:29:01.428110 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:29:01.428110 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application May 25 14:29:01.428602 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0aa45df-c37a-461d-ae2c-3f3675a90991 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:01.431332 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 532/1065] 10.222.0.67 () {56 vars in 1108 bytes} [Wed May 25 14:29:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:29:01.432194 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c138d1-5e44-4c62-af74-4b9a34d14cd8 None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:01.444153 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:01.538906 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c138d1-5e44-4c62-af74-4b9a34d14cd8 None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:01.541404 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0aa45df-c37a-461d-ae2c-3f3675a90991 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:01.554231 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:01.578508 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d37c3a-03b7-4de2-ae4c-e0e9f211f39b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:01.579155 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505a9e53-92e4-4dc0-b2a0-48238219ea56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:01.579365 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d37c3a-03b7-4de2-ae4c-e0e9f211f39b None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:01.579643 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d37c3a-03b7-4de2-ae4c-e0e9f211f39b None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:01.579812 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505a9e53-92e4-4dc0-b2a0-48238219ea56 None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:01.579907 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d37c3a-03b7-4de2-ae4c-e0e9f211f39b None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:01.580081 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505a9e53-92e4-4dc0-b2a0-48238219ea56 None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:01.580357 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505a9e53-92e4-4dc0-b2a0-48238219ea56 None admin] PATH_INFO: `/v3/domains` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:01.581247 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505a9e53-92e4-4dc0-b2a0-48238219ea56 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:29:01.581553 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505a9e53-92e4-4dc0-b2a0-48238219ea56 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:01.582928 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505a9e53-92e4-4dc0-b2a0-48238219ea56 None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:01.592948 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d37c3a-03b7-4de2-ae4c-e0e9f211f39b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:29:01.595711 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 533/1066] 10.222.0.67 () {56 vars in 1109 bytes} [Wed May 25 14:29:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:29:01.601518 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application [None req-c0d37c3a-03b7-4de2-ae4c-e0e9f211f39b None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 25 14:29:01.601518 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:29:01.601518 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:29:01.601518 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:29:01.601518 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:29:01.601518 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:29:01.601518 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:29:01.601518 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:29:01.601518 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:29:01.601518 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:29:01.601518 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:29:01.601518 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:29:01.601518 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:29:01.601518 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:29:01.601518 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:29:01.601518 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:29:01.602530 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:29:01.602530 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:29:01.602530 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:29:01.602530 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:29:01.602530 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:29:01.602530 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:29:01.602530 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:29:01.602530 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:29:01.602530 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:29:01.602530 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:29:01.602530 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:29:01.602530 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application with Lock( May 25 14:29:01.602530 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:29:01.602530 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._enter() May 25 14:29:01.602530 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:29:01.602530 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:29:01.609440 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:29:01.609440 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.creator() May 25 14:29:01.609440 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:29:01.609440 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application created_value = creator( May 25 14:29:01.609440 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:29:01.609440 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:29:01.609440 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:29:01.609440 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:29:01.609440 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:29:01.609440 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:29:01.609440 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 25 14:29:01.609440 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:29:01.609440 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 534/1067] 10.222.0.67 () {56 vars in 1120 bytes} [Wed May 25 14:29:01 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 14:29:01.610228 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505a9e53-92e4-4dc0-b2a0-48238219ea56 None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:01.725758 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505a9e53-92e4-4dc0-b2a0-48238219ea56 None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:01.762931 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc7177b-eb43-4285-8255-235c985bc994 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:01.764426 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc7177b-eb43-4285-8255-235c985bc994 None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:01.764717 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc7177b-eb43-4285-8255-235c985bc994 None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:01.764996 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc7177b-eb43-4285-8255-235c985bc994 None admin] PATH_INFO: `/v3/roles` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:01.765762 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc7177b-eb43-4285-8255-235c985bc994 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:29:01.766070 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc7177b-eb43-4285-8255-235c985bc994 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:01.767480 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc7177b-eb43-4285-8255-235c985bc994 None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:01.776884 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 534/1068] 10.222.0.67 () {56 vars in 1115 bytes} [Wed May 25 14:29:01 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:29:01.783394 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d37c3a-03b7-4de2-ae4c-e0e9f211f39b None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:01.868772 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:01.907860 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d37c3a-03b7-4de2-ae4c-e0e9f211f39b None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:01.944785 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07785b81-05b3-4098-9ef2-a8ec48bd73e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:01.945576 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07785b81-05b3-4098-9ef2-a8ec48bd73e8 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:01.945855 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07785b81-05b3-4098-9ef2-a8ec48bd73e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:01.946125 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07785b81-05b3-4098-9ef2-a8ec48bd73e8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:01.956981 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07785b81-05b3-4098-9ef2-a8ec48bd73e8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:01.958451 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07785b81-05b3-4098-9ef2-a8ec48bd73e8 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:01.975998 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application [None req-07785b81-05b3-4098-9ef2-a8ec48bd73e8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:29:01.975998 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:29:01.975998 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:29:01.975998 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:29:01.975998 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:29:01.975998 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:29:01.975998 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:29:01.975998 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:29:01.975998 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:29:01.975998 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:29:01.975998 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:29:01.975998 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:29:01.975998 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 14:29:01.975998 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 14:29:01.975998 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 14:29:01.976957 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 14:29:01.976957 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:29:01.976957 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:29:01.976957 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:29:01.976957 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:29:01.976957 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:29:01.976957 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:29:01.976957 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:29:01.976957 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application with Lock( May 25 14:29:01.976957 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:29:01.976957 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._enter() May 25 14:29:01.976957 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:29:01.976957 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:29:01.976957 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:29:01.976957 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.creator() May 25 14:29:01.976957 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:29:01.976957 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application created_value = creator( May 25 14:29:01.977896 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 14:29:01.977896 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 14:29:01.977896 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:29:01.977896 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:29:01.977896 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 535/1069] 10.222.0.67 () {56 vars in 1108 bytes} [Wed May 25 14:29:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 14:29:01.983402 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc7177b-eb43-4285-8255-235c985bc994 None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:02.017356 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:02.082463 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc7177b-eb43-4285-8255-235c985bc994 None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:02.116164 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8d4883-3bc3-4b1c-9d3f-a9aa33a75dc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:02.116820 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8d4883-3bc3-4b1c-9d3f-a9aa33a75dc9 None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:02.117099 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8d4883-3bc3-4b1c-9d3f-a9aa33a75dc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:02.117372 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8d4883-3bc3-4b1c-9d3f-a9aa33a75dc9 None admin] PATH_INFO: `/v3/domains` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:02.118089 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8d4883-3bc3-4b1c-9d3f-a9aa33a75dc9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:29:02.118394 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8d4883-3bc3-4b1c-9d3f-a9aa33a75dc9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:02.119791 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8d4883-3bc3-4b1c-9d3f-a9aa33a75dc9 None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:02.131604 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 535/1070] 10.222.0.67 () {56 vars in 1109 bytes} [Wed May 25 14:29:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:29:02.137144 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07785b81-05b3-4098-9ef2-a8ec48bd73e8 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:02.240248 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07785b81-05b3-4098-9ef2-a8ec48bd73e8 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:02.263121 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:02.274541 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b044920-ca96-4bc7-a6aa-90aee1af1566 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:02.275353 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b044920-ca96-4bc7-a6aa-90aee1af1566 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:02.275641 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b044920-ca96-4bc7-a6aa-90aee1af1566 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:02.275916 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b044920-ca96-4bc7-a6aa-90aee1af1566 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:02.283921 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b044920-ca96-4bc7-a6aa-90aee1af1566 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:02.285363 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b044920-ca96-4bc7-a6aa-90aee1af1566 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:02.299673 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application [None req-5b044920-ca96-4bc7-a6aa-90aee1af1566 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 25 14:29:02.299673 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:29:02.299673 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:29:02.299673 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:29:02.299673 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:29:02.299673 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:29:02.299673 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:29:02.299673 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:29:02.299673 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:29:02.299673 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:29:02.299673 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:29:02.299673 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:29:02.299673 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 14:29:02.299673 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 14:29:02.299673 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 14:29:02.299673 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 14:29:02.300745 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:29:02.300745 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:29:02.300745 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 14:29:02.300745 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 14:29:02.300745 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 14:29:02.300745 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 14:29:02.300745 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:29:02.300745 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:29:02.300745 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:29:02.300745 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:29:02.300745 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:29:02.300745 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application with Lock( May 25 14:29:02.300745 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:29:02.300745 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._enter() May 25 14:29:02.300745 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:29:02.300745 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:29:02.300745 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:29:02.300745 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.creator() May 25 14:29:02.301737 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:29:02.301737 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application created_value = creator( May 25 14:29:02.301737 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 14:29:02.301737 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 14:29:02.301737 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 14:29:02.301737 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 14:29:02.301737 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 14:29:02.301737 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 14:29:02.301737 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 25 14:29:02.301737 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:29:02.301737 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 536/1071] 10.222.0.67 () {56 vars in 1093 bytes} [Wed May 25 14:29:02 2022] GET /identity/v3/users/nova => generated 82 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:29:02.306612 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8d4883-3bc3-4b1c-9d3f-a9aa33a75dc9 None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:02.399542 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:02.407218 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8d4883-3bc3-4b1c-9d3f-a9aa33a75dc9 None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:02.440399 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075d6cd3-ae84-4028-b82f-8dd16a96d439 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:02.441176 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075d6cd3-ae84-4028-b82f-8dd16a96d439 None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:02.441529 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075d6cd3-ae84-4028-b82f-8dd16a96d439 None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:02.441874 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075d6cd3-ae84-4028-b82f-8dd16a96d439 None admin] PATH_INFO: `/v3/users` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:02.442791 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075d6cd3-ae84-4028-b82f-8dd16a96d439 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:29:02.443200 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075d6cd3-ae84-4028-b82f-8dd16a96d439 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:02.444691 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075d6cd3-ae84-4028-b82f-8dd16a96d439 None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:02.462552 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 536/1072] 10.222.0.67 () {56 vars in 1133 bytes} [Wed May 25 14:29:02 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:29:02.468815 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b044920-ca96-4bc7-a6aa-90aee1af1566 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:02.567236 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b044920-ca96-4bc7-a6aa-90aee1af1566 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:02.605415 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d80f77e-3e0b-4028-b287-21dd3dae01da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:02.606206 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d80f77e-3e0b-4028-b287-21dd3dae01da None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:02.606494 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d80f77e-3e0b-4028-b287-21dd3dae01da None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:02.606773 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d80f77e-3e0b-4028-b287-21dd3dae01da None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:02.617739 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d80f77e-3e0b-4028-b287-21dd3dae01da None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:02.619230 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d80f77e-3e0b-4028-b287-21dd3dae01da None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:02.636784 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application [None req-3d80f77e-3e0b-4028-b287-21dd3dae01da None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:29:02.636784 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:29:02.636784 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:29:02.636784 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:29:02.636784 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:29:02.636784 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:29:02.636784 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:29:02.636784 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:29:02.636784 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:29:02.636784 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:29:02.636784 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:29:02.636784 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:29:02.636784 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 14:29:02.636784 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 14:29:02.636784 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 14:29:02.637889 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 14:29:02.637889 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:29:02.637889 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:29:02.637889 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:29:02.637889 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:29:02.637889 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:29:02.637889 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:29:02.637889 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:29:02.637889 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application with Lock( May 25 14:29:02.637889 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:29:02.637889 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._enter() May 25 14:29:02.637889 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:29:02.637889 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:29:02.637889 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:29:02.637889 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.creator() May 25 14:29:02.637889 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:29:02.637889 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application created_value = creator( May 25 14:29:02.639973 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 14:29:02.639973 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 14:29:02.639973 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:29:02.639973 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:29:02.642944 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 537/1073] 10.222.0.67 () {56 vars in 1108 bytes} [Wed May 25 14:29:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:29:02.644313 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075d6cd3-ae84-4028-b82f-8dd16a96d439 None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:02.744186 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075d6cd3-ae84-4028-b82f-8dd16a96d439 None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:02.777344 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e394d5-162e-4fd7-b5b2-e0caeca2bf64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:02.778003 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e394d5-162e-4fd7-b5b2-e0caeca2bf64 None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:02.778287 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e394d5-162e-4fd7-b5b2-e0caeca2bf64 None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:02.778563 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e394d5-162e-4fd7-b5b2-e0caeca2bf64 None admin] PATH_INFO: `/v3/domains` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:02.780013 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e394d5-162e-4fd7-b5b2-e0caeca2bf64 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:29:02.780332 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e394d5-162e-4fd7-b5b2-e0caeca2bf64 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:02.781696 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e394d5-162e-4fd7-b5b2-e0caeca2bf64 None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:02.793079 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 537/1074] 10.222.0.67 () {56 vars in 1109 bytes} [Wed May 25 14:29:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:29:02.799395 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d80f77e-3e0b-4028-b287-21dd3dae01da None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:02.844332 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:02.911230 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d80f77e-3e0b-4028-b287-21dd3dae01da None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:02.945140 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20af263-f33f-4a38-867b-d9f330d7e9c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:02.945927 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20af263-f33f-4a38-867b-d9f330d7e9c9 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:02.946212 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20af263-f33f-4a38-867b-d9f330d7e9c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:02.946487 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20af263-f33f-4a38-867b-d9f330d7e9c9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:02.953605 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20af263-f33f-4a38-867b-d9f330d7e9c9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:02.955086 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20af263-f33f-4a38-867b-d9f330d7e9c9 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:02.970959 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application [None req-a20af263-f33f-4a38-867b-d9f330d7e9c9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 14:29:02.970959 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:29:02.970959 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:29:02.970959 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:29:02.970959 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:29:02.970959 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:29:02.970959 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:29:02.970959 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:29:02.970959 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:29:02.970959 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:29:02.970959 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:29:02.970959 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:29:02.970959 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 14:29:02.970959 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 14:29:02.970959 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 14:29:02.971903 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 14:29:02.971903 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:29:02.971903 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:29:02.971903 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:29:02.971903 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:29:02.971903 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:29:02.971903 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:29:02.971903 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:29:02.971903 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application with Lock( May 25 14:29:02.971903 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:29:02.971903 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._enter() May 25 14:29:02.971903 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:29:02.971903 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:29:02.971903 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:29:02.971903 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.creator() May 25 14:29:02.971903 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:29:02.971903 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application created_value = creator( May 25 14:29:02.972833 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 14:29:02.972833 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 14:29:02.972833 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 14:29:02.972833 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 14:29:02.972833 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 14:29:02.972833 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 14:29:02.972833 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 14:29:02.972833 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:29:02.972833 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 538/1075] 10.222.0.67 () {56 vars in 1111 bytes} [Wed May 25 14:29:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:29:02.977875 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e394d5-162e-4fd7-b5b2-e0caeca2bf64 None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:02.994358 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:03.000981 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e07723c-ee98-4486-8bf6-f1c45935ff7f None None] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:03.001268 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e07723c-ee98-4486-8bf6-f1c45935ff7f None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:03.001546 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e07723c-ee98-4486-8bf6-f1c45935ff7f None None] PATH_INFO: `/` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:03.002922 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 539/1076] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 14:29:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 14:29:03.007881 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7c5275-7fd3-4fbb-8136-62ee30313e76 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:03.008166 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7c5275-7fd3-4fbb-8136-62ee30313e76 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:03.008439 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7c5275-7fd3-4fbb-8136-62ee30313e76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:03.025945 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-3a7c5275-7fd3-4fbb-8136-62ee30313e76 None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:29:03.027160 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-3a7c5275-7fd3-4fbb-8136-62ee30313e76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:29:03.085431 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e394d5-162e-4fd7-b5b2-e0caeca2bf64 None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:03.095249 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 540/1077] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 14:29:03 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 25 14:29:03.117979 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7c5275-7fd3-4fbb-8136-62ee30313e76 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:03.118905 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12c967c-9f8a-4a00-8c20-9d22e6639ac9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:03.119597 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12c967c-9f8a-4a00-8c20-9d22e6639ac9 None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:03.119877 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12c967c-9f8a-4a00-8c20-9d22e6639ac9 None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:03.120154 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12c967c-9f8a-4a00-8c20-9d22e6639ac9 None admin] PATH_INFO: `/v3/projects` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:03.120943 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12c967c-9f8a-4a00-8c20-9d22e6639ac9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:29:03.121251 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12c967c-9f8a-4a00-8c20-9d22e6639ac9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:03.123900 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12c967c-9f8a-4a00-8c20-9d22e6639ac9 None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:03.135523 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 538/1078] 10.222.0.67 () {56 vars in 1148 bytes} [Wed May 25 14:29:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:29:03.141872 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12c967c-9f8a-4a00-8c20-9d22e6639ac9 None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:03.150135 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:03.215375 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:03.226955 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7c5275-7fd3-4fbb-8136-62ee30313e76 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:03.244539 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12c967c-9f8a-4a00-8c20-9d22e6639ac9 None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:03.261985 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72601650-478d-4706-bec5-8ea0d72edf79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:03.262887 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72601650-478d-4706-bec5-8ea0d72edf79 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:03.263235 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72601650-478d-4706-bec5-8ea0d72edf79 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:03.263516 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72601650-478d-4706-bec5-8ea0d72edf79 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:03.273474 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72601650-478d-4706-bec5-8ea0d72edf79 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:29:03.280269 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fd9dcc-e906-48f3-a603-fd7ede13668f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:03.281154 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application [None req-72601650-478d-4706-bec5-8ea0d72edf79 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 14:29:03.281154 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:29:03.281154 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:29:03.281154 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:29:03.281154 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:29:03.281154 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:29:03.281154 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:29:03.281154 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:29:03.281154 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:29:03.281154 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:29:03.281154 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:29:03.281154 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:29:03.281154 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:29:03.281154 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:29:03.281154 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:29:03.281154 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:29:03.282232 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:29:03.282232 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:29:03.282232 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:29:03.282232 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:29:03.282232 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:29:03.282232 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:29:03.282232 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:29:03.282232 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:29:03.282232 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:29:03.282232 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:29:03.282232 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:29:03.282232 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application with Lock( May 25 14:29:03.282232 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:29:03.282232 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._enter() May 25 14:29:03.282232 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:29:03.282232 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:29:03.283156 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:29:03.283156 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.creator() May 25 14:29:03.283156 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:29:03.283156 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application created_value = creator( May 25 14:29:03.283156 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:29:03.283156 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:29:03.283156 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:29:03.283156 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:29:03.283156 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:29:03.283156 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:29:03.283156 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 14:29:03.283156 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:29:03.283819 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fd9dcc-e906-48f3-a603-fd7ede13668f None admin] REQUEST_METHOD: `PUT` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:03.283819 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fd9dcc-e906-48f3-a603-fd7ede13668f None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:03.283819 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fd9dcc-e906-48f3-a603-fd7ede13668f None admin] PATH_INFO: `/v3/projects/bfe93ee8d32a441295efc0b885de4bd7/users/428ec99478284743943ed41e9d24a603/roles/a45d5a067e824fa18ca4428cff2a3889` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:03.284027 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 541/1079] 10.222.0.67 () {56 vars in 1096 bytes} [Wed May 25 14:29:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 14:29:03.288296 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72601650-478d-4706-bec5-8ea0d72edf79 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:03.288406 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fd9dcc-e906-48f3-a603-fd7ede13668f None admin] RBAC: Authorizing `identity:create_grant(project_id=bfe93ee8d32a441295efc0b885de4bd7, user_id=428ec99478284743943ed41e9d24a603, role_id=a45d5a067e824fa18ca4428cff2a3889)` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:03.289743 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fd9dcc-e906-48f3-a603-fd7ede13668f None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:03.304746 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 539/1080] 10.222.0.67 () {58 vars in 1439 bytes} [Wed May 25 14:29:03 2022] PUT /identity/v3/projects/bfe93ee8d32a441295efc0b885de4bd7/users/428ec99478284743943ed41e9d24a603/roles/a45d5a067e824fa18ca4428cff2a3889 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 14:29:03.379629 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:03.395861 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72601650-478d-4706-bec5-8ea0d72edf79 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:03.431104 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a9e73f-1cce-4e37-99a2-614621ca2afd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:03.431789 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a9e73f-1cce-4e37-99a2-614621ca2afd None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:03.432075 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a9e73f-1cce-4e37-99a2-614621ca2afd None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:03.432352 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a9e73f-1cce-4e37-99a2-614621ca2afd None admin] PATH_INFO: `/v3/roles` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:03.433114 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a9e73f-1cce-4e37-99a2-614621ca2afd None admin] RBAC: Adding query filter params (name=admin) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:29:03.433426 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a9e73f-1cce-4e37-99a2-614621ca2afd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:03.434841 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a9e73f-1cce-4e37-99a2-614621ca2afd None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:03.449620 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 542/1081] 10.222.0.67 () {56 vars in 1099 bytes} [Wed May 25 14:29:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:29:03.451318 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fd9dcc-e906-48f3-a603-fd7ede13668f None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:03.559244 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fd9dcc-e906-48f3-a603-fd7ede13668f None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:03.589943 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:03.595797 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd38427b-1ef7-42f7-9aa4-7763cd3f5b56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:03.596691 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd38427b-1ef7-42f7-9aa4-7763cd3f5b56 None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:03.597120 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd38427b-1ef7-42f7-9aa4-7763cd3f5b56 None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:03.597565 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd38427b-1ef7-42f7-9aa4-7763cd3f5b56 None admin] PATH_INFO: `/v3/users/4456e115599c41fcae42ec073dd289d4` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:03.598749 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd38427b-1ef7-42f7-9aa4-7763cd3f5b56 None admin] RBAC: Authorizing `identity:get_user(user_id=4456e115599c41fcae42ec073dd289d4)` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:03.600212 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd38427b-1ef7-42f7-9aa4-7763cd3f5b56 None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:03.602075 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 540/1082] 10.222.0.67 () {56 vars in 1177 bytes} [Wed May 25 14:29:03 2022] GET /identity/v3/users/4456e115599c41fcae42ec073dd289d4 => generated 285 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:29:03.607550 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a9e73f-1cce-4e37-99a2-614621ca2afd None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:03.707427 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a9e73f-1cce-4e37-99a2-614621ca2afd None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:03.740173 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62a0dc1-f519-4622-8323-620e92f56880 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:03.741027 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62a0dc1-f519-4622-8323-620e92f56880 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:03.741309 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62a0dc1-f519-4622-8323-620e92f56880 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:03.741586 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62a0dc1-f519-4622-8323-620e92f56880 None admin] PATH_INFO: `/v3/projects/4dc3bba175574309a5e7a9a57fdba146` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:03.742746 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62a0dc1-f519-4622-8323-620e92f56880 None admin] RBAC: Authorizing `identity:get_project(project_id=4dc3bba175574309a5e7a9a57fdba146)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:03.744241 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62a0dc1-f519-4622-8323-620e92f56880 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:03.745963 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 543/1083] 10.222.0.67 () {56 vars in 1186 bytes} [Wed May 25 14:29:03 2022] GET /identity/v3/projects/4dc3bba175574309a5e7a9a57fdba146 => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:29:03.752795 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd38427b-1ef7-42f7-9aa4-7763cd3f5b56 None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:03.853179 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd38427b-1ef7-42f7-9aa4-7763cd3f5b56 None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:03.889298 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4c402c-5d25-42b7-aa33-e454d742cddd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:03.890181 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4c402c-5d25-42b7-aa33-e454d742cddd None admin] REQUEST_METHOD: `PUT` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:03.890464 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4c402c-5d25-42b7-aa33-e454d742cddd None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:03.890737 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4c402c-5d25-42b7-aa33-e454d742cddd None admin] PATH_INFO: `/v3/projects/4dc3bba175574309a5e7a9a57fdba146/users/4456e115599c41fcae42ec073dd289d4/roles/399893e19eac4ab5a8e596f7c07be13c` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:03.892716 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4c402c-5d25-42b7-aa33-e454d742cddd None admin] RBAC: Authorizing `identity:create_grant(project_id=4dc3bba175574309a5e7a9a57fdba146, user_id=4456e115599c41fcae42ec073dd289d4, role_id=399893e19eac4ab5a8e596f7c07be13c)` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:03.894138 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4c402c-5d25-42b7-aa33-e454d742cddd None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:03.907163 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 541/1084] 10.222.0.67 () {58 vars in 1439 bytes} [Wed May 25 14:29:03 2022] PUT /identity/v3/projects/4dc3bba175574309a5e7a9a57fdba146/users/4456e115599c41fcae42ec073dd289d4/roles/399893e19eac4ab5a8e596f7c07be13c => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:29:05.495485 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89621af3-65ac-4880-a48b-57135cc56612 None None] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:05.496047 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89621af3-65ac-4880-a48b-57135cc56612 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:05.496047 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89621af3-65ac-4880-a48b-57135cc56612 None None] PATH_INFO: `/` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:05.498197 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 544/1085] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 14:29:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:29:05.503176 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ba3653-c9cb-43f6-86fb-0293ebfbb6d7 None None] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:05.503608 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ba3653-c9cb-43f6-86fb-0293ebfbb6d7 None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:05.503745 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ba3653-c9cb-43f6-86fb-0293ebfbb6d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:05.520816 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.auth.core [None req-23ba3653-c9cb-43f6-86fb-0293ebfbb6d7 None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:29:05.521996 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-23ba3653-c9cb-43f6-86fb-0293ebfbb6d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:29:05.579141 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:05.591205 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 542/1086] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 14:29:05 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 14:29:05.616708 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89621af3-65ac-4880-a48b-57135cc56612 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:05.636279 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:05.719810 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89621af3-65ac-4880-a48b-57135cc56612 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:05.754492 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c91386-5594-4eb7-8546-94fa49aa72f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:05.755347 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c91386-5594-4eb7-8546-94fa49aa72f2 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:05.755637 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c91386-5594-4eb7-8546-94fa49aa72f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:05.755918 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c91386-5594-4eb7-8546-94fa49aa72f2 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:05.766005 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c91386-5594-4eb7-8546-94fa49aa72f2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:29:05.774187 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application [None req-07c91386-5594-4eb7-8546-94fa49aa72f2 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 25 14:29:05.774187 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:29:05.774187 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:29:05.774187 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:29:05.774187 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:29:05.774187 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:29:05.774187 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:29:05.774187 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:29:05.774187 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:29:05.774187 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:29:05.774187 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:29:05.774187 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:29:05.774187 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:29:05.774187 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:29:05.774187 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:29:05.774187 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:29:05.775258 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:29:05.775258 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:29:05.775258 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:29:05.775258 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:29:05.775258 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:29:05.775258 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:29:05.775258 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:29:05.775258 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:29:05.775258 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:29:05.775258 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:29:05.775258 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:29:05.775258 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application with Lock( May 25 14:29:05.775258 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:29:05.775258 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._enter() May 25 14:29:05.775258 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:29:05.775258 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:29:05.776123 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:29:05.776123 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.creator() May 25 14:29:05.776123 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:29:05.776123 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application created_value = creator( May 25 14:29:05.776123 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:29:05.776123 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:29:05.776123 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:29:05.776123 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:29:05.776123 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:29:05.776123 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:29:05.776123 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 25 14:29:05.776123 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:29:05.776123 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 545/1087] 10.222.0.67 () {56 vars in 1120 bytes} [Wed May 25 14:29:05 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:29:05.781773 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ba3653-c9cb-43f6-86fb-0293ebfbb6d7 None None] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:05.884182 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ba3653-c9cb-43f6-86fb-0293ebfbb6d7 None None] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:05.923807 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75894972-064f-4945-bab0-020ba7313099 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:05.924857 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75894972-064f-4945-bab0-020ba7313099 None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:05.925148 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75894972-064f-4945-bab0-020ba7313099 None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:05.925426 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75894972-064f-4945-bab0-020ba7313099 None admin] PATH_INFO: `/v3/roles` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:05.926192 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75894972-064f-4945-bab0-020ba7313099 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:29:05.926507 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75894972-064f-4945-bab0-020ba7313099 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:05.928484 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75894972-064f-4945-bab0-020ba7313099 None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:05.938017 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 543/1088] 10.222.0.67 () {56 vars in 1115 bytes} [Wed May 25 14:29:05 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:29:05.943671 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c91386-5594-4eb7-8546-94fa49aa72f2 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:06.023146 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:06.047866 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c91386-5594-4eb7-8546-94fa49aa72f2 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:06.077667 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae9a483-9fba-477f-aff6-b27a12de5f49 None None] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:06.077958 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae9a483-9fba-477f-aff6-b27a12de5f49 None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:06.078240 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae9a483-9fba-477f-aff6-b27a12de5f49 None None] PATH_INFO: `/` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:06.079644 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 544/1089] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 14:29:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 14:29:06.082000 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e724b02-1944-43eb-85eb-8542177b341b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:06.082878 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e724b02-1944-43eb-85eb-8542177b341b None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:06.083264 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e724b02-1944-43eb-85eb-8542177b341b None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:06.083543 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e724b02-1944-43eb-85eb-8542177b341b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:06.084595 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707c1141-3779-465e-b444-3eff7a4929b6 None None] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:06.084890 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707c1141-3779-465e-b444-3eff7a4929b6 None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:06.085175 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707c1141-3779-465e-b444-3eff7a4929b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:06.096221 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e724b02-1944-43eb-85eb-8542177b341b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:06.097741 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e724b02-1944-43eb-85eb-8542177b341b None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:06.102100 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.auth.core [None req-707c1141-3779-465e-b444-3eff7a4929b6 None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:29:06.103323 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-707c1141-3779-465e-b444-3eff7a4929b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:29:06.115397 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application [None req-1e724b02-1944-43eb-85eb-8542177b341b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:29:06.115397 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:29:06.115397 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:29:06.115397 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:29:06.115397 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:29:06.115397 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:29:06.115397 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:29:06.115397 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:29:06.115397 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:29:06.115397 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:29:06.115397 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:29:06.115397 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:29:06.115397 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 14:29:06.115397 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 14:29:06.115397 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 14:29:06.116491 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 14:29:06.116491 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:29:06.116491 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:29:06.116491 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:29:06.116491 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:29:06.116491 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:29:06.116491 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:29:06.116491 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:29:06.116491 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application with Lock( May 25 14:29:06.116491 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:29:06.116491 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._enter() May 25 14:29:06.116491 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:29:06.116491 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:29:06.116491 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:29:06.116491 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.creator() May 25 14:29:06.116491 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:29:06.116491 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application created_value = creator( May 25 14:29:06.117429 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 14:29:06.117429 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 14:29:06.117429 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:29:06.117429 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:29:06.117429 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 546/1090] 10.222.0.67 () {56 vars in 1108 bytes} [Wed May 25 14:29:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:29:06.122284 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e724b02-1944-43eb-85eb-8542177b341b None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:06.153119 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:06.174476 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 545/1091] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 14:29:06 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 14:29:06.197599 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707c1141-3779-465e-b444-3eff7a4929b6 None None] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:06.223900 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e724b02-1944-43eb-85eb-8542177b341b None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:06.250278 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:06.258864 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50110577-b9d6-4191-ac3d-b4da385b8aa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:06.259553 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50110577-b9d6-4191-ac3d-b4da385b8aa2 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:06.259841 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50110577-b9d6-4191-ac3d-b4da385b8aa2 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:06.260127 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50110577-b9d6-4191-ac3d-b4da385b8aa2 None admin] PATH_INFO: `/v3/domains` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:06.260850 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50110577-b9d6-4191-ac3d-b4da385b8aa2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:29:06.261158 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50110577-b9d6-4191-ac3d-b4da385b8aa2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:06.262539 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50110577-b9d6-4191-ac3d-b4da385b8aa2 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:06.279811 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 547/1092] 10.222.0.67 () {56 vars in 1109 bytes} [Wed May 25 14:29:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:29:06.280795 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50110577-b9d6-4191-ac3d-b4da385b8aa2 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:06.297089 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707c1141-3779-465e-b444-3eff7a4929b6 None None] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:06.330814 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1287f306-68ce-4395-8e49-9c888a629cc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:06.331634 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1287f306-68ce-4395-8e49-9c888a629cc4 None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:06.331923 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1287f306-68ce-4395-8e49-9c888a629cc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:06.332201 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1287f306-68ce-4395-8e49-9c888a629cc4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:06.343125 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1287f306-68ce-4395-8e49-9c888a629cc4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:29:06.350810 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application [None req-1287f306-68ce-4395-8e49-9c888a629cc4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 14:29:06.350810 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:29:06.350810 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:29:06.350810 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:29:06.350810 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:29:06.350810 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:29:06.350810 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:29:06.350810 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:29:06.350810 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:29:06.350810 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:29:06.350810 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:29:06.350810 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:29:06.350810 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:29:06.350810 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:29:06.350810 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:29:06.350810 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:29:06.351975 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:29:06.351975 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:29:06.351975 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:29:06.351975 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:29:06.351975 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:29:06.351975 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:29:06.351975 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:29:06.351975 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:29:06.351975 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:29:06.351975 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:29:06.351975 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:29:06.351975 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application with Lock( May 25 14:29:06.351975 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:29:06.351975 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self._enter() May 25 14:29:06.351975 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:29:06.351975 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:29:06.352879 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:29:06.352879 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.creator() May 25 14:29:06.352879 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:29:06.352879 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application created_value = creator( May 25 14:29:06.352879 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:29:06.352879 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:29:06.352879 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:29:06.352879 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:29:06.352879 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:29:06.352879 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:29:06.352879 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 14:29:06.352879 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application May 25 14:29:06.352879 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 546/1093] 10.222.0.67 () {56 vars in 1096 bytes} [Wed May 25 14:29:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 14:29:06.357920 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1287f306-68ce-4395-8e49-9c888a629cc4 None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:06.380791 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50110577-b9d6-4191-ac3d-b4da385b8aa2 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:06.400259 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:06.416392 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a922daad-8522-4160-919f-3b52156f7d09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:06.417179 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a922daad-8522-4160-919f-3b52156f7d09 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:06.417464 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a922daad-8522-4160-919f-3b52156f7d09 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:06.417742 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a922daad-8522-4160-919f-3b52156f7d09 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:06.424935 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a922daad-8522-4160-919f-3b52156f7d09 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:06.426381 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a922daad-8522-4160-919f-3b52156f7d09 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:06.440913 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application [None req-a922daad-8522-4160-919f-3b52156f7d09 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 25 14:29:06.440913 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:29:06.440913 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:29:06.440913 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:29:06.440913 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:29:06.440913 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:29:06.440913 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:29:06.440913 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:29:06.440913 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:29:06.440913 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:29:06.440913 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:29:06.440913 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:29:06.440913 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 14:29:06.440913 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 14:29:06.440913 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 14:29:06.440913 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 14:29:06.441988 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:29:06.441988 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:29:06.441988 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 14:29:06.441988 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 14:29:06.441988 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 14:29:06.441988 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 14:29:06.441988 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:29:06.441988 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:29:06.441988 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:29:06.441988 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:29:06.441988 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:29:06.441988 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application with Lock( May 25 14:29:06.441988 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:29:06.441988 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._enter() May 25 14:29:06.441988 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:29:06.441988 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:29:06.441988 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:29:06.441988 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.creator() May 25 14:29:06.442973 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:29:06.442973 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application created_value = creator( May 25 14:29:06.442973 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 14:29:06.442973 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 14:29:06.442973 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 14:29:06.442973 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 14:29:06.442973 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 14:29:06.442973 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 14:29:06.442973 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 25 14:29:06.442973 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:29:06.442973 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 548/1094] 10.222.0.67 () {56 vars in 1093 bytes} [Wed May 25 14:29:06 2022] GET /identity/v3/users/nova => generated 82 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:29:06.448028 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a922daad-8522-4160-919f-3b52156f7d09 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:06.457612 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1287f306-68ce-4395-8e49-9c888a629cc4 None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:06.490929 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6737162c-2ae5-441b-95cb-740b00f2528e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:06.491619 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6737162c-2ae5-441b-95cb-740b00f2528e None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:06.491903 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6737162c-2ae5-441b-95cb-740b00f2528e None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:06.492183 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6737162c-2ae5-441b-95cb-740b00f2528e None admin] PATH_INFO: `/v3/roles` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:06.492937 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6737162c-2ae5-441b-95cb-740b00f2528e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:29:06.493242 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6737162c-2ae5-441b-95cb-740b00f2528e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:06.494604 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6737162c-2ae5-441b-95cb-740b00f2528e None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:06.498217 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:06.503762 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 547/1095] 10.222.0.67 () {56 vars in 1099 bytes} [Wed May 25 14:29:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:29:06.509395 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6737162c-2ae5-441b-95cb-740b00f2528e None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:06.552228 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a922daad-8522-4160-919f-3b52156f7d09 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:06.586953 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc85f11-80b5-4f2c-9cb2-456a84bf7171 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:06.587639 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc85f11-80b5-4f2c-9cb2-456a84bf7171 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:06.587920 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc85f11-80b5-4f2c-9cb2-456a84bf7171 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:06.588199 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc85f11-80b5-4f2c-9cb2-456a84bf7171 None admin] PATH_INFO: `/v3/users` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:06.589028 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc85f11-80b5-4f2c-9cb2-456a84bf7171 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:29:06.589364 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc85f11-80b5-4f2c-9cb2-456a84bf7171 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:06.590797 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc85f11-80b5-4f2c-9cb2-456a84bf7171 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:06.608085 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 549/1096] 10.222.0.67 () {56 vars in 1133 bytes} [Wed May 25 14:29:06 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:29:06.609675 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6737162c-2ae5-441b-95cb-740b00f2528e None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:06.612070 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:06.613716 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc85f11-80b5-4f2c-9cb2-456a84bf7171 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:06.645379 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ceea4ed-5695-4f76-83cb-3ed50e70d8b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:06.646253 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ceea4ed-5695-4f76-83cb-3ed50e70d8b8 None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:06.646537 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ceea4ed-5695-4f76-83cb-3ed50e70d8b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:06.646814 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ceea4ed-5695-4f76-83cb-3ed50e70d8b8 None admin] PATH_INFO: `/v3/users/4456e115599c41fcae42ec073dd289d4` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:06.648059 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ceea4ed-5695-4f76-83cb-3ed50e70d8b8 None admin] RBAC: Authorizing `identity:get_user(user_id=4456e115599c41fcae42ec073dd289d4)` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:06.649486 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ceea4ed-5695-4f76-83cb-3ed50e70d8b8 None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:06.651158 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 548/1097] 10.222.0.67 () {56 vars in 1177 bytes} [Wed May 25 14:29:06 2022] GET /identity/v3/users/4456e115599c41fcae42ec073dd289d4 => generated 285 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:29:06.656652 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ceea4ed-5695-4f76-83cb-3ed50e70d8b8 None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:06.713014 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc85f11-80b5-4f2c-9cb2-456a84bf7171 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:06.720957 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:06.748791 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a14d03-226c-4177-87e5-e08513f1e402 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:06.749441 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a14d03-226c-4177-87e5-e08513f1e402 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:06.749723 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a14d03-226c-4177-87e5-e08513f1e402 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:06.750006 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a14d03-226c-4177-87e5-e08513f1e402 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:06.755433 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ceea4ed-5695-4f76-83cb-3ed50e70d8b8 None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:06.788159 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b17b215-12d4-4d79-a83f-1f518a33e5cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:06.788809 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b17b215-12d4-4d79-a83f-1f518a33e5cc None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:06.789097 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b17b215-12d4-4d79-a83f-1f518a33e5cc None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:06.789375 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b17b215-12d4-4d79-a83f-1f518a33e5cc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:06.817416 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a14d03-226c-4177-87e5-e08513f1e402 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:06.818929 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a14d03-226c-4177-87e5-e08513f1e402 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:06.830539 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:06.859757 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b17b215-12d4-4d79-a83f-1f518a33e5cc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:06.861212 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b17b215-12d4-4d79-a83f-1f518a33e5cc None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:06.917644 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 550/1098] 10.222.0.67 () {58 vars in 1282 bytes} [Wed May 25 14:29:06 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 25 14:29:06.923758 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a14d03-226c-4177-87e5-e08513f1e402 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:06.931118 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:06.961984 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 549/1099] 10.222.0.67 () {58 vars in 1282 bytes} [Wed May 25 14:29:06 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 25 14:29:06.968852 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b17b215-12d4-4d79-a83f-1f518a33e5cc None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:07.021351 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a14d03-226c-4177-87e5-e08513f1e402 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:07.036167 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:07.055652 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8223495b-89dc-4780-a7a3-78670859e43f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:07.056448 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8223495b-89dc-4780-a7a3-78670859e43f None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:07.056737 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8223495b-89dc-4780-a7a3-78670859e43f None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:07.057019 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8223495b-89dc-4780-a7a3-78670859e43f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:07.067122 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8223495b-89dc-4780-a7a3-78670859e43f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:07.068630 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b17b215-12d4-4d79-a83f-1f518a33e5cc None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:07.068750 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8223495b-89dc-4780-a7a3-78670859e43f None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:07.087131 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application [None req-8223495b-89dc-4780-a7a3-78670859e43f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:29:07.087131 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:29:07.087131 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:29:07.087131 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:29:07.087131 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:29:07.087131 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:29:07.087131 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:29:07.087131 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:29:07.087131 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:29:07.087131 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:29:07.087131 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:29:07.087131 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:29:07.087131 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 14:29:07.087131 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 14:29:07.087131 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 14:29:07.088221 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 14:29:07.088221 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:29:07.088221 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:29:07.088221 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:29:07.088221 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:29:07.088221 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:29:07.088221 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:29:07.088221 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:29:07.088221 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application with Lock( May 25 14:29:07.088221 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:29:07.088221 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._enter() May 25 14:29:07.088221 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:29:07.088221 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:29:07.088221 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:29:07.088221 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.creator() May 25 14:29:07.088221 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:29:07.088221 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application created_value = creator( May 25 14:29:07.089147 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 14:29:07.089147 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 14:29:07.089147 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:29:07.089147 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:29:07.089147 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 551/1100] 10.222.0.67 () {56 vars in 1108 bytes} [Wed May 25 14:29:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 14:29:07.095447 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8223495b-89dc-4780-a7a3-78670859e43f None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:07.103863 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c37c0f9-b08f-4137-830a-90d8d23154ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:07.104809 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c37c0f9-b08f-4137-830a-90d8d23154ea None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:07.105093 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c37c0f9-b08f-4137-830a-90d8d23154ea None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:07.105371 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c37c0f9-b08f-4137-830a-90d8d23154ea None admin] PATH_INFO: `/v3/projects/4dc3bba175574309a5e7a9a57fdba146` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:07.106550 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c37c0f9-b08f-4137-830a-90d8d23154ea None admin] RBAC: Authorizing `identity:get_project(project_id=4dc3bba175574309a5e7a9a57fdba146)` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:07.108314 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c37c0f9-b08f-4137-830a-90d8d23154ea None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:07.110009 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 550/1101] 10.222.0.67 () {56 vars in 1186 bytes} [Wed May 25 14:29:06 2022] GET /identity/v3/projects/4dc3bba175574309a5e7a9a57fdba146 => generated 311 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:29:07.115763 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c37c0f9-b08f-4137-830a-90d8d23154ea None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:07.159225 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:07.202731 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8223495b-89dc-4780-a7a3-78670859e43f None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:07.216136 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c37c0f9-b08f-4137-830a-90d8d23154ea None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:07.239160 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c77a1e0-6962-4ce1-9e2d-d667dee1f9ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:07.239815 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c77a1e0-6962-4ce1-9e2d-d667dee1f9ab None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:07.240095 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c77a1e0-6962-4ce1-9e2d-d667dee1f9ab None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:07.240366 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c77a1e0-6962-4ce1-9e2d-d667dee1f9ab None admin] PATH_INFO: `/v3/domains` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:07.241081 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c77a1e0-6962-4ce1-9e2d-d667dee1f9ab None admin] RBAC: Adding query filter params (name=Default) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:29:07.241384 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c77a1e0-6962-4ce1-9e2d-d667dee1f9ab None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:07.242742 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c77a1e0-6962-4ce1-9e2d-d667dee1f9ab None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:07.254522 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 552/1102] 10.222.0.67 () {56 vars in 1109 bytes} [Wed May 25 14:29:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:29:07.259171 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f090b9-a722-4557-82eb-bf22e1896f27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:07.259171 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f090b9-a722-4557-82eb-bf22e1896f27 None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:07.259171 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f090b9-a722-4557-82eb-bf22e1896f27 None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:07.259171 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f090b9-a722-4557-82eb-bf22e1896f27 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:07.259525 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f090b9-a722-4557-82eb-bf22e1896f27 None admin] RBAC: Adding query filter params (role.id=399893e19eac4ab5a8e596f7c07be13c, scope.project.id=4dc3bba175574309a5e7a9a57fdba146, user.id=4456e115599c41fcae42ec073dd289d4) {{(pid=80474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:29:07.259525 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f090b9-a722-4557-82eb-bf22e1896f27 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:07.259525 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f090b9-a722-4557-82eb-bf22e1896f27 None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:07.259951 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c77a1e0-6962-4ce1-9e2d-d667dee1f9ab None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:07.266181 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 551/1103] 10.222.0.67 () {56 vars in 1374 bytes} [Wed May 25 14:29:07 2022] GET /identity/v3/role_assignments?user.id=4456e115599c41fcae42ec073dd289d4&scope.project.id=4dc3bba175574309a5e7a9a57fdba146&role.id=399893e19eac4ab5a8e596f7c07be13c => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:29:07.365753 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c77a1e0-6962-4ce1-9e2d-d667dee1f9ab None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:07.384266 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:07.402465 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495efd58-da7a-436a-a622-54708dafe2a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:07.403304 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495efd58-da7a-436a-a622-54708dafe2a6 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:07.403594 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495efd58-da7a-436a-a622-54708dafe2a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:07.403874 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495efd58-da7a-436a-a622-54708dafe2a6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:07.411312 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495efd58-da7a-436a-a622-54708dafe2a6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:07.412787 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495efd58-da7a-436a-a622-54708dafe2a6 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:07.428933 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application [None req-495efd58-da7a-436a-a622-54708dafe2a6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 14:29:07.428933 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:29:07.428933 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:29:07.428933 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:29:07.428933 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:29:07.428933 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:29:07.428933 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:29:07.428933 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:29:07.428933 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:29:07.428933 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:29:07.428933 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:29:07.428933 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:29:07.428933 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 14:29:07.428933 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 14:29:07.428933 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 14:29:07.430108 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 14:29:07.430108 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:29:07.430108 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:29:07.430108 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:29:07.430108 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:29:07.430108 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:29:07.430108 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:29:07.430108 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:29:07.430108 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application with Lock( May 25 14:29:07.430108 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:29:07.430108 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._enter() May 25 14:29:07.430108 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:29:07.430108 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:29:07.430108 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:29:07.430108 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.creator() May 25 14:29:07.430108 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:29:07.430108 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application created_value = creator( May 25 14:29:07.431093 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 14:29:07.431093 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 14:29:07.431093 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 14:29:07.431093 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 14:29:07.431093 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 14:29:07.431093 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 14:29:07.431093 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 14:29:07.431093 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:29:07.431093 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 553/1104] 10.222.0.67 () {56 vars in 1111 bytes} [Wed May 25 14:29:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:29:07.436787 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f090b9-a722-4557-82eb-bf22e1896f27 None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:07.442555 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:07.539304 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f090b9-a722-4557-82eb-bf22e1896f27 None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:07.571823 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c40ce7-d3dc-4062-ac27-e54bb6aa970a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:07.572476 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c40ce7-d3dc-4062-ac27-e54bb6aa970a None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:07.572758 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c40ce7-d3dc-4062-ac27-e54bb6aa970a None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:07.573029 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c40ce7-d3dc-4062-ac27-e54bb6aa970a None admin] PATH_INFO: `/v3/projects` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:07.573809 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c40ce7-d3dc-4062-ac27-e54bb6aa970a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:29:07.574114 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c40ce7-d3dc-4062-ac27-e54bb6aa970a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:07.575568 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c40ce7-d3dc-4062-ac27-e54bb6aa970a None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:07.588194 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 552/1105] 10.222.0.67 () {56 vars in 1148 bytes} [Wed May 25 14:29:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:29:07.594886 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495efd58-da7a-436a-a622-54708dafe2a6 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:07.697534 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495efd58-da7a-436a-a622-54708dafe2a6 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:07.731744 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea246f2-bd93-43cf-8124-1820861c1e5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:07.732423 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea246f2-bd93-43cf-8124-1820861c1e5c None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:07.732711 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea246f2-bd93-43cf-8124-1820861c1e5c None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:07.732993 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea246f2-bd93-43cf-8124-1820861c1e5c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:07.733828 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea246f2-bd93-43cf-8124-1820861c1e5c None admin] RBAC: Adding query filter params (role.id=a45d5a067e824fa18ca4428cff2a3889, scope.project.id=bfe93ee8d32a441295efc0b885de4bd7, user.id=428ec99478284743943ed41e9d24a603) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:29:07.734145 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea246f2-bd93-43cf-8124-1820861c1e5c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:07.735606 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea246f2-bd93-43cf-8124-1820861c1e5c None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:07.741428 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 554/1106] 10.222.0.67 () {56 vars in 1374 bytes} [Wed May 25 14:29:07 2022] GET /identity/v3/role_assignments?user.id=428ec99478284743943ed41e9d24a603&scope.project.id=bfe93ee8d32a441295efc0b885de4bd7&role.id=a45d5a067e824fa18ca4428cff2a3889 => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:29:09.569728 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fe777a-0f77-4768-8000-2e6e0639e387 None None] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:09.570263 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fe777a-0f77-4768-8000-2e6e0639e387 None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:09.570263 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fe777a-0f77-4768-8000-2e6e0639e387 None None] PATH_INFO: `/` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:09.572026 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 553/1107] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 14:29:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:29:09.577493 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd2a405-7857-413f-a263-60dcfe34197d None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:09.577918 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd2a405-7857-413f-a263-60dcfe34197d None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:09.578055 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd2a405-7857-413f-a263-60dcfe34197d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:09.596662 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-bfd2a405-7857-413f-a263-60dcfe34197d None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:29:09.597845 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-bfd2a405-7857-413f-a263-60dcfe34197d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:29:09.636831 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:09.668388 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 555/1108] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 14:29:09 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 14:29:09.692810 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fe777a-0f77-4768-8000-2e6e0639e387 None None] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:09.755770 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:09.794120 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fe777a-0f77-4768-8000-2e6e0639e387 None None] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:09.828174 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b555be-ba2b-4826-ac63-58ee47a1c55b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:09.828899 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b555be-ba2b-4826-ac63-58ee47a1c55b None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:09.829180 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b555be-ba2b-4826-ac63-58ee47a1c55b None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:09.829454 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b555be-ba2b-4826-ac63-58ee47a1c55b None admin] PATH_INFO: `/v3/domains/default` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:09.830619 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b555be-ba2b-4826-ac63-58ee47a1c55b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:09.832086 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b555be-ba2b-4826-ac63-58ee47a1c55b None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:09.833688 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 554/1109] 10.222.0.67 () {56 vars in 1108 bytes} [Wed May 25 14:29:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:29:09.839393 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd2a405-7857-413f-a263-60dcfe34197d None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:09.937945 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd2a405-7857-413f-a263-60dcfe34197d None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:09.972411 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf2be1b-6eb9-4c55-9217-51dc11e80622 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:09.973072 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf2be1b-6eb9-4c55-9217-51dc11e80622 None admin] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:09.973357 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf2be1b-6eb9-4c55-9217-51dc11e80622 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:09.973632 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf2be1b-6eb9-4c55-9217-51dc11e80622 None admin] PATH_INFO: `/v3/users` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:09.974351 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf2be1b-6eb9-4c55-9217-51dc11e80622 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:09.975805 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf2be1b-6eb9-4c55-9217-51dc11e80622 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:09.995220 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 556/1110] 10.222.0.67 () {60 vars in 1132 bytes} [Wed May 25 14:29:09 2022] POST /identity/v3/users => generated 286 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:29:12.215921 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c777ab8-c8b0-4c8c-af63-857e0597f242 None None] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:12.217093 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c777ab8-c8b0-4c8c-af63-857e0597f242 None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:12.217093 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c777ab8-c8b0-4c8c-af63-857e0597f242 None None] PATH_INFO: `/` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:12.218536 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 555/1111] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 14:29:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:29:12.224116 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfba338-3712-4866-aee1-d4e17bd40b6a None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:12.224539 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfba338-3712-4866-aee1-d4e17bd40b6a None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:12.224687 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfba338-3712-4866-aee1-d4e17bd40b6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:12.241420 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-6cfba338-3712-4866-aee1-d4e17bd40b6a None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:29:12.242601 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-6cfba338-3712-4866-aee1-d4e17bd40b6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:29:12.266185 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:12.311236 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 557/1112] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 14:29:12 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 14:29:12.334776 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c777ab8-c8b0-4c8c-af63-857e0597f242 None None] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:12.433482 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c777ab8-c8b0-4c8c-af63-857e0597f242 None None] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:12.462590 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:12.468401 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50430310-e6e6-4690-a6d1-f42a74f3a81f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:12.469188 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50430310-e6e6-4690-a6d1-f42a74f3a81f None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:12.469472 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50430310-e6e6-4690-a6d1-f42a74f3a81f None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:12.469749 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50430310-e6e6-4690-a6d1-f42a74f3a81f None admin] PATH_INFO: `/v3/roles/3e87d9311f1d411395a3fcd41ac81431` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:12.471235 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50430310-e6e6-4690-a6d1-f42a74f3a81f None admin] RBAC: Authorizing `identity:get_role(role_id=3e87d9311f1d411395a3fcd41ac81431)` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:12.472603 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50430310-e6e6-4690-a6d1-f42a74f3a81f None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:12.473958 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 556/1113] 10.222.0.67 () {56 vars in 1177 bytes} [Wed May 25 14:29:12 2022] GET /identity/v3/roles/3e87d9311f1d411395a3fcd41ac81431 => generated 223 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:29:12.479714 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfba338-3712-4866-aee1-d4e17bd40b6a None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:12.577836 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfba338-3712-4866-aee1-d4e17bd40b6a None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:12.611323 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2c691a-f95e-4cdf-a10a-251a47d1ce07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:12.612175 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2c691a-f95e-4cdf-a10a-251a47d1ce07 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:12.612462 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2c691a-f95e-4cdf-a10a-251a47d1ce07 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:12.612741 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2c691a-f95e-4cdf-a10a-251a47d1ce07 None admin] PATH_INFO: `/v3/users/2cfa4559aba04a1b87ca53566ff0d5d1` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:12.625841 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2c691a-f95e-4cdf-a10a-251a47d1ce07 None admin] RBAC: Authorizing `identity:get_user(user_id=2cfa4559aba04a1b87ca53566ff0d5d1)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:12.627313 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2c691a-f95e-4cdf-a10a-251a47d1ce07 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:12.628941 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 558/1114] 10.222.0.67 () {56 vars in 1177 bytes} [Wed May 25 14:29:12 2022] GET /identity/v3/users/2cfa4559aba04a1b87ca53566ff0d5d1 => generated 286 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:29:12.634766 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50430310-e6e6-4690-a6d1-f42a74f3a81f None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:12.731428 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50430310-e6e6-4690-a6d1-f42a74f3a81f None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:12.764440 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485f429f-da40-4952-9b0e-d7665bc9030c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:12.765072 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485f429f-da40-4952-9b0e-d7665bc9030c None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:12.765355 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485f429f-da40-4952-9b0e-d7665bc9030c None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:12.765632 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485f429f-da40-4952-9b0e-d7665bc9030c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:12.829111 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:12.831563 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485f429f-da40-4952-9b0e-d7665bc9030c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:12.833463 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485f429f-da40-4952-9b0e-d7665bc9030c None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:12.931330 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 557/1115] 10.222.0.67 () {58 vars in 1282 bytes} [Wed May 25 14:29:12 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 25 14:29:12.937797 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2c691a-f95e-4cdf-a10a-251a47d1ce07 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:12.955889 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:13.036902 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2c691a-f95e-4cdf-a10a-251a47d1ce07 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:13.069326 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a118975-68df-40fe-bb18-36e7e3c2e37f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:13.070174 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a118975-68df-40fe-bb18-36e7e3c2e37f None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:13.070458 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a118975-68df-40fe-bb18-36e7e3c2e37f None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:13.070735 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a118975-68df-40fe-bb18-36e7e3c2e37f None admin] PATH_INFO: `/v3/projects/4dc3bba175574309a5e7a9a57fdba146` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:13.072086 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a118975-68df-40fe-bb18-36e7e3c2e37f None admin] RBAC: Authorizing `identity:get_project(project_id=4dc3bba175574309a5e7a9a57fdba146)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:13.073521 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a118975-68df-40fe-bb18-36e7e3c2e37f None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:13.075259 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 559/1116] 10.222.0.67 () {56 vars in 1186 bytes} [Wed May 25 14:29:12 2022] GET /identity/v3/projects/4dc3bba175574309a5e7a9a57fdba146 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:29:13.082105 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485f429f-da40-4952-9b0e-d7665bc9030c None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:13.182367 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:13.185578 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485f429f-da40-4952-9b0e-d7665bc9030c None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:13.219787 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1951f0-44fe-4e1f-9f9f-e4f9f4c40738 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:13.220439 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1951f0-44fe-4e1f-9f9f-e4f9f4c40738 None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:13.220723 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1951f0-44fe-4e1f-9f9f-e4f9f4c40738 None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:13.221003 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1951f0-44fe-4e1f-9f9f-e4f9f4c40738 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:13.221828 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1951f0-44fe-4e1f-9f9f-e4f9f4c40738 None admin] RBAC: Adding query filter params (role.id=3e87d9311f1d411395a3fcd41ac81431, scope.project.id=4dc3bba175574309a5e7a9a57fdba146, user.id=2cfa4559aba04a1b87ca53566ff0d5d1) {{(pid=80474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:29:13.222142 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1951f0-44fe-4e1f-9f9f-e4f9f4c40738 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:13.223599 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1951f0-44fe-4e1f-9f9f-e4f9f4c40738 None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:13.228954 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 558/1117] 10.222.0.67 () {56 vars in 1374 bytes} [Wed May 25 14:29:13 2022] GET /identity/v3/role_assignments?user.id=2cfa4559aba04a1b87ca53566ff0d5d1&scope.project.id=4dc3bba175574309a5e7a9a57fdba146&role.id=3e87d9311f1d411395a3fcd41ac81431 => generated 259 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:29:15.367173 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad88dfa-85ac-498c-9def-8e9b92de984c None None] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:15.367727 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad88dfa-85ac-498c-9def-8e9b92de984c None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:15.367727 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad88dfa-85ac-498c-9def-8e9b92de984c None None] PATH_INFO: `/` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:15.369107 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 560/1118] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 14:29:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:29:15.374716 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c1e9d1-dfd2-44f8-86a8-1bd9c93f7f1e None None] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:15.375112 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c1e9d1-dfd2-44f8-86a8-1bd9c93f7f1e None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:15.375310 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c1e9d1-dfd2-44f8-86a8-1bd9c93f7f1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:15.392194 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.auth.core [None req-b6c1e9d1-dfd2-44f8-86a8-1bd9c93f7f1e None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:29:15.393372 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-b6c1e9d1-dfd2-44f8-86a8-1bd9c93f7f1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:29:15.457631 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 559/1119] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 14:29:15 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 14:29:15.480506 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad88dfa-85ac-498c-9def-8e9b92de984c None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:15.563821 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:15.580817 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad88dfa-85ac-498c-9def-8e9b92de984c None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:15.613012 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e876af-e719-41a8-b0cd-8cf31e1808ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:15.613857 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e876af-e719-41a8-b0cd-8cf31e1808ba None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:15.614144 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e876af-e719-41a8-b0cd-8cf31e1808ba None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:15.614423 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e876af-e719-41a8-b0cd-8cf31e1808ba None admin] PATH_INFO: `/v3/roles/3e87d9311f1d411395a3fcd41ac81431` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:15.615912 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e876af-e719-41a8-b0cd-8cf31e1808ba None admin] RBAC: Authorizing `identity:get_role(role_id=3e87d9311f1d411395a3fcd41ac81431)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:15.617337 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e876af-e719-41a8-b0cd-8cf31e1808ba None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:15.618655 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 561/1120] 10.222.0.67 () {56 vars in 1177 bytes} [Wed May 25 14:29:15 2022] GET /identity/v3/roles/3e87d9311f1d411395a3fcd41ac81431 => generated 223 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:29:15.625311 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c1e9d1-dfd2-44f8-86a8-1bd9c93f7f1e None None] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:15.715200 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:15.722251 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c1e9d1-dfd2-44f8-86a8-1bd9c93f7f1e None None] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:15.755402 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a01d79b-555d-453d-b8cb-ff0b0de35b84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:15.756267 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a01d79b-555d-453d-b8cb-ff0b0de35b84 None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:15.756551 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a01d79b-555d-453d-b8cb-ff0b0de35b84 None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:15.756829 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a01d79b-555d-453d-b8cb-ff0b0de35b84 None admin] PATH_INFO: `/v3/users/2cfa4559aba04a1b87ca53566ff0d5d1` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:15.758032 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a01d79b-555d-453d-b8cb-ff0b0de35b84 None admin] RBAC: Authorizing `identity:get_user(user_id=2cfa4559aba04a1b87ca53566ff0d5d1)` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:15.759510 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a01d79b-555d-453d-b8cb-ff0b0de35b84 None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:15.761135 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 560/1121] 10.222.0.67 () {56 vars in 1177 bytes} [Wed May 25 14:29:15 2022] GET /identity/v3/users/2cfa4559aba04a1b87ca53566ff0d5d1 => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:29:15.767415 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e876af-e719-41a8-b0cd-8cf31e1808ba None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:15.864730 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e876af-e719-41a8-b0cd-8cf31e1808ba None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:15.899128 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6b309a-7ef9-4745-bfe4-83435a49361f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:15.899911 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6b309a-7ef9-4745-bfe4-83435a49361f None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:15.900190 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6b309a-7ef9-4745-bfe4-83435a49361f None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:15.900460 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6b309a-7ef9-4745-bfe4-83435a49361f None admin] PATH_INFO: `/v3/projects/4dc3bba175574309a5e7a9a57fdba146` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:15.901627 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6b309a-7ef9-4745-bfe4-83435a49361f None admin] RBAC: Authorizing `identity:get_project(project_id=4dc3bba175574309a5e7a9a57fdba146)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:15.903093 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6b309a-7ef9-4745-bfe4-83435a49361f None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:15.904994 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 562/1122] 10.222.0.67 () {56 vars in 1186 bytes} [Wed May 25 14:29:15 2022] GET /identity/v3/projects/4dc3bba175574309a5e7a9a57fdba146 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:29:15.910802 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a01d79b-555d-453d-b8cb-ff0b0de35b84 None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:16.007886 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a01d79b-555d-453d-b8cb-ff0b0de35b84 None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:16.040936 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfaa44e-bd32-420c-b628-16b6ac325d40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:16.041810 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfaa44e-bd32-420c-b628-16b6ac325d40 None admin] REQUEST_METHOD: `PUT` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:16.042094 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfaa44e-bd32-420c-b628-16b6ac325d40 None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:16.042370 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfaa44e-bd32-420c-b628-16b6ac325d40 None admin] PATH_INFO: `/v3/projects/4dc3bba175574309a5e7a9a57fdba146/users/2cfa4559aba04a1b87ca53566ff0d5d1/roles/3e87d9311f1d411395a3fcd41ac81431` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:16.045108 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfaa44e-bd32-420c-b628-16b6ac325d40 None admin] RBAC: Authorizing `identity:create_grant(project_id=4dc3bba175574309a5e7a9a57fdba146, user_id=2cfa4559aba04a1b87ca53566ff0d5d1, role_id=3e87d9311f1d411395a3fcd41ac81431)` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:16.046540 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfaa44e-bd32-420c-b628-16b6ac325d40 None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:16.061840 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 561/1123] 10.222.0.67 () {58 vars in 1439 bytes} [Wed May 25 14:29:15 2022] PUT /identity/v3/projects/4dc3bba175574309a5e7a9a57fdba146/users/2cfa4559aba04a1b87ca53566ff0d5d1/roles/3e87d9311f1d411395a3fcd41ac81431 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:29:18.197100 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9fb26b-ce63-4e05-b6d6-2cad039c0882 None None] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:18.197619 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9fb26b-ce63-4e05-b6d6-2cad039c0882 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:18.197619 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9fb26b-ce63-4e05-b6d6-2cad039c0882 None None] PATH_INFO: `/` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:18.198950 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 563/1124] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 14:29:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:29:18.204899 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4bb42c-e355-4ce1-aa68-3930c57bcd15 None None] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:18.205278 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4bb42c-e355-4ce1-aa68-3930c57bcd15 None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:18.205458 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4bb42c-e355-4ce1-aa68-3930c57bcd15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:18.222479 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.auth.core [None req-7c4bb42c-e355-4ce1-aa68-3930c57bcd15 None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:29:18.223716 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-7c4bb42c-e355-4ce1-aa68-3930c57bcd15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:29:18.239820 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:18.289986 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 562/1125] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 14:29:18 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 14:29:18.313691 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9fb26b-ce63-4e05-b6d6-2cad039c0882 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:18.335564 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:18.414924 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9fb26b-ce63-4e05-b6d6-2cad039c0882 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:18.448509 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c617052-66bb-4601-997a-c95465aa2a00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:18.449304 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c617052-66bb-4601-997a-c95465aa2a00 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:18.449592 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c617052-66bb-4601-997a-c95465aa2a00 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:18.449873 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c617052-66bb-4601-997a-c95465aa2a00 None admin] PATH_INFO: `/v3/roles/3e87d9311f1d411395a3fcd41ac81431` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:18.451494 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c617052-66bb-4601-997a-c95465aa2a00 None admin] RBAC: Authorizing `identity:get_role(role_id=3e87d9311f1d411395a3fcd41ac81431)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:18.452864 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c617052-66bb-4601-997a-c95465aa2a00 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:18.454239 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 564/1126] 10.222.0.67 () {56 vars in 1177 bytes} [Wed May 25 14:29:18 2022] GET /identity/v3/roles/3e87d9311f1d411395a3fcd41ac81431 => generated 223 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:29:18.459976 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4bb42c-e355-4ce1-aa68-3930c57bcd15 None None] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:18.556245 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4bb42c-e355-4ce1-aa68-3930c57bcd15 None None] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:18.589619 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9eb3493-0096-42ec-958d-b3a1c70624cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:18.590477 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9eb3493-0096-42ec-958d-b3a1c70624cc None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:18.590764 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9eb3493-0096-42ec-958d-b3a1c70624cc None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:18.591087 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9eb3493-0096-42ec-958d-b3a1c70624cc None admin] PATH_INFO: `/v3/users/2cfa4559aba04a1b87ca53566ff0d5d1` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:18.592389 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9eb3493-0096-42ec-958d-b3a1c70624cc None admin] RBAC: Authorizing `identity:get_user(user_id=2cfa4559aba04a1b87ca53566ff0d5d1)` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:18.593820 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9eb3493-0096-42ec-958d-b3a1c70624cc None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:18.595468 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 563/1127] 10.222.0.67 () {56 vars in 1177 bytes} [Wed May 25 14:29:18 2022] GET /identity/v3/users/2cfa4559aba04a1b87ca53566ff0d5d1 => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:29:18.601086 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c617052-66bb-4601-997a-c95465aa2a00 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:18.686317 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:18.698062 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c617052-66bb-4601-997a-c95465aa2a00 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:18.731007 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09514124-3cfb-4dab-ae52-300e5a1dea0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:18.731604 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09514124-3cfb-4dab-ae52-300e5a1dea0f None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:18.731948 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09514124-3cfb-4dab-ae52-300e5a1dea0f None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:18.732223 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09514124-3cfb-4dab-ae52-300e5a1dea0f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:18.797460 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09514124-3cfb-4dab-ae52-300e5a1dea0f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:18.798909 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09514124-3cfb-4dab-ae52-300e5a1dea0f None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:18.885012 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:18.897431 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 565/1128] 10.222.0.67 () {58 vars in 1282 bytes} [Wed May 25 14:29:18 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 25 14:29:18.903222 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9eb3493-0096-42ec-958d-b3a1c70624cc None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:18.924846 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:19.001900 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9eb3493-0096-42ec-958d-b3a1c70624cc None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:19.034084 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535801a2-12dd-4402-916f-46a22219d75b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:19.034935 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535801a2-12dd-4402-916f-46a22219d75b None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:19.035252 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535801a2-12dd-4402-916f-46a22219d75b None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:19.035532 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535801a2-12dd-4402-916f-46a22219d75b None admin] PATH_INFO: `/v3/projects/4dc3bba175574309a5e7a9a57fdba146` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:19.036699 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535801a2-12dd-4402-916f-46a22219d75b None admin] RBAC: Authorizing `identity:get_project(project_id=4dc3bba175574309a5e7a9a57fdba146)` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:19.038118 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535801a2-12dd-4402-916f-46a22219d75b None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:19.039921 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 564/1129] 10.222.0.67 () {56 vars in 1186 bytes} [Wed May 25 14:29:18 2022] GET /identity/v3/projects/4dc3bba175574309a5e7a9a57fdba146 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:29:19.046243 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09514124-3cfb-4dab-ae52-300e5a1dea0f None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:19.143094 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09514124-3cfb-4dab-ae52-300e5a1dea0f None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:19.181343 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032df57b-1049-41a7-bc26-6d47f3843f39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:19.181993 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032df57b-1049-41a7-bc26-6d47f3843f39 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:19.182279 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032df57b-1049-41a7-bc26-6d47f3843f39 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:19.182558 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032df57b-1049-41a7-bc26-6d47f3843f39 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:19.183416 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032df57b-1049-41a7-bc26-6d47f3843f39 None admin] RBAC: Adding query filter params (role.id=3e87d9311f1d411395a3fcd41ac81431, scope.project.id=4dc3bba175574309a5e7a9a57fdba146, user.id=2cfa4559aba04a1b87ca53566ff0d5d1) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:29:19.183727 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032df57b-1049-41a7-bc26-6d47f3843f39 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:19.185833 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032df57b-1049-41a7-bc26-6d47f3843f39 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:19.191687 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 566/1130] 10.222.0.67 () {56 vars in 1374 bytes} [Wed May 25 14:29:19 2022] GET /identity/v3/role_assignments?user.id=2cfa4559aba04a1b87ca53566ff0d5d1&scope.project.id=4dc3bba175574309a5e7a9a57fdba146&role.id=3e87d9311f1d411395a3fcd41ac81431 => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:29:21.370601 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b88c662-ce0f-4955-9c5a-cf599f5f5762 None None] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:21.371152 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b88c662-ce0f-4955-9c5a-cf599f5f5762 None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:21.371264 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b88c662-ce0f-4955-9c5a-cf599f5f5762 None None] PATH_INFO: `/` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:21.372839 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 565/1131] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 14:29:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:29:21.378108 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abb1f7b-0467-458e-85f7-abcfe71116e3 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:21.378512 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abb1f7b-0467-458e-85f7-abcfe71116e3 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:21.378670 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abb1f7b-0467-458e-85f7-abcfe71116e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:21.395860 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-5abb1f7b-0467-458e-85f7-abcfe71116e3 None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:29:21.397044 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-5abb1f7b-0467-458e-85f7-abcfe71116e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:29:21.442286 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:21.462260 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 567/1132] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 14:29:21 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 14:29:21.486388 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b88c662-ce0f-4955-9c5a-cf599f5f5762 None None] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:21.572674 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:21.586522 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b88c662-ce0f-4955-9c5a-cf599f5f5762 None None] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:21.618611 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e99757-aaac-41b9-bf73-9badf6866f3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:21.619412 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e99757-aaac-41b9-bf73-9badf6866f3c None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:21.619693 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e99757-aaac-41b9-bf73-9badf6866f3c None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:21.619962 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e99757-aaac-41b9-bf73-9badf6866f3c None admin] PATH_INFO: `/v3/domains/default` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:21.621180 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e99757-aaac-41b9-bf73-9badf6866f3c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:21.623389 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e99757-aaac-41b9-bf73-9badf6866f3c None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:21.624976 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 566/1133] 10.222.0.67 () {56 vars in 1108 bytes} [Wed May 25 14:29:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:29:21.630879 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abb1f7b-0467-458e-85f7-abcfe71116e3 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:21.727983 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abb1f7b-0467-458e-85f7-abcfe71116e3 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:21.761765 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0736da-ec5e-46cf-b732-8e0e814a7a98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:21.762409 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0736da-ec5e-46cf-b732-8e0e814a7a98 None admin] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:21.762693 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0736da-ec5e-46cf-b732-8e0e814a7a98 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:21.763548 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0736da-ec5e-46cf-b732-8e0e814a7a98 None admin] PATH_INFO: `/v3/projects` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:21.764260 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0736da-ec5e-46cf-b732-8e0e814a7a98 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:21.765688 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0736da-ec5e-46cf-b732-8e0e814a7a98 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:21.789941 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 568/1134] 10.222.0.67 () {60 vars in 1141 bytes} [Wed May 25 14:29:21 2022] POST /identity/v3/projects => generated 311 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 14:29:24.103055 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218d9ec2-8e79-4577-a429-5ca8df71ba21 None None] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:24.103553 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218d9ec2-8e79-4577-a429-5ca8df71ba21 None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:24.103553 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218d9ec2-8e79-4577-a429-5ca8df71ba21 None None] PATH_INFO: `/` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:24.104876 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 567/1135] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 14:29:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:29:24.110715 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07efeb7f-1835-4760-bcd6-9b85f3d9c42c None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:24.111171 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07efeb7f-1835-4760-bcd6-9b85f3d9c42c None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:24.111308 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07efeb7f-1835-4760-bcd6-9b85f3d9c42c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:24.128192 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-07efeb7f-1835-4760-bcd6-9b85f3d9c42c None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:29:24.129368 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-07efeb7f-1835-4760-bcd6-9b85f3d9c42c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:29:24.155905 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:24.196072 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 569/1136] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 14:29:24 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 14:29:24.221140 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218d9ec2-8e79-4577-a429-5ca8df71ba21 None None] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:24.319338 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218d9ec2-8e79-4577-a429-5ca8df71ba21 None None] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:24.352001 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d59336-a8fe-40ca-9de8-27dafbb2c74e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:24.352784 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d59336-a8fe-40ca-9de8-27dafbb2c74e None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:24.353114 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d59336-a8fe-40ca-9de8-27dafbb2c74e None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:24.353336 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d59336-a8fe-40ca-9de8-27dafbb2c74e None admin] PATH_INFO: `/v3/domains/default` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:24.354488 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d59336-a8fe-40ca-9de8-27dafbb2c74e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:24.355936 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d59336-a8fe-40ca-9de8-27dafbb2c74e None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:24.358073 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 568/1137] 10.222.0.67 () {56 vars in 1108 bytes} [Wed May 25 14:29:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:29:24.363844 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07efeb7f-1835-4760-bcd6-9b85f3d9c42c None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:24.460670 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07efeb7f-1835-4760-bcd6-9b85f3d9c42c None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:24.494050 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae606932-b483-4d91-b641-6672f9d598db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:24.494717 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae606932-b483-4d91-b641-6672f9d598db None admin] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:24.495025 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae606932-b483-4d91-b641-6672f9d598db None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:24.495311 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae606932-b483-4d91-b641-6672f9d598db None admin] PATH_INFO: `/v3/users` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:24.496027 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae606932-b483-4d91-b641-6672f9d598db None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:24.498382 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae606932-b483-4d91-b641-6672f9d598db None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:24.517264 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 570/1138] 10.222.0.67 () {60 vars in 1132 bytes} [Wed May 25 14:29:24 2022] POST /identity/v3/users => generated 286 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 14:29:26.781712 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5bbd62-82de-491f-81b7-3664f2e4cf88 None None] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:26.782251 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5bbd62-82de-491f-81b7-3664f2e4cf88 None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:26.782251 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5bbd62-82de-491f-81b7-3664f2e4cf88 None None] PATH_INFO: `/` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:26.783684 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 569/1139] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 14:29:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:29:26.788830 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404b0bda-21e6-46b7-8eab-b87f41b96762 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:26.789222 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404b0bda-21e6-46b7-8eab-b87f41b96762 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:26.789404 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404b0bda-21e6-46b7-8eab-b87f41b96762 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:26.806576 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-404b0bda-21e6-46b7-8eab-b87f41b96762 None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:29:26.807791 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-404b0bda-21e6-46b7-8eab-b87f41b96762 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:29:26.821499 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:26.877009 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 571/1140] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 14:29:26 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 14:29:26.900159 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5bbd62-82de-491f-81b7-3664f2e4cf88 None None] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:26.926328 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:27.003057 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5bbd62-82de-491f-81b7-3664f2e4cf88 None None] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:27.036495 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1628e080-7c1b-459e-b344-590a304e975e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:27.037211 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1628e080-7c1b-459e-b344-590a304e975e None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:27.037495 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1628e080-7c1b-459e-b344-590a304e975e None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:27.037773 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1628e080-7c1b-459e-b344-590a304e975e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:27.048403 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1628e080-7c1b-459e-b344-590a304e975e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:29:27.056009 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application [None req-1628e080-7c1b-459e-b344-590a304e975e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 14:29:27.056009 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:29:27.056009 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:29:27.056009 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:29:27.056009 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:29:27.056009 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:29:27.056009 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:29:27.056009 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:29:27.056009 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:29:27.056009 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:29:27.056009 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:29:27.056009 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:29:27.056009 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:29:27.056009 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:29:27.056009 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:29:27.056009 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:29:27.057166 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:29:27.057166 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:29:27.057166 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:29:27.057166 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:29:27.057166 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:29:27.057166 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:29:27.057166 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:29:27.057166 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:29:27.057166 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:29:27.057166 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:29:27.057166 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:29:27.057166 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application with Lock( May 25 14:29:27.057166 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:29:27.057166 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self._enter() May 25 14:29:27.057166 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:29:27.057166 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:29:27.062119 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:29:27.062119 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.creator() May 25 14:29:27.062119 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:29:27.062119 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application created_value = creator( May 25 14:29:27.062119 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:29:27.062119 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:29:27.062119 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:29:27.062119 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:29:27.062119 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:29:27.062119 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:29:27.062119 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 14:29:27.062119 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application May 25 14:29:27.062119 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 570/1141] 10.222.0.67 () {56 vars in 1096 bytes} [Wed May 25 14:29:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:29:27.063978 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404b0bda-21e6-46b7-8eab-b87f41b96762 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:27.159205 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404b0bda-21e6-46b7-8eab-b87f41b96762 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:27.192617 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced0c5f9-6e3d-4f5d-8b81-30dc5ccea2a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:27.193286 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced0c5f9-6e3d-4f5d-8b81-30dc5ccea2a4 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:27.193572 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced0c5f9-6e3d-4f5d-8b81-30dc5ccea2a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:27.193850 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced0c5f9-6e3d-4f5d-8b81-30dc5ccea2a4 None admin] PATH_INFO: `/v3/roles` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:27.194598 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced0c5f9-6e3d-4f5d-8b81-30dc5ccea2a4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:29:27.194907 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced0c5f9-6e3d-4f5d-8b81-30dc5ccea2a4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:27.196313 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced0c5f9-6e3d-4f5d-8b81-30dc5ccea2a4 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:27.205610 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 572/1142] 10.222.0.67 () {56 vars in 1099 bytes} [Wed May 25 14:29:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:29:27.214761 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1628e080-7c1b-459e-b344-590a304e975e None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:27.297410 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:27.315453 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1628e080-7c1b-459e-b344-590a304e975e None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:27.347566 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e56a2a8-db2c-4ce5-91f2-edc520c9636c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:27.348431 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e56a2a8-db2c-4ce5-91f2-edc520c9636c None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:27.348717 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e56a2a8-db2c-4ce5-91f2-edc520c9636c None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:27.348996 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e56a2a8-db2c-4ce5-91f2-edc520c9636c None admin] PATH_INFO: `/v3/users/4e3775cae6414c29b5c564b1db72c06c` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:27.362241 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e56a2a8-db2c-4ce5-91f2-edc520c9636c None admin] RBAC: Authorizing `identity:get_user(user_id=4e3775cae6414c29b5c564b1db72c06c)` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:27.363713 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e56a2a8-db2c-4ce5-91f2-edc520c9636c None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:27.365354 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 571/1143] 10.222.0.67 () {56 vars in 1177 bytes} [Wed May 25 14:29:27 2022] GET /identity/v3/users/4e3775cae6414c29b5c564b1db72c06c => generated 286 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:29:27.371145 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced0c5f9-6e3d-4f5d-8b81-30dc5ccea2a4 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:27.386740 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:27.471692 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced0c5f9-6e3d-4f5d-8b81-30dc5ccea2a4 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:27.504906 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8362c31f-3578-4b6f-b2d3-b13c86c5a715 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:27.505552 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8362c31f-3578-4b6f-b2d3-b13c86c5a715 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:27.505836 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8362c31f-3578-4b6f-b2d3-b13c86c5a715 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:27.506114 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8362c31f-3578-4b6f-b2d3-b13c86c5a715 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:27.572727 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8362c31f-3578-4b6f-b2d3-b13c86c5a715 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:27.574128 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8362c31f-3578-4b6f-b2d3-b13c86c5a715 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:27.587518 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:27.673140 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 573/1144] 10.222.0.67 () {58 vars in 1282 bytes} [Wed May 25 14:29:27 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 25 14:29:27.679370 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e56a2a8-db2c-4ce5-91f2-edc520c9636c None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:27.806035 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e56a2a8-db2c-4ce5-91f2-edc520c9636c None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:27.843052 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09b2937-9f45-4dcf-a115-8709b4049642 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:27.843924 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09b2937-9f45-4dcf-a115-8709b4049642 None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:27.844211 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09b2937-9f45-4dcf-a115-8709b4049642 None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:27.844492 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09b2937-9f45-4dcf-a115-8709b4049642 None admin] PATH_INFO: `/v3/projects/fd76491915be4bceb8543410be611539` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:27.845686 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09b2937-9f45-4dcf-a115-8709b4049642 None admin] RBAC: Authorizing `identity:get_project(project_id=fd76491915be4bceb8543410be611539)` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:27.847148 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09b2937-9f45-4dcf-a115-8709b4049642 None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:27.848856 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 572/1145] 10.222.0.67 () {56 vars in 1186 bytes} [Wed May 25 14:29:27 2022] GET /identity/v3/projects/fd76491915be4bceb8543410be611539 => generated 311 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:29:27.854823 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8362c31f-3578-4b6f-b2d3-b13c86c5a715 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:27.954530 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8362c31f-3578-4b6f-b2d3-b13c86c5a715 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:27.968572 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:27.991832 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d4d281-c76d-4a1e-9ad0-5dbcd19b3e87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:27.992521 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d4d281-c76d-4a1e-9ad0-5dbcd19b3e87 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:27.992835 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d4d281-c76d-4a1e-9ad0-5dbcd19b3e87 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:27.993111 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d4d281-c76d-4a1e-9ad0-5dbcd19b3e87 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:27.994014 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d4d281-c76d-4a1e-9ad0-5dbcd19b3e87 None admin] RBAC: Adding query filter params (role.id=399893e19eac4ab5a8e596f7c07be13c, scope.project.id=fd76491915be4bceb8543410be611539, user.id=4e3775cae6414c29b5c564b1db72c06c) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:29:27.994326 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d4d281-c76d-4a1e-9ad0-5dbcd19b3e87 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:27.995972 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d4d281-c76d-4a1e-9ad0-5dbcd19b3e87 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:28.003388 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 574/1146] 10.222.0.67 () {56 vars in 1374 bytes} [Wed May 25 14:29:27 2022] GET /identity/v3/role_assignments?user.id=4e3775cae6414c29b5c564b1db72c06c&scope.project.id=fd76491915be4bceb8543410be611539&role.id=399893e19eac4ab5a8e596f7c07be13c => generated 259 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:29:30.168031 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ff8f1c-8455-436b-a48f-86255902107b None None] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:30.168537 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ff8f1c-8455-436b-a48f-86255902107b None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:30.168537 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ff8f1c-8455-436b-a48f-86255902107b None None] PATH_INFO: `/` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:30.169899 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 573/1147] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 14:29:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:29:30.175006 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74926e0d-0756-4d44-83df-962a89bed81d None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:30.175404 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74926e0d-0756-4d44-83df-962a89bed81d None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:30.175570 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74926e0d-0756-4d44-83df-962a89bed81d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:30.191864 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-74926e0d-0756-4d44-83df-962a89bed81d None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:29:30.193024 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-74926e0d-0756-4d44-83df-962a89bed81d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:29:30.257165 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 575/1148] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 14:29:30 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 14:29:30.280021 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ff8f1c-8455-436b-a48f-86255902107b None None] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:30.292213 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:30.380319 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ff8f1c-8455-436b-a48f-86255902107b None None] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:30.413226 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa243cd-f336-4b15-b48b-dd5e63e380cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:30.414007 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa243cd-f336-4b15-b48b-dd5e63e380cc None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:30.414293 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa243cd-f336-4b15-b48b-dd5e63e380cc None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:30.414570 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa243cd-f336-4b15-b48b-dd5e63e380cc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:30.425062 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa243cd-f336-4b15-b48b-dd5e63e380cc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:29:30.432709 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application [None req-0aa243cd-f336-4b15-b48b-dd5e63e380cc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 14:29:30.432709 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:29:30.432709 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:29:30.432709 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:29:30.432709 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:29:30.432709 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:29:30.432709 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:29:30.432709 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:29:30.432709 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:29:30.432709 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:29:30.432709 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:29:30.432709 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:29:30.432709 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:29:30.432709 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:29:30.432709 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:29:30.432709 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:29:30.433662 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:29:30.433662 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:29:30.433662 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:29:30.433662 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:29:30.433662 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:29:30.433662 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:29:30.433662 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:29:30.433662 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:29:30.433662 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:29:30.433662 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:29:30.433662 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:29:30.433662 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application with Lock( May 25 14:29:30.433662 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:29:30.433662 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self._enter() May 25 14:29:30.433662 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:29:30.433662 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:29:30.434568 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:29:30.434568 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.creator() May 25 14:29:30.434568 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:29:30.434568 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application created_value = creator( May 25 14:29:30.434568 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:29:30.434568 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:29:30.434568 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:29:30.434568 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:29:30.434568 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:29:30.434568 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:29:30.434568 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 14:29:30.434568 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application May 25 14:29:30.434568 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 574/1149] 10.222.0.67 () {56 vars in 1096 bytes} [Wed May 25 14:29:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:29:30.440346 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74926e0d-0756-4d44-83df-962a89bed81d None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:30.537892 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74926e0d-0756-4d44-83df-962a89bed81d None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:30.545636 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:30.572820 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9782a82-d395-46c3-a6ae-e800114ff812 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:30.573482 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9782a82-d395-46c3-a6ae-e800114ff812 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:30.573768 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9782a82-d395-46c3-a6ae-e800114ff812 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:30.574056 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9782a82-d395-46c3-a6ae-e800114ff812 None admin] PATH_INFO: `/v3/roles` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:30.574801 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9782a82-d395-46c3-a6ae-e800114ff812 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:29:30.575142 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9782a82-d395-46c3-a6ae-e800114ff812 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:30.577205 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9782a82-d395-46c3-a6ae-e800114ff812 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:30.585128 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 576/1150] 10.222.0.67 () {56 vars in 1099 bytes} [Wed May 25 14:29:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:29:30.591125 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa243cd-f336-4b15-b48b-dd5e63e380cc None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:30.661263 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:30.692743 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa243cd-f336-4b15-b48b-dd5e63e380cc None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:30.725612 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede85664-cb43-4704-a1e2-f99ca40f1433 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:30.726472 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede85664-cb43-4704-a1e2-f99ca40f1433 None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:30.726757 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede85664-cb43-4704-a1e2-f99ca40f1433 None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:30.727059 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede85664-cb43-4704-a1e2-f99ca40f1433 None admin] PATH_INFO: `/v3/users/4e3775cae6414c29b5c564b1db72c06c` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:30.728243 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede85664-cb43-4704-a1e2-f99ca40f1433 None admin] RBAC: Authorizing `identity:get_user(user_id=4e3775cae6414c29b5c564b1db72c06c)` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:30.729686 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede85664-cb43-4704-a1e2-f99ca40f1433 None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:30.731339 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 575/1151] 10.222.0.67 () {56 vars in 1177 bytes} [Wed May 25 14:29:30 2022] GET /identity/v3/users/4e3775cae6414c29b5c564b1db72c06c => generated 286 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:29:30.737070 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9782a82-d395-46c3-a6ae-e800114ff812 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:30.836424 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9782a82-d395-46c3-a6ae-e800114ff812 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:30.870024 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568ce68c-233d-4ffc-9942-9394b56ca3b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:30.870872 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568ce68c-233d-4ffc-9942-9394b56ca3b9 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:30.871189 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568ce68c-233d-4ffc-9942-9394b56ca3b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:30.871471 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568ce68c-233d-4ffc-9942-9394b56ca3b9 None admin] PATH_INFO: `/v3/projects/fd76491915be4bceb8543410be611539` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:30.873704 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568ce68c-233d-4ffc-9942-9394b56ca3b9 None admin] RBAC: Authorizing `identity:get_project(project_id=fd76491915be4bceb8543410be611539)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:30.875177 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568ce68c-233d-4ffc-9942-9394b56ca3b9 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:30.876859 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 577/1152] 10.222.0.67 () {56 vars in 1186 bytes} [Wed May 25 14:29:30 2022] GET /identity/v3/projects/fd76491915be4bceb8543410be611539 => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:29:30.882659 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede85664-cb43-4704-a1e2-f99ca40f1433 None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:30.979884 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede85664-cb43-4704-a1e2-f99ca40f1433 None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:31.012889 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b98779-a228-475a-b2d2-8178ac8516c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:31.013751 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b98779-a228-475a-b2d2-8178ac8516c9 None admin] REQUEST_METHOD: `PUT` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:31.014033 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b98779-a228-475a-b2d2-8178ac8516c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:31.014312 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b98779-a228-475a-b2d2-8178ac8516c9 None admin] PATH_INFO: `/v3/projects/fd76491915be4bceb8543410be611539/users/4e3775cae6414c29b5c564b1db72c06c/roles/399893e19eac4ab5a8e596f7c07be13c` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:31.016273 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b98779-a228-475a-b2d2-8178ac8516c9 None admin] RBAC: Authorizing `identity:create_grant(project_id=fd76491915be4bceb8543410be611539, user_id=4e3775cae6414c29b5c564b1db72c06c, role_id=399893e19eac4ab5a8e596f7c07be13c)` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:31.017696 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b98779-a228-475a-b2d2-8178ac8516c9 None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:31.026347 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:31.032191 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 576/1153] 10.222.0.67 () {58 vars in 1439 bytes} [Wed May 25 14:29:30 2022] PUT /identity/v3/projects/fd76491915be4bceb8543410be611539/users/4e3775cae6414c29b5c564b1db72c06c/roles/399893e19eac4ab5a8e596f7c07be13c => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:29:33.179607 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf37afd-f4d2-40f2-80e9-da2e7cbe1b29 None None] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:33.180158 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf37afd-f4d2-40f2-80e9-da2e7cbe1b29 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:33.180158 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf37afd-f4d2-40f2-80e9-da2e7cbe1b29 None None] PATH_INFO: `/` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:33.181464 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 578/1154] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 14:29:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:29:33.187371 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a16b6b3-22e8-48a7-9648-dd0735acb6fd None None] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:33.187812 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a16b6b3-22e8-48a7-9648-dd0735acb6fd None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:33.187915 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a16b6b3-22e8-48a7-9648-dd0735acb6fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:33.204413 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.auth.core [None req-8a16b6b3-22e8-48a7-9648-dd0735acb6fd None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:29:33.205587 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-8a16b6b3-22e8-48a7-9648-dd0735acb6fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:29:33.278271 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 577/1155] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 14:29:33 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 14:29:33.302166 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf37afd-f4d2-40f2-80e9-da2e7cbe1b29 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:33.337851 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:33.402605 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf37afd-f4d2-40f2-80e9-da2e7cbe1b29 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:33.436531 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a061de-b405-46fa-a9d9-9214ee7778b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:33.437233 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a061de-b405-46fa-a9d9-9214ee7778b0 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:33.437520 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a061de-b405-46fa-a9d9-9214ee7778b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:33.437797 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a061de-b405-46fa-a9d9-9214ee7778b0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:33.447720 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a061de-b405-46fa-a9d9-9214ee7778b0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:29:33.455413 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application [None req-61a061de-b405-46fa-a9d9-9214ee7778b0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 14:29:33.455413 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:29:33.455413 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:29:33.455413 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:29:33.455413 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:29:33.455413 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:29:33.455413 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:29:33.455413 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:29:33.455413 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:29:33.455413 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:29:33.455413 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:29:33.455413 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:29:33.455413 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:29:33.455413 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:29:33.455413 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:29:33.455413 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:29:33.456611 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:29:33.456611 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:29:33.456611 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:29:33.456611 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:29:33.456611 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:29:33.456611 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:29:33.456611 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:29:33.456611 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:29:33.456611 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:29:33.456611 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:29:33.456611 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:29:33.456611 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application with Lock( May 25 14:29:33.456611 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:29:33.456611 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._enter() May 25 14:29:33.456611 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:29:33.456611 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:29:33.457743 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:29:33.457743 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.creator() May 25 14:29:33.457743 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:29:33.457743 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application created_value = creator( May 25 14:29:33.457743 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:29:33.457743 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:29:33.457743 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:29:33.457743 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:29:33.457743 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:29:33.457743 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:29:33.457743 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 14:29:33.457743 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:29:33.457743 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 579/1156] 10.222.0.67 () {56 vars in 1096 bytes} [Wed May 25 14:29:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:29:33.462513 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a16b6b3-22e8-48a7-9648-dd0735acb6fd None None] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:33.560575 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a16b6b3-22e8-48a7-9648-dd0735acb6fd None None] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:33.590056 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:33.598924 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50350b63-3332-44b3-be97-62d09d71a368 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:33.599632 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50350b63-3332-44b3-be97-62d09d71a368 None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:33.599922 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50350b63-3332-44b3-be97-62d09d71a368 None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:33.600203 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50350b63-3332-44b3-be97-62d09d71a368 None admin] PATH_INFO: `/v3/roles` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:33.600954 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50350b63-3332-44b3-be97-62d09d71a368 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:29:33.601265 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50350b63-3332-44b3-be97-62d09d71a368 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:33.602636 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50350b63-3332-44b3-be97-62d09d71a368 None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:33.611297 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 578/1157] 10.222.0.67 () {56 vars in 1099 bytes} [Wed May 25 14:29:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:29:33.617087 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a061de-b405-46fa-a9d9-9214ee7778b0 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:33.709257 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:33.715298 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a061de-b405-46fa-a9d9-9214ee7778b0 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:33.748204 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a14e902-2469-4267-b221-aec869ac81fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:33.749211 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a14e902-2469-4267-b221-aec869ac81fd None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:33.749498 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a14e902-2469-4267-b221-aec869ac81fd None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:33.749778 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a14e902-2469-4267-b221-aec869ac81fd None admin] PATH_INFO: `/v3/users/4e3775cae6414c29b5c564b1db72c06c` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:33.750958 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a14e902-2469-4267-b221-aec869ac81fd None admin] RBAC: Authorizing `identity:get_user(user_id=4e3775cae6414c29b5c564b1db72c06c)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:33.752428 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a14e902-2469-4267-b221-aec869ac81fd None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:33.754043 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 580/1158] 10.222.0.67 () {56 vars in 1177 bytes} [Wed May 25 14:29:33 2022] GET /identity/v3/users/4e3775cae6414c29b5c564b1db72c06c => generated 286 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:29:33.759787 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50350b63-3332-44b3-be97-62d09d71a368 None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:33.862932 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50350b63-3332-44b3-be97-62d09d71a368 None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:33.896183 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbe7221-8830-4ba1-b072-bc32d28f02de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:33.896832 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbe7221-8830-4ba1-b072-bc32d28f02de None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:33.897121 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbe7221-8830-4ba1-b072-bc32d28f02de None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:33.897401 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbe7221-8830-4ba1-b072-bc32d28f02de None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:33.952499 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:33.962807 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbe7221-8830-4ba1-b072-bc32d28f02de None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:33.964217 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbe7221-8830-4ba1-b072-bc32d28f02de None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:34.058044 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 579/1159] 10.222.0.67 () {58 vars in 1282 bytes} [Wed May 25 14:29:33 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 25 14:29:34.064097 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a14e902-2469-4267-b221-aec869ac81fd None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:34.162316 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a14e902-2469-4267-b221-aec869ac81fd None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:34.194806 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3eafd9-c3df-42f5-8436-8c85f9e68172 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:34.195681 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3eafd9-c3df-42f5-8436-8c85f9e68172 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:34.195967 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3eafd9-c3df-42f5-8436-8c85f9e68172 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:34.196244 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3eafd9-c3df-42f5-8436-8c85f9e68172 None admin] PATH_INFO: `/v3/projects/fd76491915be4bceb8543410be611539` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:34.197420 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3eafd9-c3df-42f5-8436-8c85f9e68172 None admin] RBAC: Authorizing `identity:get_project(project_id=fd76491915be4bceb8543410be611539)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:34.198857 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3eafd9-c3df-42f5-8436-8c85f9e68172 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:34.201289 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 581/1160] 10.222.0.67 () {56 vars in 1186 bytes} [Wed May 25 14:29:34 2022] GET /identity/v3/projects/fd76491915be4bceb8543410be611539 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:29:34.207012 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbe7221-8830-4ba1-b072-bc32d28f02de None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:34.293882 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:34.304638 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbe7221-8830-4ba1-b072-bc32d28f02de None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:34.336945 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acd69ac-04a7-4ac4-a5c7-e172370a40d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:34.337590 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acd69ac-04a7-4ac4-a5c7-e172370a40d7 None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:34.337878 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acd69ac-04a7-4ac4-a5c7-e172370a40d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:34.338152 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acd69ac-04a7-4ac4-a5c7-e172370a40d7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:34.338978 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acd69ac-04a7-4ac4-a5c7-e172370a40d7 None admin] RBAC: Adding query filter params (role.id=399893e19eac4ab5a8e596f7c07be13c, scope.project.id=fd76491915be4bceb8543410be611539, user.id=4e3775cae6414c29b5c564b1db72c06c) {{(pid=80474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:29:34.339320 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acd69ac-04a7-4ac4-a5c7-e172370a40d7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:34.340745 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acd69ac-04a7-4ac4-a5c7-e172370a40d7 None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:34.346932 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 580/1161] 10.222.0.67 () {56 vars in 1374 bytes} [Wed May 25 14:29:34 2022] GET /identity/v3/role_assignments?user.id=4e3775cae6414c29b5c564b1db72c06c&scope.project.id=fd76491915be4bceb8543410be611539&role.id=399893e19eac4ab5a8e596f7c07be13c => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:29:36.555376 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac6be5a-4136-4ebe-bf45-965e464c627e None None] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:36.555928 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac6be5a-4136-4ebe-bf45-965e464c627e None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:36.555928 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac6be5a-4136-4ebe-bf45-965e464c627e None None] PATH_INFO: `/` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:36.557282 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 582/1162] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 14:29:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:29:36.563031 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294c4aae-44b3-40f5-b2f6-fc602965d4e4 None None] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:36.563487 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294c4aae-44b3-40f5-b2f6-fc602965d4e4 None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:36.563587 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294c4aae-44b3-40f5-b2f6-fc602965d4e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:36.581242 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.auth.core [None req-294c4aae-44b3-40f5-b2f6-fc602965d4e4 None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:29:36.582447 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-294c4aae-44b3-40f5-b2f6-fc602965d4e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:29:36.648366 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 581/1163] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 14:29:36 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 14:29:36.670839 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac6be5a-4136-4ebe-bf45-965e464c627e None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:36.702768 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:36.772517 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac6be5a-4136-4ebe-bf45-965e464c627e None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:36.804218 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c94f16-677f-47c5-be35-4f46ac3d75e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:36.804846 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c94f16-677f-47c5-be35-4f46ac3d75e4 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:36.805153 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c94f16-677f-47c5-be35-4f46ac3d75e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:36.805478 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c94f16-677f-47c5-be35-4f46ac3d75e4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:36.875224 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c94f16-677f-47c5-be35-4f46ac3d75e4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:36.876671 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c94f16-677f-47c5-be35-4f46ac3d75e4 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:36.906210 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:36.978160 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 583/1164] 10.222.0.67 () {58 vars in 1282 bytes} [Wed May 25 14:29:36 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 25 14:29:36.985168 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294c4aae-44b3-40f5-b2f6-fc602965d4e4 None None] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:37.066468 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:37.082650 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294c4aae-44b3-40f5-b2f6-fc602965d4e4 None None] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:37.115505 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51da5d0-5a27-48f2-ab5b-55d700560574 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:37.116294 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51da5d0-5a27-48f2-ab5b-55d700560574 None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:37.116580 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51da5d0-5a27-48f2-ab5b-55d700560574 None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:37.116857 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51da5d0-5a27-48f2-ab5b-55d700560574 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:37.123685 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51da5d0-5a27-48f2-ab5b-55d700560574 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:37.125119 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51da5d0-5a27-48f2-ab5b-55d700560574 None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:37.139701 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application [None req-b51da5d0-5a27-48f2-ab5b-55d700560574 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. May 25 14:29:37.139701 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:29:37.139701 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain May 25 14:29:37.139701 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) May 25 14:29:37.139701 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 14:29:37.139701 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 14:29:37.139701 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 14:29:37.139701 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 14:29:37.139701 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. May 25 14:29:37.139701 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application May 25 14:29:37.139701 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 14:29:37.139701 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application May 25 14:29:37.139701 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:29:37.139701 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:29:37.139701 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:29:37.139701 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:29:37.139701 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:29:37.140930 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:29:37.140930 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:29:37.140930 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:29:37.140930 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:29:37.140930 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:29:37.140930 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:29:37.140930 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 14:29:37.140930 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 14:29:37.140930 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 14:29:37.140930 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 14:29:37.140930 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:29:37.140930 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:29:37.140930 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:29:37.140930 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:29:37.140930 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:29:37.140930 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:29:37.141867 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:29:37.141867 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application with Lock( May 25 14:29:37.141867 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:29:37.141867 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self._enter() May 25 14:29:37.141867 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:29:37.141867 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:29:37.141867 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:29:37.141867 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.creator() May 25 14:29:37.141867 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:29:37.141867 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application created_value = creator( May 25 14:29:37.141867 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain May 25 14:29:37.141867 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 14:29:37.141867 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. May 25 14:29:37.141867 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application May 25 14:29:37.141867 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 582/1165] 10.222.0.67 () {56 vars in 1117 bytes} [Wed May 25 14:29:36 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:29:37.146981 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c94f16-677f-47c5-be35-4f46ac3d75e4 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:37.244554 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c94f16-677f-47c5-be35-4f46ac3d75e4 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:37.273463 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:37.278766 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81481014-6b4b-4043-b608-e4f6f9c123a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:37.279445 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81481014-6b4b-4043-b608-e4f6f9c123a5 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:37.279728 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81481014-6b4b-4043-b608-e4f6f9c123a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:37.280003 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81481014-6b4b-4043-b608-e4f6f9c123a5 None admin] PATH_INFO: `/v3/domains` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:37.280716 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81481014-6b4b-4043-b608-e4f6f9c123a5 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:29:37.281022 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81481014-6b4b-4043-b608-e4f6f9c123a5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:37.282392 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81481014-6b4b-4043-b608-e4f6f9c123a5 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:37.289543 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 584/1166] 10.222.0.67 () {56 vars in 1115 bytes} [Wed May 25 14:29:37 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:29:39.451625 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794e2189-8a7a-468c-b1bb-87b0959d2f7d None None] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:39.452181 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794e2189-8a7a-468c-b1bb-87b0959d2f7d None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:39.452181 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794e2189-8a7a-468c-b1bb-87b0959d2f7d None None] PATH_INFO: `/` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:39.453550 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 583/1167] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 14:29:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:29:39.458650 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97aacae9-1a8e-4ab4-ab03-9c4138bf3212 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:39.459053 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97aacae9-1a8e-4ab4-ab03-9c4138bf3212 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:39.459236 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97aacae9-1a8e-4ab4-ab03-9c4138bf3212 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:39.476425 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-97aacae9-1a8e-4ab4-ab03-9c4138bf3212 None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:29:39.477586 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-97aacae9-1a8e-4ab4-ab03-9c4138bf3212 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:29:39.541123 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 585/1168] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 14:29:39 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 14:29:39.563795 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794e2189-8a7a-468c-b1bb-87b0959d2f7d None None] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:39.662967 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794e2189-8a7a-468c-b1bb-87b0959d2f7d None None] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:39.696124 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63ef773-d848-4bc4-b597-6d9874a56b7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:39.696772 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63ef773-d848-4bc4-b597-6d9874a56b7e None admin] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:39.697061 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63ef773-d848-4bc4-b597-6d9874a56b7e None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:39.697342 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63ef773-d848-4bc4-b597-6d9874a56b7e None admin] PATH_INFO: `/v3/domains` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:39.698093 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63ef773-d848-4bc4-b597-6d9874a56b7e None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:39.699483 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63ef773-d848-4bc4-b597-6d9874a56b7e None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:39.713909 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 584/1169] 10.222.0.67 () {60 vars in 1138 bytes} [Wed May 25 14:29:39 2022] POST /identity/v3/domains => generated 267 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:29:41.902889 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5a4f7f-2ab5-4d62-8a91-c56f4744c2e9 None None] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:41.903430 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5a4f7f-2ab5-4d62-8a91-c56f4744c2e9 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:41.903544 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5a4f7f-2ab5-4d62-8a91-c56f4744c2e9 None None] PATH_INFO: `/` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:41.904864 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 586/1170] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 14:29:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:29:41.910200 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f387f2de-ba70-473b-80c0-214a49877cbe None None] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:41.910594 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f387f2de-ba70-473b-80c0-214a49877cbe None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:41.910771 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f387f2de-ba70-473b-80c0-214a49877cbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:41.916769 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:41.928496 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.auth.core [None req-f387f2de-ba70-473b-80c0-214a49877cbe None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:29:41.929683 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-f387f2de-ba70-473b-80c0-214a49877cbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:29:41.995776 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 585/1171] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 14:29:41 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 14:29:42.020364 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5a4f7f-2ab5-4d62-8a91-c56f4744c2e9 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:42.118218 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5a4f7f-2ab5-4d62-8a91-c56f4744c2e9 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:42.143147 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:42.151844 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ffa2f4-452b-40ff-9a68-ab38fd6c4968 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:42.152684 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ffa2f4-452b-40ff-9a68-ab38fd6c4968 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:42.152963 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ffa2f4-452b-40ff-9a68-ab38fd6c4968 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:42.153269 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ffa2f4-452b-40ff-9a68-ab38fd6c4968 None admin] PATH_INFO: `/v3/domains/ad97a8483cfb40d9b3747ce19b3cab5f` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:42.163551 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ffa2f4-452b-40ff-9a68-ab38fd6c4968 None admin] RBAC: Authorizing `identity:get_domain(domain_id=ad97a8483cfb40d9b3747ce19b3cab5f)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:42.164981 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ffa2f4-452b-40ff-9a68-ab38fd6c4968 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:42.166568 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 587/1172] 10.222.0.67 () {56 vars in 1183 bytes} [Wed May 25 14:29:42 2022] GET /identity/v3/domains/ad97a8483cfb40d9b3747ce19b3cab5f => generated 267 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:29:42.173050 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f387f2de-ba70-473b-80c0-214a49877cbe None None] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:42.274289 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f387f2de-ba70-473b-80c0-214a49877cbe None None] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:42.306823 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba36a34-a4c6-44bf-9c15-d18d11c35c45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:42.307496 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba36a34-a4c6-44bf-9c15-d18d11c35c45 None admin] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:42.307779 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba36a34-a4c6-44bf-9c15-d18d11c35c45 None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:42.308053 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba36a34-a4c6-44bf-9c15-d18d11c35c45 None admin] PATH_INFO: `/v3/projects` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:42.308757 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba36a34-a4c6-44bf-9c15-d18d11c35c45 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:42.310749 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba36a34-a4c6-44bf-9c15-d18d11c35c45 None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:42.313897 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:42.334789 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 586/1173] 10.222.0.67 () {60 vars in 1141 bytes} [Wed May 25 14:29:42 2022] POST /identity/v3/projects => generated 361 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:29:44.530395 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80e6099-c23d-4081-abbd-7f8c0a693999 None None] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:44.530959 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80e6099-c23d-4081-abbd-7f8c0a693999 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:44.530959 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80e6099-c23d-4081-abbd-7f8c0a693999 None None] PATH_INFO: `/` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:44.532325 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 588/1174] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 14:29:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:29:44.537518 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160a7d2c-72f5-4c91-9928-e97dc9f41354 None None] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:44.537942 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160a7d2c-72f5-4c91-9928-e97dc9f41354 None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:44.538128 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160a7d2c-72f5-4c91-9928-e97dc9f41354 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:44.555201 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.auth.core [None req-160a7d2c-72f5-4c91-9928-e97dc9f41354 None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:29:44.556373 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-160a7d2c-72f5-4c91-9928-e97dc9f41354 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:29:44.623001 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 587/1175] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 14:29:44 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 25 14:29:44.647434 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80e6099-c23d-4081-abbd-7f8c0a693999 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:44.745648 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80e6099-c23d-4081-abbd-7f8c0a693999 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:44.780587 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ca999f-14b3-4425-ac8c-d76ef38d3d1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:44.781362 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ca999f-14b3-4425-ac8c-d76ef38d3d1a None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:44.781650 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ca999f-14b3-4425-ac8c-d76ef38d3d1a None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:44.781924 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ca999f-14b3-4425-ac8c-d76ef38d3d1a None admin] PATH_INFO: `/v3/domains/ad97a8483cfb40d9b3747ce19b3cab5f` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:44.783112 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ca999f-14b3-4425-ac8c-d76ef38d3d1a None admin] RBAC: Authorizing `identity:get_domain(domain_id=ad97a8483cfb40d9b3747ce19b3cab5f)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:44.784542 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ca999f-14b3-4425-ac8c-d76ef38d3d1a None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:44.786142 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 589/1176] 10.222.0.67 () {56 vars in 1183 bytes} [Wed May 25 14:29:44 2022] GET /identity/v3/domains/ad97a8483cfb40d9b3747ce19b3cab5f => generated 267 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:29:44.791919 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160a7d2c-72f5-4c91-9928-e97dc9f41354 None None] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:44.899854 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160a7d2c-72f5-4c91-9928-e97dc9f41354 None None] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:44.916677 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:44.935463 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2866f18-29ba-48f5-a7b6-a07567b08ea0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:44.936134 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2866f18-29ba-48f5-a7b6-a07567b08ea0 None admin] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:44.936420 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2866f18-29ba-48f5-a7b6-a07567b08ea0 None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:44.936697 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2866f18-29ba-48f5-a7b6-a07567b08ea0 None admin] PATH_INFO: `/v3/users` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:44.937416 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2866f18-29ba-48f5-a7b6-a07567b08ea0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:44.938852 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2866f18-29ba-48f5-a7b6-a07567b08ea0 None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:44.957824 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 588/1177] 10.222.0.67 () {60 vars in 1132 bytes} [Wed May 25 14:29:44 2022] POST /identity/v3/users => generated 311 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:29:47.211697 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca968bf-9291-46f4-bbb0-62f8369a206c None None] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:47.212213 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca968bf-9291-46f4-bbb0-62f8369a206c None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:47.212213 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca968bf-9291-46f4-bbb0-62f8369a206c None None] PATH_INFO: `/` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:47.213542 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 590/1178] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 14:29:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:29:47.219333 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1ad41f-efb1-4253-9067-d7a61e49129d None None] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:47.219739 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1ad41f-efb1-4253-9067-d7a61e49129d None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:47.219889 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1ad41f-efb1-4253-9067-d7a61e49129d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:47.236652 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.auth.core [None req-7f1ad41f-efb1-4253-9067-d7a61e49129d None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:29:47.237825 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-7f1ad41f-efb1-4253-9067-d7a61e49129d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:29:47.305098 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 589/1179] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 14:29:47 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 14:29:47.330447 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca968bf-9291-46f4-bbb0-62f8369a206c None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:47.386692 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:47.431210 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca968bf-9291-46f4-bbb0-62f8369a206c None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:47.464016 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d3820f-83a0-4822-99b2-d724eb22fa55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:47.464741 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d3820f-83a0-4822-99b2-d724eb22fa55 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:47.465028 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d3820f-83a0-4822-99b2-d724eb22fa55 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:47.465305 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d3820f-83a0-4822-99b2-d724eb22fa55 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:47.475139 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d3820f-83a0-4822-99b2-d724eb22fa55 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:29:47.483448 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application [None req-f3d3820f-83a0-4822-99b2-d724eb22fa55 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 14:29:47.483448 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:29:47.483448 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:29:47.483448 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:29:47.483448 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:29:47.483448 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:29:47.483448 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:29:47.483448 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:29:47.483448 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:29:47.483448 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:29:47.483448 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:29:47.483448 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:29:47.483448 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:29:47.483448 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:29:47.483448 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:29:47.483448 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:29:47.484603 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:29:47.484603 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:29:47.484603 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:29:47.484603 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:29:47.484603 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:29:47.484603 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:29:47.484603 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:29:47.484603 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:29:47.484603 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:29:47.484603 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:29:47.484603 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:29:47.484603 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application with Lock( May 25 14:29:47.484603 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:29:47.484603 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._enter() May 25 14:29:47.484603 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:29:47.484603 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:29:47.485682 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:29:47.485682 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.creator() May 25 14:29:47.485682 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:29:47.485682 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application created_value = creator( May 25 14:29:47.485682 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:29:47.485682 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:29:47.485682 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:29:47.485682 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:29:47.485682 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:29:47.485682 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:29:47.485682 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 14:29:47.485682 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:29:47.485682 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 591/1180] 10.222.0.67 () {56 vars in 1096 bytes} [Wed May 25 14:29:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:29:47.490649 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1ad41f-efb1-4253-9067-d7a61e49129d None None] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:47.589242 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1ad41f-efb1-4253-9067-d7a61e49129d None None] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:47.591032 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:47.626047 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13215956-8525-4f6f-918b-599cfee28c00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:47.626707 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13215956-8525-4f6f-918b-599cfee28c00 None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:47.627014 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13215956-8525-4f6f-918b-599cfee28c00 None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:47.627293 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13215956-8525-4f6f-918b-599cfee28c00 None admin] PATH_INFO: `/v3/roles` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:47.628041 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13215956-8525-4f6f-918b-599cfee28c00 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:29:47.628350 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13215956-8525-4f6f-918b-599cfee28c00 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:47.629708 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13215956-8525-4f6f-918b-599cfee28c00 None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:47.637613 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 590/1181] 10.222.0.67 () {56 vars in 1099 bytes} [Wed May 25 14:29:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:29:47.643411 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d3820f-83a0-4822-99b2-d724eb22fa55 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:47.740562 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d3820f-83a0-4822-99b2-d724eb22fa55 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:47.754745 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:47.775121 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b256197-85f9-47ae-b3bd-278e4502295c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:47.775980 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b256197-85f9-47ae-b3bd-278e4502295c None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:47.776265 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b256197-85f9-47ae-b3bd-278e4502295c None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:47.776540 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b256197-85f9-47ae-b3bd-278e4502295c None admin] PATH_INFO: `/v3/users/34ffa8cee05b434392041ae91cb9b793` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:47.789350 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b256197-85f9-47ae-b3bd-278e4502295c None admin] RBAC: Authorizing `identity:get_user(user_id=34ffa8cee05b434392041ae91cb9b793)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:47.790797 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b256197-85f9-47ae-b3bd-278e4502295c None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:47.792463 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 592/1182] 10.222.0.67 () {56 vars in 1177 bytes} [Wed May 25 14:29:47 2022] GET /identity/v3/users/34ffa8cee05b434392041ae91cb9b793 => generated 311 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:29:47.798409 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13215956-8525-4f6f-918b-599cfee28c00 None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:47.897668 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13215956-8525-4f6f-918b-599cfee28c00 None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:47.930620 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee250b4-4913-43a8-847e-48e9336cbeb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:47.931297 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee250b4-4913-43a8-847e-48e9336cbeb6 None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:47.931582 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee250b4-4913-43a8-847e-48e9336cbeb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:47.931857 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee250b4-4913-43a8-847e-48e9336cbeb6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:47.960829 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:47.997984 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee250b4-4913-43a8-847e-48e9336cbeb6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:47.999380 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee250b4-4913-43a8-847e-48e9336cbeb6 None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:48.092309 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 591/1183] 10.222.0.67 () {58 vars in 1282 bytes} [Wed May 25 14:29:47 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 25 14:29:48.098171 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b256197-85f9-47ae-b3bd-278e4502295c None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:48.197818 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b256197-85f9-47ae-b3bd-278e4502295c None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:48.230269 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e36165-e57e-4b07-b60d-7ac20d69745b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:48.231140 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e36165-e57e-4b07-b60d-7ac20d69745b None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:48.232462 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e36165-e57e-4b07-b60d-7ac20d69745b None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:48.232750 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e36165-e57e-4b07-b60d-7ac20d69745b None admin] PATH_INFO: `/v3/projects/fd2d97ddfc89436b8c2ef5ce30224d1d` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:48.233929 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e36165-e57e-4b07-b60d-7ac20d69745b None admin] RBAC: Authorizing `identity:get_project(project_id=fd2d97ddfc89436b8c2ef5ce30224d1d)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:48.235394 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e36165-e57e-4b07-b60d-7ac20d69745b None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:48.237066 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 593/1184] 10.222.0.67 () {56 vars in 1186 bytes} [Wed May 25 14:29:48 2022] GET /identity/v3/projects/fd2d97ddfc89436b8c2ef5ce30224d1d => generated 361 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:29:48.243019 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee250b4-4913-43a8-847e-48e9336cbeb6 None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:48.304330 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:48.340812 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee250b4-4913-43a8-847e-48e9336cbeb6 None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:48.374421 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4d5911-dbdb-481d-ba18-b7aff3b2a027 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:48.375092 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4d5911-dbdb-481d-ba18-b7aff3b2a027 None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:48.375375 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4d5911-dbdb-481d-ba18-b7aff3b2a027 None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:48.375650 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4d5911-dbdb-481d-ba18-b7aff3b2a027 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:48.376472 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4d5911-dbdb-481d-ba18-b7aff3b2a027 None admin] RBAC: Adding query filter params (role.id=399893e19eac4ab5a8e596f7c07be13c, scope.project.id=fd2d97ddfc89436b8c2ef5ce30224d1d, user.id=34ffa8cee05b434392041ae91cb9b793) {{(pid=80474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:29:48.376780 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4d5911-dbdb-481d-ba18-b7aff3b2a027 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:48.378198 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4d5911-dbdb-481d-ba18-b7aff3b2a027 None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:48.384101 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 592/1185] 10.222.0.67 () {56 vars in 1374 bytes} [Wed May 25 14:29:48 2022] GET /identity/v3/role_assignments?user.id=34ffa8cee05b434392041ae91cb9b793&scope.project.id=fd2d97ddfc89436b8c2ef5ce30224d1d&role.id=399893e19eac4ab5a8e596f7c07be13c => generated 259 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:29:50.549975 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a56adf9-1a24-4763-8795-6aa033b45ada None None] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:50.550507 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a56adf9-1a24-4763-8795-6aa033b45ada None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:50.550507 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a56adf9-1a24-4763-8795-6aa033b45ada None None] PATH_INFO: `/` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:50.551911 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 594/1186] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 14:29:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:29:50.557059 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e788c7-dc64-41c7-8cb8-1916435e80f6 None None] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:50.557450 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e788c7-dc64-41c7-8cb8-1916435e80f6 None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:50.557707 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e788c7-dc64-41c7-8cb8-1916435e80f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:50.574500 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.auth.core [None req-64e788c7-dc64-41c7-8cb8-1916435e80f6 None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:29:50.576656 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-64e788c7-dc64-41c7-8cb8-1916435e80f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:29:50.642629 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 593/1187] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 14:29:50 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 25 14:29:50.665473 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a56adf9-1a24-4763-8795-6aa033b45ada None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:50.708618 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:50.768236 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a56adf9-1a24-4763-8795-6aa033b45ada None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:50.801170 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d956e8-75e8-445d-8d6e-6041b989a56f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:50.801893 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d956e8-75e8-445d-8d6e-6041b989a56f None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:50.802178 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d956e8-75e8-445d-8d6e-6041b989a56f None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:50.802453 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d956e8-75e8-445d-8d6e-6041b989a56f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:50.813178 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d956e8-75e8-445d-8d6e-6041b989a56f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:29:50.820797 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application [None req-34d956e8-75e8-445d-8d6e-6041b989a56f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 14:29:50.820797 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:29:50.820797 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:29:50.820797 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:29:50.820797 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:29:50.820797 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:29:50.820797 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:29:50.820797 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:29:50.820797 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:29:50.820797 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:29:50.820797 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:29:50.820797 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:29:50.820797 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:29:50.820797 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:29:50.820797 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:29:50.820797 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:29:50.821854 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:29:50.821854 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:29:50.821854 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:29:50.821854 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:29:50.821854 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:29:50.821854 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:29:50.821854 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:29:50.821854 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:29:50.821854 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:29:50.821854 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:29:50.821854 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:29:50.821854 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application with Lock( May 25 14:29:50.821854 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:29:50.821854 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._enter() May 25 14:29:50.821854 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:29:50.821854 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:29:50.822902 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:29:50.822902 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.creator() May 25 14:29:50.822902 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:29:50.822902 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application created_value = creator( May 25 14:29:50.822902 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:29:50.822902 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:29:50.822902 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:29:50.822902 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:29:50.822902 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:29:50.822902 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:29:50.822902 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 14:29:50.822902 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:29:50.822902 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 595/1188] 10.222.0.67 () {56 vars in 1096 bytes} [Wed May 25 14:29:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:29:50.829143 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e788c7-dc64-41c7-8cb8-1916435e80f6 None None] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:50.885019 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:50.924868 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e788c7-dc64-41c7-8cb8-1916435e80f6 None None] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:50.957762 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07c9be0-7e91-48f7-8191-6acf026c4ce0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:50.958417 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07c9be0-7e91-48f7-8191-6acf026c4ce0 None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:50.958697 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07c9be0-7e91-48f7-8191-6acf026c4ce0 None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:50.958969 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07c9be0-7e91-48f7-8191-6acf026c4ce0 None admin] PATH_INFO: `/v3/roles` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:50.959735 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07c9be0-7e91-48f7-8191-6acf026c4ce0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:29:50.960038 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07c9be0-7e91-48f7-8191-6acf026c4ce0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:50.961390 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07c9be0-7e91-48f7-8191-6acf026c4ce0 None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:50.969211 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 594/1189] 10.222.0.67 () {56 vars in 1099 bytes} [Wed May 25 14:29:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:29:50.975193 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d956e8-75e8-445d-8d6e-6041b989a56f None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:51.069786 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:51.072630 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d956e8-75e8-445d-8d6e-6041b989a56f None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:51.105766 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76adbe10-5ad5-4d78-bd77-3cc9dfa50bba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:51.107174 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76adbe10-5ad5-4d78-bd77-3cc9dfa50bba None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:51.107461 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76adbe10-5ad5-4d78-bd77-3cc9dfa50bba None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:51.107740 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76adbe10-5ad5-4d78-bd77-3cc9dfa50bba None admin] PATH_INFO: `/v3/users/34ffa8cee05b434392041ae91cb9b793` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:51.108925 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76adbe10-5ad5-4d78-bd77-3cc9dfa50bba None admin] RBAC: Authorizing `identity:get_user(user_id=34ffa8cee05b434392041ae91cb9b793)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:51.110360 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76adbe10-5ad5-4d78-bd77-3cc9dfa50bba None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:51.112005 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 596/1190] 10.222.0.67 () {56 vars in 1177 bytes} [Wed May 25 14:29:50 2022] GET /identity/v3/users/34ffa8cee05b434392041ae91cb9b793 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:29:51.117750 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07c9be0-7e91-48f7-8191-6acf026c4ce0 None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:51.216607 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07c9be0-7e91-48f7-8191-6acf026c4ce0 None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:51.235903 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:51.252012 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac51d3c1-6483-44c9-b5fc-0f77b15ee23c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:51.252854 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac51d3c1-6483-44c9-b5fc-0f77b15ee23c None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:51.253132 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac51d3c1-6483-44c9-b5fc-0f77b15ee23c None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:51.253400 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac51d3c1-6483-44c9-b5fc-0f77b15ee23c None admin] PATH_INFO: `/v3/projects/fd2d97ddfc89436b8c2ef5ce30224d1d` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:51.254557 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac51d3c1-6483-44c9-b5fc-0f77b15ee23c None admin] RBAC: Authorizing `identity:get_project(project_id=fd2d97ddfc89436b8c2ef5ce30224d1d)` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:51.255994 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac51d3c1-6483-44c9-b5fc-0f77b15ee23c None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:51.257655 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 595/1191] 10.222.0.67 () {56 vars in 1186 bytes} [Wed May 25 14:29:51 2022] GET /identity/v3/projects/fd2d97ddfc89436b8c2ef5ce30224d1d => generated 361 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:29:51.264309 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76adbe10-5ad5-4d78-bd77-3cc9dfa50bba None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:51.363990 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76adbe10-5ad5-4d78-bd77-3cc9dfa50bba None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:51.396602 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df65843-dcec-424d-a6e8-573533269c47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:51.397479 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df65843-dcec-424d-a6e8-573533269c47 None admin] REQUEST_METHOD: `PUT` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:51.397765 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df65843-dcec-424d-a6e8-573533269c47 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:51.398043 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df65843-dcec-424d-a6e8-573533269c47 None admin] PATH_INFO: `/v3/projects/fd2d97ddfc89436b8c2ef5ce30224d1d/users/34ffa8cee05b434392041ae91cb9b793/roles/399893e19eac4ab5a8e596f7c07be13c` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:51.400029 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df65843-dcec-424d-a6e8-573533269c47 None admin] RBAC: Authorizing `identity:create_grant(project_id=fd2d97ddfc89436b8c2ef5ce30224d1d, user_id=34ffa8cee05b434392041ae91cb9b793, role_id=399893e19eac4ab5a8e596f7c07be13c)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:51.401461 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df65843-dcec-424d-a6e8-573533269c47 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:51.413724 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 597/1192] 10.222.0.67 () {58 vars in 1439 bytes} [Wed May 25 14:29:51 2022] PUT /identity/v3/projects/fd2d97ddfc89436b8c2ef5ce30224d1d/users/34ffa8cee05b434392041ae91cb9b793/roles/399893e19eac4ab5a8e596f7c07be13c => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:29:53.560332 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799afc24-6b5b-4cb4-ad1d-bfe0dd44a7c4 None None] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:53.560906 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799afc24-6b5b-4cb4-ad1d-bfe0dd44a7c4 None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:53.560906 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799afc24-6b5b-4cb4-ad1d-bfe0dd44a7c4 None None] PATH_INFO: `/` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:53.562257 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 596/1193] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 14:29:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:29:53.567375 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd5d54d-114a-4249-a139-78977be73a10 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:53.567775 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd5d54d-114a-4249-a139-78977be73a10 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:53.567925 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd5d54d-114a-4249-a139-78977be73a10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:53.585055 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-7cd5d54d-114a-4249-a139-78977be73a10 None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:29:53.586489 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-7cd5d54d-114a-4249-a139-78977be73a10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:29:53.609288 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:53.652547 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 598/1194] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 14:29:53 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 14:29:53.678656 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799afc24-6b5b-4cb4-ad1d-bfe0dd44a7c4 None None] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:53.779318 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799afc24-6b5b-4cb4-ad1d-bfe0dd44a7c4 None None] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:53.812184 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00178d1c-29ea-4655-a65a-526604046a3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:53.812904 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00178d1c-29ea-4655-a65a-526604046a3e None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:53.813193 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00178d1c-29ea-4655-a65a-526604046a3e None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:53.813474 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00178d1c-29ea-4655-a65a-526604046a3e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:53.823351 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00178d1c-29ea-4655-a65a-526604046a3e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:29:53.831639 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application [None req-00178d1c-29ea-4655-a65a-526604046a3e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 14:29:53.831639 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:29:53.831639 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:29:53.831639 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:29:53.831639 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:29:53.831639 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:29:53.831639 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:29:53.831639 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:29:53.831639 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:29:53.831639 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:29:53.831639 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:29:53.831639 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:29:53.831639 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:29:53.831639 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:29:53.831639 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:29:53.831639 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:29:53.832781 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:29:53.832781 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:29:53.832781 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:29:53.832781 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:29:53.832781 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:29:53.832781 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:29:53.832781 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:29:53.832781 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:29:53.832781 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:29:53.832781 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:29:53.832781 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:29:53.832781 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application with Lock( May 25 14:29:53.832781 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:29:53.832781 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self._enter() May 25 14:29:53.832781 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:29:53.832781 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:29:53.833978 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:29:53.833978 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.creator() May 25 14:29:53.833978 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:29:53.833978 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application created_value = creator( May 25 14:29:53.833978 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:29:53.833978 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:29:53.833978 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:29:53.833978 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:29:53.833978 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:29:53.833978 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:29:53.833978 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 14:29:53.833978 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application May 25 14:29:53.833978 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 597/1195] 10.222.0.67 () {56 vars in 1096 bytes} [Wed May 25 14:29:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:29:53.838747 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd5d54d-114a-4249-a139-78977be73a10 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:53.938338 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd5d54d-114a-4249-a139-78977be73a10 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:53.972812 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1792dee3-7554-44f1-8f1a-fa33d650c177 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:53.973479 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1792dee3-7554-44f1-8f1a-fa33d650c177 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:53.973763 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1792dee3-7554-44f1-8f1a-fa33d650c177 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:53.974040 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1792dee3-7554-44f1-8f1a-fa33d650c177 None admin] PATH_INFO: `/v3/roles` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:53.974869 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1792dee3-7554-44f1-8f1a-fa33d650c177 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:29:53.975190 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1792dee3-7554-44f1-8f1a-fa33d650c177 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:53.976566 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1792dee3-7554-44f1-8f1a-fa33d650c177 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:53.984532 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 599/1196] 10.222.0.67 () {56 vars in 1099 bytes} [Wed May 25 14:29:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:29:53.990290 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00178d1c-29ea-4655-a65a-526604046a3e None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:54.038543 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:54.089410 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00178d1c-29ea-4655-a65a-526604046a3e None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:54.122141 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73827c28-d094-47de-8abe-3045f66f87dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:54.123270 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73827c28-d094-47de-8abe-3045f66f87dc None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:54.123551 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73827c28-d094-47de-8abe-3045f66f87dc None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:54.123824 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73827c28-d094-47de-8abe-3045f66f87dc None admin] PATH_INFO: `/v3/users/34ffa8cee05b434392041ae91cb9b793` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:54.124992 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73827c28-d094-47de-8abe-3045f66f87dc None admin] RBAC: Authorizing `identity:get_user(user_id=34ffa8cee05b434392041ae91cb9b793)` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:54.126408 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73827c28-d094-47de-8abe-3045f66f87dc None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:54.128021 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 598/1197] 10.222.0.67 () {56 vars in 1177 bytes} [Wed May 25 14:29:53 2022] GET /identity/v3/users/34ffa8cee05b434392041ae91cb9b793 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:29:54.133615 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1792dee3-7554-44f1-8f1a-fa33d650c177 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:54.156154 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:54.231233 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1792dee3-7554-44f1-8f1a-fa33d650c177 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:54.263857 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08761793-3fbb-460f-bac3-a501c0b16b4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:54.264481 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08761793-3fbb-460f-bac3-a501c0b16b4a None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:54.264762 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08761793-3fbb-460f-bac3-a501c0b16b4a None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:54.265036 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08761793-3fbb-460f-bac3-a501c0b16b4a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:54.330894 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08761793-3fbb-460f-bac3-a501c0b16b4a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:54.332364 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08761793-3fbb-460f-bac3-a501c0b16b4a None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:54.352290 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:54.426690 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 600/1198] 10.222.0.67 () {58 vars in 1282 bytes} [Wed May 25 14:29:54 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 25 14:29:54.432553 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73827c28-d094-47de-8abe-3045f66f87dc None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:54.531400 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73827c28-d094-47de-8abe-3045f66f87dc None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:54.547010 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:54.564815 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9911efc9-d5d0-4cd0-bab7-2918abcda866 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:54.565668 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9911efc9-d5d0-4cd0-bab7-2918abcda866 None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:54.565953 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9911efc9-d5d0-4cd0-bab7-2918abcda866 None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:54.566229 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9911efc9-d5d0-4cd0-bab7-2918abcda866 None admin] PATH_INFO: `/v3/projects/fd2d97ddfc89436b8c2ef5ce30224d1d` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:54.567425 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9911efc9-d5d0-4cd0-bab7-2918abcda866 None admin] RBAC: Authorizing `identity:get_project(project_id=fd2d97ddfc89436b8c2ef5ce30224d1d)` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:54.568866 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9911efc9-d5d0-4cd0-bab7-2918abcda866 None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:54.570542 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 599/1199] 10.222.0.67 () {56 vars in 1186 bytes} [Wed May 25 14:29:54 2022] GET /identity/v3/projects/fd2d97ddfc89436b8c2ef5ce30224d1d => generated 361 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:29:54.577076 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08761793-3fbb-460f-bac3-a501c0b16b4a None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:54.672788 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08761793-3fbb-460f-bac3-a501c0b16b4a None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:54.693302 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:54.708023 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e30efb-044d-461d-9c0f-c22a1d7e9ce1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:54.708667 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e30efb-044d-461d-9c0f-c22a1d7e9ce1 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:54.708954 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e30efb-044d-461d-9c0f-c22a1d7e9ce1 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:54.709233 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e30efb-044d-461d-9c0f-c22a1d7e9ce1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:54.710058 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e30efb-044d-461d-9c0f-c22a1d7e9ce1 None admin] RBAC: Adding query filter params (role.id=399893e19eac4ab5a8e596f7c07be13c, scope.project.id=fd2d97ddfc89436b8c2ef5ce30224d1d, user.id=34ffa8cee05b434392041ae91cb9b793) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:29:54.710371 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e30efb-044d-461d-9c0f-c22a1d7e9ce1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:54.711851 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e30efb-044d-461d-9c0f-c22a1d7e9ce1 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:54.717556 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 601/1200] 10.222.0.67 () {56 vars in 1374 bytes} [Wed May 25 14:29:54 2022] GET /identity/v3/role_assignments?user.id=34ffa8cee05b434392041ae91cb9b793&scope.project.id=fd2d97ddfc89436b8c2ef5ce30224d1d&role.id=399893e19eac4ab5a8e596f7c07be13c => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:30:04.560906 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=8 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:30:04.715357 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=8 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:30:56.371471 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03002b3-8763-49c9-8e41-9b2bd1632056 None None] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:30:56.371471 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03002b3-8763-49c9-8e41-9b2bd1632056 None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:30:56.371471 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03002b3-8763-49c9-8e41-9b2bd1632056 None None] PATH_INFO: `/` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:30:56.372746 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 600/1201] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 14:30:56 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:30:56.378601 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e147df7a-4c45-4072-80db-46fba721fd26 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:30:56.379724 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e147df7a-4c45-4072-80db-46fba721fd26 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:30:56.380152 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e147df7a-4c45-4072-80db-46fba721fd26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:30:56.399500 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-e147df7a-4c45-4072-80db-46fba721fd26 None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:30:56.401279 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-e147df7a-4c45-4072-80db-46fba721fd26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:30:56.483054 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 602/1202] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 14:30:56 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 14:30:56.509879 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03002b3-8763-49c9-8e41-9b2bd1632056 None None] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:30:56.656596 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03002b3-8763-49c9-8e41-9b2bd1632056 None None] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:30:56.709624 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bd7375-e5ca-4aab-a66c-b7ff46b3494d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:30:56.710522 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bd7375-e5ca-4aab-a66c-b7ff46b3494d None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:30:56.711322 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bd7375-e5ca-4aab-a66c-b7ff46b3494d None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:30:56.711623 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bd7375-e5ca-4aab-a66c-b7ff46b3494d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:30:56.726212 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bd7375-e5ca-4aab-a66c-b7ff46b3494d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:30:56.727898 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bd7375-e5ca-4aab-a66c-b7ff46b3494d None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:30:56.747976 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application [None req-a9bd7375-e5ca-4aab-a66c-b7ff46b3494d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:30:56.747976 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:30:56.747976 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:30:56.747976 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:30:56.747976 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:30:56.747976 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:30:56.747976 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:30:56.747976 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:30:56.747976 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:30:56.747976 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:30:56.747976 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:30:56.747976 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:30:56.747976 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 14:30:56.747976 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 14:30:56.747976 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 14:30:56.749413 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 14:30:56.749413 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:30:56.749413 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:30:56.749413 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:30:56.749413 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:30:56.749413 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:30:56.749413 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:30:56.749413 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:30:56.749413 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application with Lock( May 25 14:30:56.749413 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:30:56.749413 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self._enter() May 25 14:30:56.749413 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:30:56.749413 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:30:56.749413 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:30:56.749413 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.creator() May 25 14:30:56.749413 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:30:56.749413 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application created_value = creator( May 25 14:30:56.750439 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 14:30:56.750439 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 14:30:56.750439 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:30:56.750439 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application May 25 14:30:56.755984 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e147df7a-4c45-4072-80db-46fba721fd26 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:30:56.757932 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 601/1203] 10.222.0.67 () {56 vars in 1108 bytes} [Wed May 25 14:30:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:30:56.905062 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e147df7a-4c45-4072-80db-46fba721fd26 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:30:56.965111 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:30:56.973894 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf0f6b0-e8bd-45af-a973-e140931b231c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:30:56.974892 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf0f6b0-e8bd-45af-a973-e140931b231c None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:30:56.975211 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf0f6b0-e8bd-45af-a973-e140931b231c None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:30:56.975525 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf0f6b0-e8bd-45af-a973-e140931b231c None admin] PATH_INFO: `/v3/domains` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:30:56.976376 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf0f6b0-e8bd-45af-a973-e140931b231c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:30:56.976673 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf0f6b0-e8bd-45af-a973-e140931b231c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:30:56.978178 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf0f6b0-e8bd-45af-a973-e140931b231c None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:30:56.993961 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 603/1204] 10.222.0.67 () {56 vars in 1109 bytes} [Wed May 25 14:30:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:30:57.000136 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bd7375-e5ca-4aab-a66c-b7ff46b3494d None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:30:57.063043 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:30:57.123117 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bd7375-e5ca-4aab-a66c-b7ff46b3494d None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:30:57.168004 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20739f7-b23b-4046-8268-09df6546c8b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:30:57.168726 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20739f7-b23b-4046-8268-09df6546c8b8 None admin] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:30:57.169118 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20739f7-b23b-4046-8268-09df6546c8b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:30:57.169451 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20739f7-b23b-4046-8268-09df6546c8b8 None admin] PATH_INFO: `/v3/users` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:30:57.170375 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20739f7-b23b-4046-8268-09df6546c8b8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:30:57.175512 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20739f7-b23b-4046-8268-09df6546c8b8 None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:30:57.215843 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 602/1205] 10.222.0.67 () {60 vars in 1132 bytes} [Wed May 25 14:30:56 2022] POST /identity/v3/users => generated 251 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 14:30:59.996310 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bac8f7b-456b-4024-b98c-99c4e4389593 None None] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:30:59.996850 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bac8f7b-456b-4024-b98c-99c4e4389593 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:30:59.997037 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bac8f7b-456b-4024-b98c-99c4e4389593 None None] PATH_INFO: `/` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:30:59.998413 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 604/1206] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 14:30:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:31:00.004676 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72440e4a-095f-47f3-a713-00b44e5d9f8d None None] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:31:00.005130 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72440e4a-095f-47f3-a713-00b44e5d9f8d None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:31:00.005304 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72440e4a-095f-47f3-a713-00b44e5d9f8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:31:00.025244 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.auth.core [None req-72440e4a-095f-47f3-a713-00b44e5d9f8d None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:31:00.026445 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-72440e4a-095f-47f3-a713-00b44e5d9f8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:31:00.114105 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 603/1207] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 14:31:00 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 14:31:00.138177 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bac8f7b-456b-4024-b98c-99c4e4389593 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:31:00.259981 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bac8f7b-456b-4024-b98c-99c4e4389593 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:31:00.307224 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0386a526-966d-4a36-af31-08ea39ac0e1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:31:00.308329 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0386a526-966d-4a36-af31-08ea39ac0e1c None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:31:00.308711 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0386a526-966d-4a36-af31-08ea39ac0e1c None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:31:00.308994 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0386a526-966d-4a36-af31-08ea39ac0e1c None admin] PATH_INFO: `/v3/roles/service` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:31:00.323372 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0386a526-966d-4a36-af31-08ea39ac0e1c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:31:00.332610 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application [None req-0386a526-966d-4a36-af31-08ea39ac0e1c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 25 14:31:00.332610 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:31:00.332610 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:31:00.332610 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:31:00.332610 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:31:00.332610 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:31:00.332610 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:31:00.332610 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:31:00.332610 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:31:00.332610 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:31:00.332610 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:31:00.332610 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:31:00.332610 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:31:00.332610 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:31:00.332610 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:31:00.332610 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:31:00.333885 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:31:00.333885 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:31:00.333885 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:31:00.333885 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:31:00.333885 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:31:00.333885 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:31:00.333885 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:31:00.333885 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:31:00.333885 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:31:00.333885 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:31:00.333885 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:31:00.333885 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application with Lock( May 25 14:31:00.333885 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:31:00.333885 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._enter() May 25 14:31:00.333885 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:31:00.333885 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:31:00.334780 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:31:00.334780 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.creator() May 25 14:31:00.334780 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:31:00.334780 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application created_value = creator( May 25 14:31:00.334780 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:31:00.334780 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:31:00.334780 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:31:00.334780 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:31:00.334780 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:31:00.334780 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:31:00.334780 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 25 14:31:00.334780 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:31:00.334780 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 605/1208] 10.222.0.67 () {56 vars in 1102 bytes} [Wed May 25 14:31:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:31:00.341134 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72440e4a-095f-47f3-a713-00b44e5d9f8d None None] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:31:00.390566 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:31:00.458431 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72440e4a-095f-47f3-a713-00b44e5d9f8d None None] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:31:00.502761 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae4195b-8105-4278-8a69-dcb5b7661deb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:31:00.503465 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae4195b-8105-4278-8a69-dcb5b7661deb None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:31:00.503753 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae4195b-8105-4278-8a69-dcb5b7661deb None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:31:00.504035 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae4195b-8105-4278-8a69-dcb5b7661deb None admin] PATH_INFO: `/v3/roles` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:31:00.504791 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae4195b-8105-4278-8a69-dcb5b7661deb None admin] RBAC: Adding query filter params (name=service) {{(pid=80474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:31:00.505103 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae4195b-8105-4278-8a69-dcb5b7661deb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:31:00.506501 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae4195b-8105-4278-8a69-dcb5b7661deb None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:31:00.521890 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 604/1209] 10.222.0.67 () {56 vars in 1103 bytes} [Wed May 25 14:31:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:31:00.523912 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0386a526-966d-4a36-af31-08ea39ac0e1c None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:31:00.583599 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:31:00.650607 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0386a526-966d-4a36-af31-08ea39ac0e1c None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:31:00.693732 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c108e0d4-550e-48bd-b23e-1170d4975c0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:31:00.694631 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c108e0d4-550e-48bd-b23e-1170d4975c0e None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:31:00.694917 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c108e0d4-550e-48bd-b23e-1170d4975c0e None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:31:00.695280 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c108e0d4-550e-48bd-b23e-1170d4975c0e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:31:00.716302 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c108e0d4-550e-48bd-b23e-1170d4975c0e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:31:00.717916 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c108e0d4-550e-48bd-b23e-1170d4975c0e None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:31:00.743982 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application [None req-c108e0d4-550e-48bd-b23e-1170d4975c0e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:31:00.743982 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:31:00.743982 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:31:00.743982 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:31:00.743982 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:31:00.743982 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:31:00.743982 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:31:00.743982 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:31:00.743982 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:31:00.743982 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:31:00.743982 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:31:00.743982 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:31:00.743982 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 14:31:00.743982 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 14:31:00.743982 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 14:31:00.744992 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 14:31:00.744992 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:31:00.744992 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:31:00.744992 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:31:00.744992 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:31:00.744992 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:31:00.744992 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:31:00.744992 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:31:00.744992 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application with Lock( May 25 14:31:00.744992 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:31:00.744992 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._enter() May 25 14:31:00.744992 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:31:00.744992 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:31:00.744992 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:31:00.744992 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.creator() May 25 14:31:00.744992 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:31:00.744992 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application created_value = creator( May 25 14:31:00.746043 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 14:31:00.746043 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 14:31:00.746043 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:31:00.746043 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:31:00.747970 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 606/1210] 10.222.0.67 () {56 vars in 1108 bytes} [Wed May 25 14:31:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:31:00.754730 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae4195b-8105-4278-8a69-dcb5b7661deb None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:31:00.877074 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:31:00.881055 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae4195b-8105-4278-8a69-dcb5b7661deb None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:31:00.931784 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eff4a19-1e70-4173-8ea3-54b2ac4b6834 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:31:00.932375 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eff4a19-1e70-4173-8ea3-54b2ac4b6834 None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:31:00.932667 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eff4a19-1e70-4173-8ea3-54b2ac4b6834 None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:31:00.932998 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eff4a19-1e70-4173-8ea3-54b2ac4b6834 None admin] PATH_INFO: `/v3/domains` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:31:00.933795 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eff4a19-1e70-4173-8ea3-54b2ac4b6834 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:31:00.934104 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eff4a19-1e70-4173-8ea3-54b2ac4b6834 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:31:00.935628 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eff4a19-1e70-4173-8ea3-54b2ac4b6834 None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:31:00.950483 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 605/1211] 10.222.0.67 () {56 vars in 1109 bytes} [Wed May 25 14:31:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:31:00.956631 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c108e0d4-550e-48bd-b23e-1170d4975c0e None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:31:01.081306 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c108e0d4-550e-48bd-b23e-1170d4975c0e None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:31:01.083051 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:31:01.122119 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a000a7bc-0f34-447a-9cf9-07407ce074a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:31:01.123151 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a000a7bc-0f34-447a-9cf9-07407ce074a3 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:31:01.123436 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a000a7bc-0f34-447a-9cf9-07407ce074a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:31:01.123773 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a000a7bc-0f34-447a-9cf9-07407ce074a3 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:31:01.134549 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a000a7bc-0f34-447a-9cf9-07407ce074a3 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:31:01.136896 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a000a7bc-0f34-447a-9cf9-07407ce074a3 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:31:01.156882 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application [None req-a000a7bc-0f34-447a-9cf9-07407ce074a3 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 25 14:31:01.156882 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:31:01.156882 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:31:01.156882 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:31:01.156882 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:31:01.156882 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:31:01.156882 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:31:01.156882 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:31:01.156882 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:31:01.156882 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:31:01.156882 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:31:01.156882 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:31:01.156882 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 14:31:01.156882 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 14:31:01.156882 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 14:31:01.156882 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 14:31:01.159392 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:31:01.159392 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:31:01.159392 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 14:31:01.159392 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 14:31:01.159392 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 14:31:01.159392 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 14:31:01.159392 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:31:01.159392 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:31:01.159392 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:31:01.159392 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:31:01.159392 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:31:01.159392 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application with Lock( May 25 14:31:01.159392 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:31:01.159392 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._enter() May 25 14:31:01.159392 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:31:01.159392 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:31:01.159392 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:31:01.159392 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.creator() May 25 14:31:01.160482 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:31:01.160482 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application created_value = creator( May 25 14:31:01.160482 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 14:31:01.160482 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 14:31:01.160482 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 14:31:01.160482 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 14:31:01.160482 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 14:31:01.160482 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 14:31:01.160482 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 25 14:31:01.160482 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:31:01.167694 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 607/1212] 10.222.0.67 () {56 vars in 1108 bytes} [Wed May 25 14:31:00 2022] GET /identity/v3/users/placement => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:31:01.170180 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eff4a19-1e70-4173-8ea3-54b2ac4b6834 None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:31:01.288737 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eff4a19-1e70-4173-8ea3-54b2ac4b6834 None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:31:01.334833 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dff28bb-5866-41c8-9761-f1d176ec1fea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:31:01.335548 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dff28bb-5866-41c8-9761-f1d176ec1fea None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:31:01.335825 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dff28bb-5866-41c8-9761-f1d176ec1fea None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:31:01.336102 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dff28bb-5866-41c8-9761-f1d176ec1fea None admin] PATH_INFO: `/v3/users` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:31:01.336937 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dff28bb-5866-41c8-9761-f1d176ec1fea None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:31:01.337274 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dff28bb-5866-41c8-9761-f1d176ec1fea None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:31:01.338724 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dff28bb-5866-41c8-9761-f1d176ec1fea None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:31:01.360551 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 606/1213] 10.222.0.67 () {56 vars in 1143 bytes} [Wed May 25 14:31:01 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:31:01.367149 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a000a7bc-0f34-447a-9cf9-07407ce074a3 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:31:01.504782 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a000a7bc-0f34-447a-9cf9-07407ce074a3 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:31:01.556793 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fb06bc-b4ab-4dc2-86c7-139db6b3859a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:31:01.557511 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fb06bc-b4ab-4dc2-86c7-139db6b3859a None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:31:01.557851 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fb06bc-b4ab-4dc2-86c7-139db6b3859a None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:31:01.559050 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fb06bc-b4ab-4dc2-86c7-139db6b3859a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:31:01.598975 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:31:01.643714 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fb06bc-b4ab-4dc2-86c7-139db6b3859a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:31:01.645208 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fb06bc-b4ab-4dc2-86c7-139db6b3859a None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:31:01.765385 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 608/1214] 10.222.0.67 () {58 vars in 1282 bytes} [Wed May 25 14:31:01 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 25 14:31:01.772984 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dff28bb-5866-41c8-9761-f1d176ec1fea None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:31:01.796606 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:31:01.908513 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dff28bb-5866-41c8-9761-f1d176ec1fea None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:31:01.960619 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f4bdbe-8e9c-4e30-9364-50889a06d440 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:31:01.961452 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f4bdbe-8e9c-4e30-9364-50889a06d440 None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:31:01.961720 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f4bdbe-8e9c-4e30-9364-50889a06d440 None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:31:01.962024 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f4bdbe-8e9c-4e30-9364-50889a06d440 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:31:01.973318 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f4bdbe-8e9c-4e30-9364-50889a06d440 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:31:01.974775 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f4bdbe-8e9c-4e30-9364-50889a06d440 None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:31:01.997755 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application [None req-61f4bdbe-8e9c-4e30-9364-50889a06d440 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:31:01.997755 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:31:01.997755 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:31:01.997755 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:31:01.997755 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:31:01.997755 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:31:01.997755 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:31:01.997755 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:31:01.997755 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:31:01.997755 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:31:01.997755 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:31:01.997755 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:31:01.997755 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 14:31:01.997755 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 14:31:01.997755 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 14:31:01.998790 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 14:31:01.998790 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:31:01.998790 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:31:01.998790 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:31:01.998790 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:31:01.998790 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:31:01.998790 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:31:01.998790 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:31:01.998790 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application with Lock( May 25 14:31:01.998790 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:31:01.998790 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self._enter() May 25 14:31:01.998790 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:31:01.998790 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:31:01.998790 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:31:01.998790 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.creator() May 25 14:31:01.998790 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:31:01.998790 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application created_value = creator( May 25 14:31:02.000029 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 14:31:02.000029 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 14:31:02.000029 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:31:02.000029 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application May 25 14:31:02.000029 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 607/1215] 10.222.0.67 () {56 vars in 1108 bytes} [Wed May 25 14:31:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 14:31:02.004941 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fb06bc-b4ab-4dc2-86c7-139db6b3859a None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:31:02.074192 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:31:02.125894 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fb06bc-b4ab-4dc2-86c7-139db6b3859a None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:31:02.166592 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70768297-cf72-42f3-a709-ccf7ef689e54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:31:02.167304 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70768297-cf72-42f3-a709-ccf7ef689e54 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:31:02.167588 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70768297-cf72-42f3-a709-ccf7ef689e54 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:31:02.168423 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70768297-cf72-42f3-a709-ccf7ef689e54 None admin] PATH_INFO: `/v3/domains` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:31:02.169566 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70768297-cf72-42f3-a709-ccf7ef689e54 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:31:02.169873 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70768297-cf72-42f3-a709-ccf7ef689e54 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:31:02.171468 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70768297-cf72-42f3-a709-ccf7ef689e54 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:31:02.199553 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 609/1216] 10.222.0.67 () {56 vars in 1109 bytes} [Wed May 25 14:31:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:31:02.201834 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f4bdbe-8e9c-4e30-9364-50889a06d440 None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:31:02.294430 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:31:02.342531 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f4bdbe-8e9c-4e30-9364-50889a06d440 None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:31:02.389148 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37e524d-b14d-402b-b51b-1b1a049538d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:31:02.390083 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37e524d-b14d-402b-b51b-1b1a049538d8 None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:31:02.390524 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37e524d-b14d-402b-b51b-1b1a049538d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:31:02.390873 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37e524d-b14d-402b-b51b-1b1a049538d8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:31:02.398632 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37e524d-b14d-402b-b51b-1b1a049538d8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:31:02.400184 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37e524d-b14d-402b-b51b-1b1a049538d8 None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:31:02.418481 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application [None req-e37e524d-b14d-402b-b51b-1b1a049538d8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 14:31:02.418481 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:31:02.418481 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:31:02.418481 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:31:02.418481 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:31:02.418481 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:31:02.418481 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:31:02.418481 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:31:02.418481 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:31:02.418481 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:31:02.418481 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:31:02.418481 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:31:02.418481 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 14:31:02.418481 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 14:31:02.418481 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 14:31:02.419526 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 14:31:02.419526 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:31:02.419526 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:31:02.419526 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:31:02.419526 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:31:02.419526 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:31:02.419526 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:31:02.419526 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:31:02.419526 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application with Lock( May 25 14:31:02.419526 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:31:02.419526 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self._enter() May 25 14:31:02.419526 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:31:02.419526 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:31:02.419526 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:31:02.419526 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.creator() May 25 14:31:02.419526 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:31:02.419526 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application created_value = creator( May 25 14:31:02.420469 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 14:31:02.420469 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 14:31:02.420469 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 14:31:02.420469 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 14:31:02.420469 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 14:31:02.420469 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 14:31:02.420469 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 14:31:02.420469 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application May 25 14:31:02.420469 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 608/1217] 10.222.0.67 () {56 vars in 1111 bytes} [Wed May 25 14:31:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:31:02.431041 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70768297-cf72-42f3-a709-ccf7ef689e54 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:31:02.541182 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70768297-cf72-42f3-a709-ccf7ef689e54 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:31:02.573234 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:31:02.593174 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d494a3a2-e3bc-407a-a1ee-a90f68bbfc4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:31:02.594028 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d494a3a2-e3bc-407a-a1ee-a90f68bbfc4a None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:31:02.594319 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d494a3a2-e3bc-407a-a1ee-a90f68bbfc4a None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:31:02.594673 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d494a3a2-e3bc-407a-a1ee-a90f68bbfc4a None admin] PATH_INFO: `/v3/projects` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:31:02.595740 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d494a3a2-e3bc-407a-a1ee-a90f68bbfc4a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:31:02.596069 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d494a3a2-e3bc-407a-a1ee-a90f68bbfc4a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:31:02.597814 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d494a3a2-e3bc-407a-a1ee-a90f68bbfc4a None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:31:02.618333 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 610/1218] 10.222.0.67 () {56 vars in 1148 bytes} [Wed May 25 14:31:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:31:02.627087 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37e524d-b14d-402b-b51b-1b1a049538d8 None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:31:02.762893 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37e524d-b14d-402b-b51b-1b1a049538d8 None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:31:02.804620 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:31:02.814572 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8426e57f-285d-444d-9046-d70b7ee719ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:31:02.815340 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8426e57f-285d-444d-9046-d70b7ee719ac None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:31:02.816038 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8426e57f-285d-444d-9046-d70b7ee719ac None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:31:02.816331 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8426e57f-285d-444d-9046-d70b7ee719ac None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:31:02.817417 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8426e57f-285d-444d-9046-d70b7ee719ac None admin] RBAC: Adding query filter params (role.id=85be32e3c1ae4269b5456307e0827cc7, scope.project.id=bfe93ee8d32a441295efc0b885de4bd7, user.id=ad2b99c2122a4311996364e982e1c801) {{(pid=80474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:31:02.817922 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8426e57f-285d-444d-9046-d70b7ee719ac None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:31:02.819378 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8426e57f-285d-444d-9046-d70b7ee719ac None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:31:02.831383 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 609/1219] 10.222.0.67 () {56 vars in 1374 bytes} [Wed May 25 14:31:02 2022] GET /identity/v3/role_assignments?user.id=ad2b99c2122a4311996364e982e1c801&scope.project.id=bfe93ee8d32a441295efc0b885de4bd7&role.id=85be32e3c1ae4269b5456307e0827cc7 => generated 259 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:31:05.170191 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38a4a1d-86e5-427c-bfe4-4fa73875d614 None None] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:31:05.170829 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38a4a1d-86e5-427c-bfe4-4fa73875d614 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:31:05.170829 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38a4a1d-86e5-427c-bfe4-4fa73875d614 None None] PATH_INFO: `/` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:31:05.172068 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 611/1220] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 14:31:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:31:05.177695 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3e17cf-4c20-466b-8f07-e85d1e8cd7ba None None] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:31:05.178212 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3e17cf-4c20-466b-8f07-e85d1e8cd7ba None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:31:05.178312 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3e17cf-4c20-466b-8f07-e85d1e8cd7ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:31:05.195592 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.auth.core [None req-9a3e17cf-4c20-466b-8f07-e85d1e8cd7ba None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:31:05.196805 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-9a3e17cf-4c20-466b-8f07-e85d1e8cd7ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:31:05.270713 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 610/1221] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 14:31:05 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 14:31:05.294873 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38a4a1d-86e5-427c-bfe4-4fa73875d614 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:31:05.406090 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38a4a1d-86e5-427c-bfe4-4fa73875d614 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:31:05.444160 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc950227-0217-46dd-bdce-45550e1d8c59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:31:05.445025 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc950227-0217-46dd-bdce-45550e1d8c59 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:31:05.445409 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc950227-0217-46dd-bdce-45550e1d8c59 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:31:05.445803 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc950227-0217-46dd-bdce-45550e1d8c59 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:31:05.456607 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc950227-0217-46dd-bdce-45550e1d8c59 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:31:05.465345 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application [None req-fc950227-0217-46dd-bdce-45550e1d8c59 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 25 14:31:05.465345 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:31:05.465345 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:31:05.465345 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:31:05.465345 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:31:05.465345 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:31:05.465345 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:31:05.465345 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:31:05.465345 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:31:05.465345 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:31:05.465345 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:31:05.465345 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:31:05.465345 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:31:05.465345 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:31:05.465345 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:31:05.465345 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:31:05.466640 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:31:05.466640 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:31:05.466640 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:31:05.466640 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:31:05.466640 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:31:05.466640 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:31:05.466640 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:31:05.466640 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:31:05.466640 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:31:05.466640 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:31:05.466640 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:31:05.466640 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application with Lock( May 25 14:31:05.466640 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:31:05.466640 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._enter() May 25 14:31:05.466640 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:31:05.466640 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:31:05.467831 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:31:05.467831 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.creator() May 25 14:31:05.467831 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:31:05.467831 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application created_value = creator( May 25 14:31:05.467831 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:31:05.467831 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:31:05.467831 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:31:05.467831 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:31:05.467831 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:31:05.467831 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:31:05.467831 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 25 14:31:05.467831 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:31:05.469441 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 612/1222] 10.222.0.67 () {56 vars in 1102 bytes} [Wed May 25 14:31:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 14:31:05.475571 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3e17cf-4c20-466b-8f07-e85d1e8cd7ba None None] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:31:05.591711 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3e17cf-4c20-466b-8f07-e85d1e8cd7ba None None] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:31:05.620035 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:31:05.633216 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a809744-2c63-4437-b903-6c368e4b7f4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:31:05.634032 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a809744-2c63-4437-b903-6c368e4b7f4c None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:31:05.634312 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a809744-2c63-4437-b903-6c368e4b7f4c None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:31:05.634588 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a809744-2c63-4437-b903-6c368e4b7f4c None admin] PATH_INFO: `/v3/roles` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:31:05.635506 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a809744-2c63-4437-b903-6c368e4b7f4c None admin] RBAC: Adding query filter params (name=service) {{(pid=80474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:31:05.635855 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a809744-2c63-4437-b903-6c368e4b7f4c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:31:05.638126 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a809744-2c63-4437-b903-6c368e4b7f4c None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:31:05.648611 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 611/1223] 10.222.0.67 () {56 vars in 1103 bytes} [Wed May 25 14:31:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:31:05.655334 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc950227-0217-46dd-bdce-45550e1d8c59 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:31:05.707092 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:31:05.775180 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc950227-0217-46dd-bdce-45550e1d8c59 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:31:05.816202 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f93ecd7-9e09-4c7f-8ae3-1cf70d20005b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:31:05.817086 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f93ecd7-9e09-4c7f-8ae3-1cf70d20005b None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:31:05.817365 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f93ecd7-9e09-4c7f-8ae3-1cf70d20005b None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:31:05.817713 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f93ecd7-9e09-4c7f-8ae3-1cf70d20005b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:31:05.830622 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f93ecd7-9e09-4c7f-8ae3-1cf70d20005b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:31:05.832597 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f93ecd7-9e09-4c7f-8ae3-1cf70d20005b None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:31:05.857755 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application [None req-5f93ecd7-9e09-4c7f-8ae3-1cf70d20005b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:31:05.857755 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:31:05.857755 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:31:05.857755 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:31:05.857755 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:31:05.857755 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:31:05.857755 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:31:05.857755 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:31:05.857755 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:31:05.857755 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:31:05.857755 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:31:05.857755 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:31:05.857755 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 14:31:05.857755 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 14:31:05.857755 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 14:31:05.858925 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 14:31:05.858925 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:31:05.858925 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:31:05.858925 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:31:05.858925 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:31:05.858925 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:31:05.858925 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:31:05.858925 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:31:05.858925 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application with Lock( May 25 14:31:05.858925 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:31:05.858925 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._enter() May 25 14:31:05.858925 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:31:05.858925 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:31:05.858925 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:31:05.858925 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.creator() May 25 14:31:05.858925 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:31:05.858925 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application created_value = creator( May 25 14:31:05.859919 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 14:31:05.859919 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 14:31:05.859919 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:31:05.859919 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:31:05.859919 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 613/1224] 10.222.0.67 () {56 vars in 1108 bytes} [Wed May 25 14:31:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 14:31:05.864919 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a809744-2c63-4437-b903-6c368e4b7f4c None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:31:05.978650 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a809744-2c63-4437-b903-6c368e4b7f4c None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:31:06.018324 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd4bbd6-4e4c-4fc7-a29c-a7b78c51c69c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:31:06.019019 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd4bbd6-4e4c-4fc7-a29c-a7b78c51c69c None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:31:06.019318 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd4bbd6-4e4c-4fc7-a29c-a7b78c51c69c None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:31:06.019600 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd4bbd6-4e4c-4fc7-a29c-a7b78c51c69c None admin] PATH_INFO: `/v3/domains` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:31:06.020342 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd4bbd6-4e4c-4fc7-a29c-a7b78c51c69c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:31:06.020715 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd4bbd6-4e4c-4fc7-a29c-a7b78c51c69c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:31:06.022429 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd4bbd6-4e4c-4fc7-a29c-a7b78c51c69c None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:31:06.037676 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 612/1225] 10.222.0.67 () {56 vars in 1109 bytes} [Wed May 25 14:31:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:31:06.044599 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f93ecd7-9e09-4c7f-8ae3-1cf70d20005b None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:31:06.158561 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:31:06.166581 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f93ecd7-9e09-4c7f-8ae3-1cf70d20005b None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:31:06.204300 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a44539c-4fc5-482b-a2b9-1118721d0cd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:31:06.205104 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a44539c-4fc5-482b-a2b9-1118721d0cd8 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:31:06.205389 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a44539c-4fc5-482b-a2b9-1118721d0cd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:31:06.205668 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a44539c-4fc5-482b-a2b9-1118721d0cd8 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:31:06.214259 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a44539c-4fc5-482b-a2b9-1118721d0cd8 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:31:06.216538 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a44539c-4fc5-482b-a2b9-1118721d0cd8 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:31:06.231990 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application [None req-0a44539c-4fc5-482b-a2b9-1118721d0cd8 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 25 14:31:06.231990 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:31:06.231990 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:31:06.231990 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:31:06.231990 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:31:06.231990 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:31:06.231990 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:31:06.231990 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:31:06.231990 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:31:06.231990 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:31:06.231990 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:31:06.231990 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:31:06.231990 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 14:31:06.231990 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 14:31:06.231990 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 14:31:06.231990 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 14:31:06.238692 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:31:06.238692 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:31:06.238692 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 14:31:06.238692 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 14:31:06.238692 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 14:31:06.238692 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 14:31:06.238692 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:31:06.238692 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:31:06.238692 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:31:06.238692 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:31:06.238692 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:31:06.238692 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application with Lock( May 25 14:31:06.238692 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:31:06.238692 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._enter() May 25 14:31:06.238692 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:31:06.238692 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:31:06.238692 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:31:06.238692 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.creator() May 25 14:31:06.239945 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:31:06.239945 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application created_value = creator( May 25 14:31:06.239945 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 14:31:06.239945 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 14:31:06.239945 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 14:31:06.239945 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 14:31:06.239945 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 14:31:06.239945 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 14:31:06.239945 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 25 14:31:06.239945 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:31:06.239945 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 614/1226] 10.222.0.67 () {56 vars in 1108 bytes} [Wed May 25 14:31:06 2022] GET /identity/v3/users/placement => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:31:06.240690 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd4bbd6-4e4c-4fc7-a29c-a7b78c51c69c None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:31:06.295735 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:31:06.358484 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd4bbd6-4e4c-4fc7-a29c-a7b78c51c69c None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:31:06.396705 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0f5dbe-f141-4953-8687-00c087cc9a30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:31:06.397423 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0f5dbe-f141-4953-8687-00c087cc9a30 None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:31:06.397745 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0f5dbe-f141-4953-8687-00c087cc9a30 None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:31:06.398061 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0f5dbe-f141-4953-8687-00c087cc9a30 None admin] PATH_INFO: `/v3/users` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:31:06.398899 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0f5dbe-f141-4953-8687-00c087cc9a30 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:31:06.399241 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0f5dbe-f141-4953-8687-00c087cc9a30 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:31:06.400858 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0f5dbe-f141-4953-8687-00c087cc9a30 None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:31:06.420215 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 613/1227] 10.222.0.67 () {56 vars in 1143 bytes} [Wed May 25 14:31:06 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:31:06.426388 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a44539c-4fc5-482b-a2b9-1118721d0cd8 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:31:06.534183 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a44539c-4fc5-482b-a2b9-1118721d0cd8 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:31:06.570016 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c9b0b1-c632-4673-8de9-2eab05d061cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:31:06.571017 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c9b0b1-c632-4673-8de9-2eab05d061cf None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:31:06.571181 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c9b0b1-c632-4673-8de9-2eab05d061cf None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:31:06.571449 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c9b0b1-c632-4673-8de9-2eab05d061cf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:31:06.583900 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c9b0b1-c632-4673-8de9-2eab05d061cf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:31:06.585652 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c9b0b1-c632-4673-8de9-2eab05d061cf None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:31:06.607827 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application [None req-18c9b0b1-c632-4673-8de9-2eab05d061cf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:31:06.607827 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:31:06.607827 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:31:06.607827 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:31:06.607827 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:31:06.607827 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:31:06.607827 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:31:06.607827 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:31:06.607827 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:31:06.607827 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:31:06.607827 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:31:06.607827 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:31:06.607827 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 14:31:06.607827 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 14:31:06.607827 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 14:31:06.608982 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 14:31:06.608982 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:31:06.608982 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:31:06.608982 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:31:06.608982 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:31:06.608982 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:31:06.608982 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:31:06.608982 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:31:06.608982 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application with Lock( May 25 14:31:06.608982 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:31:06.608982 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._enter() May 25 14:31:06.608982 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:31:06.608982 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:31:06.608982 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:31:06.608982 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.creator() May 25 14:31:06.608982 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:31:06.608982 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application created_value = creator( May 25 14:31:06.610201 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 14:31:06.610201 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 14:31:06.610201 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:31:06.610201 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:31:06.610201 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 615/1228] 10.222.0.67 () {56 vars in 1108 bytes} [Wed May 25 14:31:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:31:06.616231 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0f5dbe-f141-4953-8687-00c087cc9a30 None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:31:06.731218 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0f5dbe-f141-4953-8687-00c087cc9a30 None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:31:06.738880 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:31:06.771700 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f178e0e-3f87-455a-8a2c-0faf451f45f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:31:06.772374 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f178e0e-3f87-455a-8a2c-0faf451f45f6 None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:31:06.772660 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f178e0e-3f87-455a-8a2c-0faf451f45f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:31:06.772945 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f178e0e-3f87-455a-8a2c-0faf451f45f6 None admin] PATH_INFO: `/v3/domains` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:31:06.773722 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f178e0e-3f87-455a-8a2c-0faf451f45f6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:31:06.774074 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f178e0e-3f87-455a-8a2c-0faf451f45f6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:31:06.775572 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f178e0e-3f87-455a-8a2c-0faf451f45f6 None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:31:06.787992 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 614/1229] 10.222.0.67 () {56 vars in 1109 bytes} [Wed May 25 14:31:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:31:06.793875 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c9b0b1-c632-4673-8de9-2eab05d061cf None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:31:06.805988 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:31:06.909062 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c9b0b1-c632-4673-8de9-2eab05d061cf None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:31:06.946331 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32f9bf3-6dde-489e-95b5-f0a6aa69acae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:31:06.947136 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32f9bf3-6dde-489e-95b5-f0a6aa69acae None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:31:06.947426 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32f9bf3-6dde-489e-95b5-f0a6aa69acae None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:31:06.947709 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32f9bf3-6dde-489e-95b5-f0a6aa69acae None admin] PATH_INFO: `/v3/projects/service` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:31:06.954705 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32f9bf3-6dde-489e-95b5-f0a6aa69acae None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:31:06.956204 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32f9bf3-6dde-489e-95b5-f0a6aa69acae None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:31:06.970812 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application [None req-f32f9bf3-6dde-489e-95b5-f0a6aa69acae None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 14:31:06.970812 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:31:06.970812 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:31:06.970812 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:31:06.970812 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:31:06.970812 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:31:06.970812 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:31:06.970812 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:31:06.970812 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:31:06.970812 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:31:06.970812 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:31:06.970812 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:31:06.970812 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 14:31:06.970812 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 14:31:06.970812 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 14:31:06.971924 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 14:31:06.971924 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:31:06.971924 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:31:06.971924 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:31:06.971924 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:31:06.971924 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:31:06.971924 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:31:06.971924 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:31:06.971924 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application with Lock( May 25 14:31:06.971924 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:31:06.971924 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._enter() May 25 14:31:06.971924 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:31:06.971924 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:31:06.971924 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:31:06.971924 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.creator() May 25 14:31:06.971924 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:31:06.971924 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application created_value = creator( May 25 14:31:06.972876 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 14:31:06.972876 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 14:31:06.972876 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 14:31:06.972876 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 14:31:06.972876 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 14:31:06.972876 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 14:31:06.972876 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 14:31:06.972876 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:31:06.972876 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 616/1230] 10.222.0.67 () {56 vars in 1111 bytes} [Wed May 25 14:31:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:31:06.977815 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f178e0e-3f87-455a-8a2c-0faf451f45f6 None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:31:07.088570 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f178e0e-3f87-455a-8a2c-0faf451f45f6 None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:31:07.125280 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0368736-f2cc-41c2-b91b-f8b7c2e1c9a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:31:07.125955 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0368736-f2cc-41c2-b91b-f8b7c2e1c9a4 None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:31:07.126241 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0368736-f2cc-41c2-b91b-f8b7c2e1c9a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:31:07.126518 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0368736-f2cc-41c2-b91b-f8b7c2e1c9a4 None admin] PATH_INFO: `/v3/projects` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:31:07.127341 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0368736-f2cc-41c2-b91b-f8b7c2e1c9a4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:31:07.127653 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0368736-f2cc-41c2-b91b-f8b7c2e1c9a4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:31:07.129094 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0368736-f2cc-41c2-b91b-f8b7c2e1c9a4 None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:31:07.142445 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 615/1231] 10.222.0.67 () {56 vars in 1148 bytes} [Wed May 25 14:31:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:31:07.149203 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32f9bf3-6dde-489e-95b5-f0a6aa69acae None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:31:07.221976 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:31:07.259946 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32f9bf3-6dde-489e-95b5-f0a6aa69acae None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:31:07.295384 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05ede80-e8e3-4f6a-bee2-6050c2b8983b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:31:07.296277 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05ede80-e8e3-4f6a-bee2-6050c2b8983b None admin] REQUEST_METHOD: `PUT` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:31:07.296563 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05ede80-e8e3-4f6a-bee2-6050c2b8983b None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:31:07.296841 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05ede80-e8e3-4f6a-bee2-6050c2b8983b None admin] PATH_INFO: `/v3/projects/bfe93ee8d32a441295efc0b885de4bd7/users/ad2b99c2122a4311996364e982e1c801/roles/85be32e3c1ae4269b5456307e0827cc7` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:31:07.312626 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05ede80-e8e3-4f6a-bee2-6050c2b8983b None admin] RBAC: Authorizing `identity:create_grant(project_id=bfe93ee8d32a441295efc0b885de4bd7, user_id=ad2b99c2122a4311996364e982e1c801, role_id=85be32e3c1ae4269b5456307e0827cc7)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:31:07.314127 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05ede80-e8e3-4f6a-bee2-6050c2b8983b None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:31:07.325603 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 617/1232] 10.222.0.67 () {58 vars in 1439 bytes} [Wed May 25 14:31:07 2022] PUT /identity/v3/projects/bfe93ee8d32a441295efc0b885de4bd7/users/ad2b99c2122a4311996364e982e1c801/roles/85be32e3c1ae4269b5456307e0827cc7 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:31:09.662481 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e3563b-e633-42d0-94ee-c9705c1064dd None None] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:31:09.663027 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e3563b-e633-42d0-94ee-c9705c1064dd None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:31:09.663027 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e3563b-e633-42d0-94ee-c9705c1064dd None None] PATH_INFO: `/` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:31:09.664693 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 616/1233] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 14:31:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:31:09.672078 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fb963f-86e7-458d-9b3a-752f69906959 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:31:09.672540 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fb963f-86e7-458d-9b3a-752f69906959 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:31:09.672632 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fb963f-86e7-458d-9b3a-752f69906959 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:31:09.693419 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-92fb963f-86e7-458d-9b3a-752f69906959 None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:31:09.694590 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-92fb963f-86e7-458d-9b3a-752f69906959 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:31:09.777865 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 618/1234] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 14:31:09 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 14:31:09.800759 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e3563b-e633-42d0-94ee-c9705c1064dd None None] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:31:09.832518 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:31:09.925600 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e3563b-e633-42d0-94ee-c9705c1064dd None None] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:31:09.971582 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2569b02b-0996-42e7-a8c2-b7bf4bddaeac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:31:09.972605 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2569b02b-0996-42e7-a8c2-b7bf4bddaeac None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:31:09.972899 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2569b02b-0996-42e7-a8c2-b7bf4bddaeac None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:31:09.973178 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2569b02b-0996-42e7-a8c2-b7bf4bddaeac None admin] PATH_INFO: `/v3/roles/service` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:31:09.986864 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2569b02b-0996-42e7-a8c2-b7bf4bddaeac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:31:09.995670 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application [None req-2569b02b-0996-42e7-a8c2-b7bf4bddaeac None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 25 14:31:09.995670 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:31:09.995670 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:31:09.995670 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:31:09.995670 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:31:09.995670 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:31:09.995670 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:31:09.995670 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:31:09.995670 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:31:09.995670 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:31:09.995670 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:31:09.995670 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:31:09.995670 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:31:09.995670 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:31:09.995670 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:31:09.995670 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:31:09.996792 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:31:09.996792 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:31:09.996792 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:31:09.996792 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:31:09.996792 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:31:09.996792 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:31:09.996792 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:31:09.996792 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:31:09.996792 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:31:09.996792 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:31:09.996792 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:31:09.996792 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application with Lock( May 25 14:31:09.996792 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:31:09.996792 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self._enter() May 25 14:31:09.996792 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:31:09.996792 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:31:09.997680 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:31:09.997680 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.creator() May 25 14:31:09.997680 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:31:09.997680 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application created_value = creator( May 25 14:31:09.997680 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:31:09.997680 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:31:09.997680 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:31:09.997680 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:31:09.997680 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:31:09.997680 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:31:09.997680 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 25 14:31:09.997680 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application May 25 14:31:09.998375 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 617/1235] 10.222.0.67 () {56 vars in 1102 bytes} [Wed May 25 14:31:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:31:10.005027 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fb963f-86e7-458d-9b3a-752f69906959 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:31:10.059028 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:31:10.118922 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fb963f-86e7-458d-9b3a-752f69906959 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:31:10.160847 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05aae036-3a31-44c0-a178-78bd28a50ba2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:31:10.161569 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05aae036-3a31-44c0-a178-78bd28a50ba2 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:31:10.161940 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05aae036-3a31-44c0-a178-78bd28a50ba2 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:31:10.162166 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05aae036-3a31-44c0-a178-78bd28a50ba2 None admin] PATH_INFO: `/v3/roles` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:31:10.162979 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05aae036-3a31-44c0-a178-78bd28a50ba2 None admin] RBAC: Adding query filter params (name=service) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:31:10.163372 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05aae036-3a31-44c0-a178-78bd28a50ba2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:31:10.164879 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05aae036-3a31-44c0-a178-78bd28a50ba2 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:31:10.175390 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 619/1236] 10.222.0.67 () {56 vars in 1103 bytes} [Wed May 25 14:31:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:31:10.181516 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2569b02b-0996-42e7-a8c2-b7bf4bddaeac None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:31:10.296779 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:31:10.319121 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2569b02b-0996-42e7-a8c2-b7bf4bddaeac None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:31:10.360544 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af105391-3ea5-4618-b99d-7a49e542f098 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:31:10.361401 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af105391-3ea5-4618-b99d-7a49e542f098 None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:31:10.361718 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af105391-3ea5-4618-b99d-7a49e542f098 None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:31:10.362004 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af105391-3ea5-4618-b99d-7a49e542f098 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:31:10.376722 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af105391-3ea5-4618-b99d-7a49e542f098 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:31:10.377586 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af105391-3ea5-4618-b99d-7a49e542f098 None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:31:10.397851 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application [None req-af105391-3ea5-4618-b99d-7a49e542f098 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:31:10.397851 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:31:10.397851 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:31:10.397851 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:31:10.397851 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:31:10.397851 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:31:10.397851 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:31:10.397851 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:31:10.397851 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:31:10.397851 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:31:10.397851 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:31:10.397851 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:31:10.397851 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 14:31:10.397851 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 14:31:10.397851 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 14:31:10.399087 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 14:31:10.399087 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:31:10.399087 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:31:10.399087 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:31:10.399087 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:31:10.399087 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:31:10.399087 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:31:10.399087 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:31:10.399087 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application with Lock( May 25 14:31:10.399087 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:31:10.399087 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self._enter() May 25 14:31:10.399087 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:31:10.399087 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:31:10.399087 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:31:10.399087 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.creator() May 25 14:31:10.399087 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:31:10.399087 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application created_value = creator( May 25 14:31:10.400240 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 14:31:10.400240 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 14:31:10.400240 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:31:10.400240 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application May 25 14:31:10.401756 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 618/1237] 10.222.0.67 () {56 vars in 1108 bytes} [Wed May 25 14:31:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:31:10.408033 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05aae036-3a31-44c0-a178-78bd28a50ba2 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:31:10.529448 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05aae036-3a31-44c0-a178-78bd28a50ba2 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:31:10.540497 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:31:10.577431 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68034af0-eb4b-4146-b873-0cbff1e19434 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:31:10.578290 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68034af0-eb4b-4146-b873-0cbff1e19434 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:31:10.578779 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68034af0-eb4b-4146-b873-0cbff1e19434 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:31:10.579182 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68034af0-eb4b-4146-b873-0cbff1e19434 None admin] PATH_INFO: `/v3/domains` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:31:10.580073 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68034af0-eb4b-4146-b873-0cbff1e19434 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:31:10.580436 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68034af0-eb4b-4146-b873-0cbff1e19434 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:31:10.582084 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68034af0-eb4b-4146-b873-0cbff1e19434 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:31:10.599043 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 620/1238] 10.222.0.67 () {56 vars in 1109 bytes} [Wed May 25 14:31:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:31:10.603347 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af105391-3ea5-4618-b99d-7a49e542f098 None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:31:10.731536 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af105391-3ea5-4618-b99d-7a49e542f098 None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:31:10.771144 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2485756-1433-45d0-8a71-f4449a880d31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:31:10.772148 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2485756-1433-45d0-8a71-f4449a880d31 None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:31:10.772464 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2485756-1433-45d0-8a71-f4449a880d31 None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:31:10.772765 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2485756-1433-45d0-8a71-f4449a880d31 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:31:10.776228 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:31:10.784363 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2485756-1433-45d0-8a71-f4449a880d31 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:31:10.786109 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2485756-1433-45d0-8a71-f4449a880d31 None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:31:10.802059 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application [None req-d2485756-1433-45d0-8a71-f4449a880d31 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 25 14:31:10.802059 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:31:10.802059 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:31:10.802059 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:31:10.802059 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:31:10.802059 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:31:10.802059 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:31:10.802059 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:31:10.802059 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:31:10.802059 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:31:10.802059 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:31:10.802059 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:31:10.802059 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 14:31:10.802059 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 14:31:10.802059 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 14:31:10.802059 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 14:31:10.809477 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:31:10.809477 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:31:10.809477 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 14:31:10.809477 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 14:31:10.809477 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 14:31:10.809477 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 14:31:10.809477 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:31:10.809477 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:31:10.809477 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:31:10.809477 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:31:10.809477 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:31:10.809477 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application with Lock( May 25 14:31:10.809477 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:31:10.809477 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self._enter() May 25 14:31:10.809477 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:31:10.809477 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:31:10.809477 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:31:10.809477 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.creator() May 25 14:31:10.810527 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:31:10.810527 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application created_value = creator( May 25 14:31:10.810527 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 14:31:10.810527 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 14:31:10.810527 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 14:31:10.810527 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 14:31:10.810527 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 14:31:10.810527 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 14:31:10.810527 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 25 14:31:10.810527 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application May 25 14:31:10.810527 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 619/1239] 10.222.0.67 () {56 vars in 1108 bytes} [Wed May 25 14:31:10 2022] GET /identity/v3/users/placement => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 14:31:10.811260 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68034af0-eb4b-4146-b873-0cbff1e19434 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:31:10.941290 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68034af0-eb4b-4146-b873-0cbff1e19434 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:31:10.981348 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebec3f5-ec0e-43d2-a11d-5820ceafb23c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:31:10.982021 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebec3f5-ec0e-43d2-a11d-5820ceafb23c None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:31:10.982306 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebec3f5-ec0e-43d2-a11d-5820ceafb23c None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:31:10.982581 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebec3f5-ec0e-43d2-a11d-5820ceafb23c None admin] PATH_INFO: `/v3/users` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:31:10.983469 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebec3f5-ec0e-43d2-a11d-5820ceafb23c None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:31:10.983775 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebec3f5-ec0e-43d2-a11d-5820ceafb23c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:31:10.985210 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebec3f5-ec0e-43d2-a11d-5820ceafb23c None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:31:11.004381 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 621/1240] 10.222.0.67 () {56 vars in 1143 bytes} [Wed May 25 14:31:10 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:31:11.010176 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2485756-1433-45d0-8a71-f4449a880d31 None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:31:11.130745 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2485756-1433-45d0-8a71-f4449a880d31 None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:31:11.174235 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2cef4f-feba-4c6f-a2e2-92bd79aad6c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:31:11.175057 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2cef4f-feba-4c6f-a2e2-92bd79aad6c3 None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:31:11.177422 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2cef4f-feba-4c6f-a2e2-92bd79aad6c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:31:11.177422 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2cef4f-feba-4c6f-a2e2-92bd79aad6c3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:31:11.263354 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:31:11.271293 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2cef4f-feba-4c6f-a2e2-92bd79aad6c3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:31:11.272779 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2cef4f-feba-4c6f-a2e2-92bd79aad6c3 None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:31:11.399047 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 620/1241] 10.222.0.67 () {58 vars in 1282 bytes} [Wed May 25 14:31:11 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 25 14:31:11.404901 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebec3f5-ec0e-43d2-a11d-5820ceafb23c None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:31:11.439370 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:31:11.534975 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebec3f5-ec0e-43d2-a11d-5820ceafb23c None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:31:11.575738 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ccae1b-056f-4c2b-b549-effca614772b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:31:11.576549 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ccae1b-056f-4c2b-b549-effca614772b None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:31:11.577025 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ccae1b-056f-4c2b-b549-effca614772b None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:31:11.577169 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ccae1b-056f-4c2b-b549-effca614772b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:31:11.593024 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ccae1b-056f-4c2b-b549-effca614772b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:31:11.594688 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ccae1b-056f-4c2b-b549-effca614772b None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:31:11.631336 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application [None req-b3ccae1b-056f-4c2b-b549-effca614772b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:31:11.631336 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:31:11.631336 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:31:11.631336 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:31:11.631336 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:31:11.631336 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:31:11.631336 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:31:11.631336 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:31:11.631336 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:31:11.631336 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:31:11.631336 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:31:11.631336 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:31:11.631336 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 14:31:11.631336 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 14:31:11.631336 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 14:31:11.632675 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 14:31:11.632675 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:31:11.632675 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:31:11.632675 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:31:11.632675 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:31:11.632675 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:31:11.632675 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:31:11.632675 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:31:11.632675 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application with Lock( May 25 14:31:11.632675 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:31:11.632675 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._enter() May 25 14:31:11.632675 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:31:11.632675 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:31:11.632675 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:31:11.632675 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.creator() May 25 14:31:11.632675 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:31:11.632675 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application created_value = creator( May 25 14:31:11.633845 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 14:31:11.633845 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 14:31:11.633845 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:31:11.633845 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:31:11.633845 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 622/1242] 10.222.0.67 () {56 vars in 1108 bytes} [Wed May 25 14:31:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:31:11.642320 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2cef4f-feba-4c6f-a2e2-92bd79aad6c3 None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:31:11.763488 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:31:11.771435 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2cef4f-feba-4c6f-a2e2-92bd79aad6c3 None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:31:11.812349 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572b2bbd-654c-493e-85a9-e7bd077e1ae5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:31:11.813032 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572b2bbd-654c-493e-85a9-e7bd077e1ae5 None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:31:11.813325 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572b2bbd-654c-493e-85a9-e7bd077e1ae5 None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:31:11.813606 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572b2bbd-654c-493e-85a9-e7bd077e1ae5 None admin] PATH_INFO: `/v3/domains` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:31:11.814478 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572b2bbd-654c-493e-85a9-e7bd077e1ae5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:31:11.814879 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572b2bbd-654c-493e-85a9-e7bd077e1ae5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:31:11.816652 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572b2bbd-654c-493e-85a9-e7bd077e1ae5 None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:31:11.835041 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 621/1243] 10.222.0.67 () {56 vars in 1109 bytes} [Wed May 25 14:31:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:31:11.836529 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ccae1b-056f-4c2b-b549-effca614772b None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:31:11.945144 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:31:11.976707 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ccae1b-056f-4c2b-b549-effca614772b None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:31:12.030164 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7080c9-d154-4cfd-b7e6-5e95dbf56343 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:31:12.031643 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7080c9-d154-4cfd-b7e6-5e95dbf56343 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:31:12.032011 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7080c9-d154-4cfd-b7e6-5e95dbf56343 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:31:12.032455 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7080c9-d154-4cfd-b7e6-5e95dbf56343 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:31:12.042233 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7080c9-d154-4cfd-b7e6-5e95dbf56343 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:31:12.044306 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7080c9-d154-4cfd-b7e6-5e95dbf56343 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:31:12.061490 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application [None req-ae7080c9-d154-4cfd-b7e6-5e95dbf56343 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 14:31:12.061490 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:31:12.061490 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:31:12.061490 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:31:12.061490 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:31:12.061490 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:31:12.061490 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:31:12.061490 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:31:12.061490 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:31:12.061490 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:31:12.061490 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:31:12.061490 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:31:12.061490 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 14:31:12.061490 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 14:31:12.061490 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 14:31:12.062588 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 14:31:12.062588 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:31:12.062588 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:31:12.062588 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:31:12.062588 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:31:12.062588 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:31:12.062588 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:31:12.062588 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:31:12.062588 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application with Lock( May 25 14:31:12.062588 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:31:12.062588 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._enter() May 25 14:31:12.062588 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:31:12.062588 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:31:12.062588 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:31:12.062588 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.creator() May 25 14:31:12.062588 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:31:12.062588 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application created_value = creator( May 25 14:31:12.067875 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 14:31:12.067875 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 14:31:12.067875 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 14:31:12.067875 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 14:31:12.067875 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 14:31:12.067875 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 14:31:12.067875 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 14:31:12.067875 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:31:12.067875 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 623/1244] 10.222.0.67 () {56 vars in 1111 bytes} [Wed May 25 14:31:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:31:12.069117 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572b2bbd-654c-493e-85a9-e7bd077e1ae5 None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:31:12.201366 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572b2bbd-654c-493e-85a9-e7bd077e1ae5 None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:31:12.249652 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86f99e4-d401-438f-99f8-84967072dd6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:31:12.251410 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86f99e4-d401-438f-99f8-84967072dd6e None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:31:12.252135 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86f99e4-d401-438f-99f8-84967072dd6e None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:31:12.252634 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86f99e4-d401-438f-99f8-84967072dd6e None admin] PATH_INFO: `/v3/projects` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:31:12.254185 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86f99e4-d401-438f-99f8-84967072dd6e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:31:12.254745 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86f99e4-d401-438f-99f8-84967072dd6e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:31:12.257317 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86f99e4-d401-438f-99f8-84967072dd6e None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:31:12.281834 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 622/1245] 10.222.0.67 () {56 vars in 1148 bytes} [Wed May 25 14:31:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:31:12.288176 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7080c9-d154-4cfd-b7e6-5e95dbf56343 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:31:12.433025 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7080c9-d154-4cfd-b7e6-5e95dbf56343 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:31:12.475993 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259b42f3-e68f-46fe-87cb-da113da68d9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:31:12.476591 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259b42f3-e68f-46fe-87cb-da113da68d9c None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:31:12.476882 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259b42f3-e68f-46fe-87cb-da113da68d9c None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:31:12.477209 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259b42f3-e68f-46fe-87cb-da113da68d9c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:31:12.478122 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259b42f3-e68f-46fe-87cb-da113da68d9c None admin] RBAC: Adding query filter params (role.id=85be32e3c1ae4269b5456307e0827cc7, scope.project.id=bfe93ee8d32a441295efc0b885de4bd7, user.id=ad2b99c2122a4311996364e982e1c801) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:31:12.478437 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259b42f3-e68f-46fe-87cb-da113da68d9c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:31:12.479941 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259b42f3-e68f-46fe-87cb-da113da68d9c None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:31:12.487413 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 624/1246] 10.222.0.67 () {56 vars in 1374 bytes} [Wed May 25 14:31:12 2022] GET /identity/v3/role_assignments?user.id=ad2b99c2122a4311996364e982e1c801&scope.project.id=bfe93ee8d32a441295efc0b885de4bd7&role.id=85be32e3c1ae4269b5456307e0827cc7 => generated 608 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:31:15.196241 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8656153-ff9f-4584-a4e1-8f7ac2c52b8e None None] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:31:15.196761 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8656153-ff9f-4584-a4e1-8f7ac2c52b8e None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:31:15.196761 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8656153-ff9f-4584-a4e1-8f7ac2c52b8e None None] PATH_INFO: `/` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:31:15.198095 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 623/1247] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 14:31:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:31:15.205299 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706d5911-1902-4983-920e-b9a182ec2375 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:31:15.205799 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706d5911-1902-4983-920e-b9a182ec2375 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:31:15.205916 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706d5911-1902-4983-920e-b9a182ec2375 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:31:15.210833 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:31:15.229272 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-706d5911-1902-4983-920e-b9a182ec2375 None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:31:15.231383 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-706d5911-1902-4983-920e-b9a182ec2375 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:31:15.310850 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 625/1248] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 14:31:15 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 14:31:15.334823 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8656153-ff9f-4584-a4e1-8f7ac2c52b8e None None] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:31:15.359022 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:31:15.469734 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8656153-ff9f-4584-a4e1-8f7ac2c52b8e None None] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:31:15.520485 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cc960e-fb86-49ed-85a8-6107deb97d7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:31:15.521405 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cc960e-fb86-49ed-85a8-6107deb97d7e None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:31:15.521734 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cc960e-fb86-49ed-85a8-6107deb97d7e None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:31:15.522045 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cc960e-fb86-49ed-85a8-6107deb97d7e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:31:15.535230 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43cc960e-fb86-49ed-85a8-6107deb97d7e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:31:15.543795 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application [None req-43cc960e-fb86-49ed-85a8-6107deb97d7e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 14:31:15.543795 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:31:15.543795 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:31:15.543795 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:31:15.543795 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:31:15.543795 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:31:15.543795 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:31:15.543795 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:31:15.543795 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:31:15.543795 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:31:15.543795 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:31:15.543795 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:31:15.543795 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:31:15.543795 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:31:15.543795 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:31:15.543795 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:31:15.544927 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:31:15.544927 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:31:15.544927 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:31:15.544927 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:31:15.544927 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:31:15.544927 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:31:15.544927 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:31:15.544927 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:31:15.544927 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:31:15.544927 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:31:15.544927 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:31:15.544927 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application with Lock( May 25 14:31:15.544927 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:31:15.544927 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self._enter() May 25 14:31:15.544927 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:31:15.544927 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:31:15.545903 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:31:15.545903 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.creator() May 25 14:31:15.545903 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:31:15.545903 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application created_value = creator( May 25 14:31:15.545903 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:31:15.545903 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:31:15.545903 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:31:15.545903 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:31:15.545903 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:31:15.545903 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:31:15.545903 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 14:31:15.545903 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application May 25 14:31:15.545903 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 624/1249] 10.222.0.67 () {56 vars in 1096 bytes} [Wed May 25 14:31:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:31:15.551076 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706d5911-1902-4983-920e-b9a182ec2375 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:31:15.685674 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706d5911-1902-4983-920e-b9a182ec2375 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:31:15.725015 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:31:15.732695 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865c46b9-2a19-413e-ad79-00f0acfda796 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:31:15.733384 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865c46b9-2a19-413e-ad79-00f0acfda796 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:31:15.733670 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865c46b9-2a19-413e-ad79-00f0acfda796 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:31:15.734083 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865c46b9-2a19-413e-ad79-00f0acfda796 None admin] PATH_INFO: `/v3/roles` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:31:15.736245 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865c46b9-2a19-413e-ad79-00f0acfda796 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:31:15.736599 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865c46b9-2a19-413e-ad79-00f0acfda796 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:31:15.738077 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865c46b9-2a19-413e-ad79-00f0acfda796 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:31:15.748684 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 626/1250] 10.222.0.67 () {56 vars in 1099 bytes} [Wed May 25 14:31:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:31:15.754493 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cc960e-fb86-49ed-85a8-6107deb97d7e None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:31:15.862444 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:31:15.887814 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cc960e-fb86-49ed-85a8-6107deb97d7e None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:31:15.925728 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7b1ae2-9f54-4d01-9ea4-0c5f0a0a285c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:31:15.926598 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7b1ae2-9f54-4d01-9ea4-0c5f0a0a285c None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:31:15.926883 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7b1ae2-9f54-4d01-9ea4-0c5f0a0a285c None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:31:15.927182 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7b1ae2-9f54-4d01-9ea4-0c5f0a0a285c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:31:15.939515 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7b1ae2-9f54-4d01-9ea4-0c5f0a0a285c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:31:15.941023 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7b1ae2-9f54-4d01-9ea4-0c5f0a0a285c None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:31:15.966485 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application [None req-9d7b1ae2-9f54-4d01-9ea4-0c5f0a0a285c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:31:15.966485 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:31:15.966485 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:31:15.966485 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:31:15.966485 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:31:15.966485 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:31:15.966485 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:31:15.966485 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:31:15.966485 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:31:15.966485 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:31:15.966485 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:31:15.966485 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:31:15.966485 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 14:31:15.966485 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 14:31:15.966485 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 14:31:15.967492 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 14:31:15.967492 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:31:15.967492 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:31:15.967492 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:31:15.967492 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:31:15.967492 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:31:15.967492 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:31:15.967492 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:31:15.967492 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application with Lock( May 25 14:31:15.967492 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:31:15.967492 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self._enter() May 25 14:31:15.967492 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:31:15.967492 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:31:15.967492 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:31:15.967492 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.creator() May 25 14:31:15.967492 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:31:15.967492 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application created_value = creator( May 25 14:31:15.968441 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 14:31:15.968441 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 14:31:15.968441 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:31:15.968441 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application May 25 14:31:15.971194 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 625/1251] 10.222.0.67 () {56 vars in 1108 bytes} [Wed May 25 14:31:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:31:15.977526 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865c46b9-2a19-413e-ad79-00f0acfda796 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:31:16.102035 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865c46b9-2a19-413e-ad79-00f0acfda796 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:31:16.143790 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d505ae5-40ea-4aca-a4f5-eec35fd3253b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:31:16.144476 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d505ae5-40ea-4aca-a4f5-eec35fd3253b None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:31:16.144763 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d505ae5-40ea-4aca-a4f5-eec35fd3253b None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:31:16.145043 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d505ae5-40ea-4aca-a4f5-eec35fd3253b None admin] PATH_INFO: `/v3/domains` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:31:16.145786 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d505ae5-40ea-4aca-a4f5-eec35fd3253b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:31:16.146098 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d505ae5-40ea-4aca-a4f5-eec35fd3253b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:31:16.147542 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d505ae5-40ea-4aca-a4f5-eec35fd3253b None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:31:16.164577 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 627/1252] 10.222.0.67 () {56 vars in 1109 bytes} [Wed May 25 14:31:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:31:16.170547 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7b1ae2-9f54-4d01-9ea4-0c5f0a0a285c None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:31:16.280564 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7b1ae2-9f54-4d01-9ea4-0c5f0a0a285c None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:31:16.306731 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:31:16.319750 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6297dc02-1bb0-4a34-a2aa-97ad28dbf3e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:31:16.320568 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6297dc02-1bb0-4a34-a2aa-97ad28dbf3e5 None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:31:16.320854 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6297dc02-1bb0-4a34-a2aa-97ad28dbf3e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:31:16.321130 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6297dc02-1bb0-4a34-a2aa-97ad28dbf3e5 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:31:16.330349 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6297dc02-1bb0-4a34-a2aa-97ad28dbf3e5 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:31:16.331370 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6297dc02-1bb0-4a34-a2aa-97ad28dbf3e5 None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:31:16.346557 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application [None req-6297dc02-1bb0-4a34-a2aa-97ad28dbf3e5 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 25 14:31:16.346557 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:31:16.346557 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:31:16.346557 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:31:16.346557 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:31:16.346557 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:31:16.346557 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:31:16.346557 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:31:16.346557 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:31:16.346557 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:31:16.346557 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:31:16.346557 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:31:16.346557 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 14:31:16.346557 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 14:31:16.346557 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 14:31:16.346557 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 14:31:16.347770 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:31:16.347770 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:31:16.347770 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 14:31:16.347770 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 14:31:16.347770 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 14:31:16.347770 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 14:31:16.347770 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:31:16.347770 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:31:16.347770 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:31:16.347770 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:31:16.347770 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:31:16.347770 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application with Lock( May 25 14:31:16.347770 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:31:16.347770 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self._enter() May 25 14:31:16.347770 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:31:16.347770 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:31:16.347770 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:31:16.347770 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.creator() May 25 14:31:16.348974 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:31:16.348974 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application created_value = creator( May 25 14:31:16.348974 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 14:31:16.348974 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 14:31:16.348974 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 14:31:16.348974 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 14:31:16.348974 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 14:31:16.348974 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 14:31:16.348974 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 25 14:31:16.348974 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application May 25 14:31:16.348974 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 626/1253] 10.222.0.67 () {56 vars in 1108 bytes} [Wed May 25 14:31:16 2022] GET /identity/v3/users/placement => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:31:16.356166 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d505ae5-40ea-4aca-a4f5-eec35fd3253b None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:31:16.430262 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:31:16.482233 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d505ae5-40ea-4aca-a4f5-eec35fd3253b None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:31:16.518654 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3908d53-724d-4953-8915-92056b62c994 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:31:16.519341 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3908d53-724d-4953-8915-92056b62c994 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:31:16.519627 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3908d53-724d-4953-8915-92056b62c994 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:31:16.519903 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3908d53-724d-4953-8915-92056b62c994 None admin] PATH_INFO: `/v3/users` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:31:16.520735 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3908d53-724d-4953-8915-92056b62c994 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:31:16.521046 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3908d53-724d-4953-8915-92056b62c994 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:31:16.522464 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3908d53-724d-4953-8915-92056b62c994 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:31:16.539132 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 628/1254] 10.222.0.67 () {56 vars in 1143 bytes} [Wed May 25 14:31:16 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:31:16.544768 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6297dc02-1bb0-4a34-a2aa-97ad28dbf3e5 None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:31:16.665251 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6297dc02-1bb0-4a34-a2aa-97ad28dbf3e5 None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:31:16.700206 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672d7f8c-cf1f-415b-a4ea-866dad1b8291 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:31:16.700856 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672d7f8c-cf1f-415b-a4ea-866dad1b8291 None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:31:16.701142 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672d7f8c-cf1f-415b-a4ea-866dad1b8291 None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:31:16.701422 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672d7f8c-cf1f-415b-a4ea-866dad1b8291 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:31:16.757178 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:31:16.770788 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672d7f8c-cf1f-415b-a4ea-866dad1b8291 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:31:16.772276 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672d7f8c-cf1f-415b-a4ea-866dad1b8291 None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:31:16.873462 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 627/1255] 10.222.0.67 () {58 vars in 1282 bytes} [Wed May 25 14:31:16 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 25 14:31:16.879373 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3908d53-724d-4953-8915-92056b62c994 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:31:16.979711 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3908d53-724d-4953-8915-92056b62c994 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:31:16.993309 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:31:17.016596 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13b348e-63ff-41cb-b36a-97a8097537e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:31:17.017382 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13b348e-63ff-41cb-b36a-97a8097537e3 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:31:17.017667 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13b348e-63ff-41cb-b36a-97a8097537e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:31:17.017945 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13b348e-63ff-41cb-b36a-97a8097537e3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:31:17.027846 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13b348e-63ff-41cb-b36a-97a8097537e3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:31:17.029287 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13b348e-63ff-41cb-b36a-97a8097537e3 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:31:17.046424 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application [None req-f13b348e-63ff-41cb-b36a-97a8097537e3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:31:17.046424 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:31:17.046424 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:31:17.046424 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:31:17.046424 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:31:17.046424 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:31:17.046424 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:31:17.046424 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:31:17.046424 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:31:17.046424 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:31:17.046424 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:31:17.046424 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:31:17.046424 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 14:31:17.046424 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 14:31:17.046424 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 14:31:17.047542 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 14:31:17.047542 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:31:17.047542 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:31:17.047542 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:31:17.047542 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:31:17.047542 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:31:17.047542 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:31:17.047542 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:31:17.047542 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application with Lock( May 25 14:31:17.047542 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:31:17.047542 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._enter() May 25 14:31:17.047542 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:31:17.047542 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:31:17.047542 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:31:17.047542 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.creator() May 25 14:31:17.047542 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:31:17.047542 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application created_value = creator( May 25 14:31:17.048492 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 14:31:17.048492 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 14:31:17.048492 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:31:17.048492 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:31:17.048492 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 629/1256] 10.222.0.67 () {56 vars in 1108 bytes} [Wed May 25 14:31:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:31:17.053199 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672d7f8c-cf1f-415b-a4ea-866dad1b8291 None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:31:17.140275 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:31:17.152780 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672d7f8c-cf1f-415b-a4ea-866dad1b8291 None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:31:17.186195 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a58c23d-8b93-4105-85be-993e6cd91059 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:31:17.186853 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a58c23d-8b93-4105-85be-993e6cd91059 None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:31:17.187172 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a58c23d-8b93-4105-85be-993e6cd91059 None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:31:17.187452 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a58c23d-8b93-4105-85be-993e6cd91059 None admin] PATH_INFO: `/v3/domains` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:31:17.188174 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a58c23d-8b93-4105-85be-993e6cd91059 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:31:17.188481 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a58c23d-8b93-4105-85be-993e6cd91059 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:31:17.189861 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a58c23d-8b93-4105-85be-993e6cd91059 None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:31:17.201503 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 628/1257] 10.222.0.67 () {56 vars in 1109 bytes} [Wed May 25 14:31:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:31:17.207056 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13b348e-63ff-41cb-b36a-97a8097537e3 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:31:17.305011 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13b348e-63ff-41cb-b36a-97a8097537e3 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:31:17.339475 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03ca9bc-a19c-4134-a06c-62ebcd8d05b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:31:17.340249 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03ca9bc-a19c-4134-a06c-62ebcd8d05b3 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:31:17.340532 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03ca9bc-a19c-4134-a06c-62ebcd8d05b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:31:17.340809 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03ca9bc-a19c-4134-a06c-62ebcd8d05b3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:31:17.347285 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03ca9bc-a19c-4134-a06c-62ebcd8d05b3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:31:17.348719 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03ca9bc-a19c-4134-a06c-62ebcd8d05b3 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:31:17.363206 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application [None req-c03ca9bc-a19c-4134-a06c-62ebcd8d05b3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 14:31:17.363206 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:31:17.363206 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:31:17.363206 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:31:17.363206 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:31:17.363206 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:31:17.363206 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:31:17.363206 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:31:17.363206 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:31:17.363206 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:31:17.363206 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:31:17.363206 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:31:17.363206 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 14:31:17.363206 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 14:31:17.363206 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 14:31:17.364738 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 14:31:17.364738 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:31:17.364738 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:31:17.364738 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:31:17.364738 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:31:17.364738 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:31:17.364738 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:31:17.364738 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:31:17.364738 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application with Lock( May 25 14:31:17.364738 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:31:17.364738 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._enter() May 25 14:31:17.364738 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:31:17.364738 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:31:17.364738 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:31:17.364738 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.creator() May 25 14:31:17.364738 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:31:17.364738 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application created_value = creator( May 25 14:31:17.367503 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 14:31:17.367503 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 14:31:17.367503 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 14:31:17.367503 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 14:31:17.367503 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 14:31:17.367503 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 14:31:17.367503 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 14:31:17.367503 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:31:17.367503 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 630/1258] 10.222.0.67 () {56 vars in 1111 bytes} [Wed May 25 14:31:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:31:17.370191 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a58c23d-8b93-4105-85be-993e6cd91059 None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:31:17.467853 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a58c23d-8b93-4105-85be-993e6cd91059 None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:31:17.500671 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15867b29-957b-4ac9-99ee-fba93d32c6d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:31:17.501312 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15867b29-957b-4ac9-99ee-fba93d32c6d2 None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:31:17.501591 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15867b29-957b-4ac9-99ee-fba93d32c6d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:31:17.501862 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15867b29-957b-4ac9-99ee-fba93d32c6d2 None admin] PATH_INFO: `/v3/projects` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:31:17.502636 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15867b29-957b-4ac9-99ee-fba93d32c6d2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:31:17.502941 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15867b29-957b-4ac9-99ee-fba93d32c6d2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:31:17.504384 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15867b29-957b-4ac9-99ee-fba93d32c6d2 None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:31:17.515931 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 629/1259] 10.222.0.67 () {56 vars in 1148 bytes} [Wed May 25 14:31:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:31:17.521985 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03ca9bc-a19c-4134-a06c-62ebcd8d05b3 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:31:17.547403 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:31:17.629548 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03ca9bc-a19c-4134-a06c-62ebcd8d05b3 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:31:17.661685 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6e89f8-90b5-4d53-b10a-fce0bad05064 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:31:17.662334 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6e89f8-90b5-4d53-b10a-fce0bad05064 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:31:17.662613 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6e89f8-90b5-4d53-b10a-fce0bad05064 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:31:17.662886 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6e89f8-90b5-4d53-b10a-fce0bad05064 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:31:17.663745 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6e89f8-90b5-4d53-b10a-fce0bad05064 None admin] RBAC: Adding query filter params (role.id=399893e19eac4ab5a8e596f7c07be13c, scope.project.id=bfe93ee8d32a441295efc0b885de4bd7, user.id=ad2b99c2122a4311996364e982e1c801) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:31:17.664052 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6e89f8-90b5-4d53-b10a-fce0bad05064 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:31:17.665473 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6e89f8-90b5-4d53-b10a-fce0bad05064 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:31:17.671785 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 631/1260] 10.222.0.67 () {56 vars in 1374 bytes} [Wed May 25 14:31:17 2022] GET /identity/v3/role_assignments?user.id=ad2b99c2122a4311996364e982e1c801&scope.project.id=bfe93ee8d32a441295efc0b885de4bd7&role.id=399893e19eac4ab5a8e596f7c07be13c => generated 259 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:31:19.849416 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cd42d0-4743-4289-b492-9e99b57e4ed9 None None] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:31:19.849831 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cd42d0-4743-4289-b492-9e99b57e4ed9 None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:31:19.849980 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cd42d0-4743-4289-b492-9e99b57e4ed9 None None] PATH_INFO: `/` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:31:19.851423 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 630/1261] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 14:31:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:31:19.856766 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73240f62-ae57-4067-9449-607c33633266 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:31:19.857212 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73240f62-ae57-4067-9449-607c33633266 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:31:19.857344 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73240f62-ae57-4067-9449-607c33633266 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:31:19.873978 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-73240f62-ae57-4067-9449-607c33633266 None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:31:19.875454 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-73240f62-ae57-4067-9449-607c33633266 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:31:19.939950 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 632/1262] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 14:31:19 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 14:31:19.962556 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cd42d0-4743-4289-b492-9e99b57e4ed9 None None] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:31:19.973956 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:31:20.063903 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cd42d0-4743-4289-b492-9e99b57e4ed9 None None] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:31:20.096759 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a86775-2dda-4226-8a96-05cb16f9f9c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:31:20.097486 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a86775-2dda-4226-8a96-05cb16f9f9c1 None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:31:20.097770 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a86775-2dda-4226-8a96-05cb16f9f9c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:31:20.098046 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a86775-2dda-4226-8a96-05cb16f9f9c1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:31:20.107915 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a86775-2dda-4226-8a96-05cb16f9f9c1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:31:20.115586 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application [None req-25a86775-2dda-4226-8a96-05cb16f9f9c1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 14:31:20.115586 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:31:20.115586 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:31:20.115586 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:31:20.115586 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:31:20.115586 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:31:20.115586 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:31:20.115586 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:31:20.115586 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:31:20.115586 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:31:20.115586 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:31:20.115586 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:31:20.115586 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:31:20.115586 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:31:20.115586 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:31:20.115586 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:31:20.116683 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:31:20.116683 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:31:20.116683 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:31:20.116683 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:31:20.116683 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:31:20.116683 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:31:20.116683 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:31:20.116683 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:31:20.116683 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:31:20.116683 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:31:20.116683 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:31:20.116683 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application with Lock( May 25 14:31:20.116683 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:31:20.116683 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self._enter() May 25 14:31:20.116683 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:31:20.116683 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:31:20.117890 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:31:20.117890 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.creator() May 25 14:31:20.117890 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:31:20.117890 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application created_value = creator( May 25 14:31:20.117890 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:31:20.117890 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:31:20.117890 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:31:20.117890 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:31:20.117890 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:31:20.117890 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:31:20.117890 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 14:31:20.117890 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application May 25 14:31:20.117890 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 631/1263] 10.222.0.67 () {56 vars in 1096 bytes} [Wed May 25 14:31:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:31:20.123534 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73240f62-ae57-4067-9449-607c33633266 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:31:20.142117 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:31:20.222353 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73240f62-ae57-4067-9449-607c33633266 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:31:20.258955 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025a2671-25a7-4cf6-9afd-6ea86672852e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:31:20.259648 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025a2671-25a7-4cf6-9afd-6ea86672852e None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:31:20.259934 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025a2671-25a7-4cf6-9afd-6ea86672852e None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:31:20.260212 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025a2671-25a7-4cf6-9afd-6ea86672852e None admin] PATH_INFO: `/v3/roles` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:31:20.260953 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025a2671-25a7-4cf6-9afd-6ea86672852e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:31:20.261329 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025a2671-25a7-4cf6-9afd-6ea86672852e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:31:20.262704 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025a2671-25a7-4cf6-9afd-6ea86672852e None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:31:20.270591 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 633/1264] 10.222.0.67 () {56 vars in 1099 bytes} [Wed May 25 14:31:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:31:20.276388 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a86775-2dda-4226-8a96-05cb16f9f9c1 None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:31:20.342945 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:31:20.376729 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a86775-2dda-4226-8a96-05cb16f9f9c1 None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:31:20.409755 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0f3977-49c2-4f7e-9f65-3b8ea5457d75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:31:20.410542 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0f3977-49c2-4f7e-9f65-3b8ea5457d75 None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:31:20.410828 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0f3977-49c2-4f7e-9f65-3b8ea5457d75 None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:31:20.411136 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0f3977-49c2-4f7e-9f65-3b8ea5457d75 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:31:20.422007 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0f3977-49c2-4f7e-9f65-3b8ea5457d75 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:31:20.423480 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0f3977-49c2-4f7e-9f65-3b8ea5457d75 None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:31:20.440681 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application [None req-8b0f3977-49c2-4f7e-9f65-3b8ea5457d75 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:31:20.440681 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:31:20.440681 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:31:20.440681 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:31:20.440681 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:31:20.440681 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:31:20.440681 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:31:20.440681 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:31:20.440681 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:31:20.440681 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:31:20.440681 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:31:20.440681 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:31:20.440681 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 14:31:20.440681 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 14:31:20.440681 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 14:31:20.441769 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 14:31:20.441769 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:31:20.441769 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:31:20.441769 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:31:20.441769 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:31:20.441769 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:31:20.441769 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:31:20.441769 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:31:20.441769 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application with Lock( May 25 14:31:20.441769 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:31:20.441769 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self._enter() May 25 14:31:20.441769 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:31:20.441769 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:31:20.441769 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:31:20.441769 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.creator() May 25 14:31:20.441769 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:31:20.441769 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application created_value = creator( May 25 14:31:20.443218 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 14:31:20.443218 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 14:31:20.443218 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:31:20.443218 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application May 25 14:31:20.443218 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 632/1265] 10.222.0.67 () {56 vars in 1108 bytes} [Wed May 25 14:31:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:31:20.447555 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025a2671-25a7-4cf6-9afd-6ea86672852e None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:31:20.527065 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:31:20.546190 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025a2671-25a7-4cf6-9afd-6ea86672852e None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:31:20.579485 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b30c4dc-f611-4be3-a5c6-664e0863b54b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:31:20.580388 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b30c4dc-f611-4be3-a5c6-664e0863b54b None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:31:20.580651 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b30c4dc-f611-4be3-a5c6-664e0863b54b None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:31:20.580933 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b30c4dc-f611-4be3-a5c6-664e0863b54b None admin] PATH_INFO: `/v3/domains` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:31:20.581655 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b30c4dc-f611-4be3-a5c6-664e0863b54b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:31:20.581960 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b30c4dc-f611-4be3-a5c6-664e0863b54b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:31:20.583355 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b30c4dc-f611-4be3-a5c6-664e0863b54b None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:31:20.595185 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 634/1266] 10.222.0.67 () {56 vars in 1109 bytes} [Wed May 25 14:31:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:31:20.600919 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0f3977-49c2-4f7e-9f65-3b8ea5457d75 None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:31:20.706865 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0f3977-49c2-4f7e-9f65-3b8ea5457d75 None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:31:20.726119 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:31:20.740732 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83790b64-250a-45e3-885e-b03c53217949 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:31:20.741522 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83790b64-250a-45e3-885e-b03c53217949 None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:31:20.741808 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83790b64-250a-45e3-885e-b03c53217949 None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:31:20.742090 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83790b64-250a-45e3-885e-b03c53217949 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:31:20.750658 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83790b64-250a-45e3-885e-b03c53217949 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:31:20.752175 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83790b64-250a-45e3-885e-b03c53217949 None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:31:20.766217 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application [None req-83790b64-250a-45e3-885e-b03c53217949 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 25 14:31:20.766217 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:31:20.766217 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:31:20.766217 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:31:20.766217 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:31:20.766217 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:31:20.766217 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:31:20.766217 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:31:20.766217 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:31:20.766217 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:31:20.766217 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:31:20.766217 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:31:20.766217 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 14:31:20.766217 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 14:31:20.766217 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 14:31:20.766217 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 14:31:20.767389 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:31:20.767389 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:31:20.767389 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 14:31:20.767389 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 14:31:20.767389 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 14:31:20.767389 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 14:31:20.767389 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:31:20.767389 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:31:20.767389 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:31:20.767389 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:31:20.767389 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:31:20.767389 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application with Lock( May 25 14:31:20.767389 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:31:20.767389 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self._enter() May 25 14:31:20.767389 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:31:20.767389 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:31:20.767389 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:31:20.767389 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.creator() May 25 14:31:20.768612 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:31:20.768612 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application created_value = creator( May 25 14:31:20.768612 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 14:31:20.768612 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 14:31:20.768612 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 14:31:20.768612 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 14:31:20.768612 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 14:31:20.768612 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 14:31:20.768612 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 25 14:31:20.768612 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application May 25 14:31:20.768612 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 633/1267] 10.222.0.67 () {56 vars in 1108 bytes} [Wed May 25 14:31:20 2022] GET /identity/v3/users/placement => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:31:20.773123 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b30c4dc-f611-4be3-a5c6-664e0863b54b None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:31:20.875668 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b30c4dc-f611-4be3-a5c6-664e0863b54b None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:31:20.908247 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85325022-3e03-49ce-9ff9-d3dde0b11c14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:31:20.908902 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85325022-3e03-49ce-9ff9-d3dde0b11c14 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:31:20.909184 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85325022-3e03-49ce-9ff9-d3dde0b11c14 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:31:20.909454 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85325022-3e03-49ce-9ff9-d3dde0b11c14 None admin] PATH_INFO: `/v3/users` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:31:20.910278 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85325022-3e03-49ce-9ff9-d3dde0b11c14 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:31:20.910584 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85325022-3e03-49ce-9ff9-d3dde0b11c14 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:31:20.912027 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85325022-3e03-49ce-9ff9-d3dde0b11c14 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:31:20.920933 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:31:20.930146 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 635/1268] 10.222.0.67 () {56 vars in 1143 bytes} [Wed May 25 14:31:20 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:31:20.935833 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83790b64-250a-45e3-885e-b03c53217949 None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:31:21.032194 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83790b64-250a-45e3-885e-b03c53217949 None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:31:21.064430 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1dcfb9-9472-4df1-9929-e0b28db2e47b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:31:21.065199 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1dcfb9-9472-4df1-9929-e0b28db2e47b None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:31:21.065479 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1dcfb9-9472-4df1-9929-e0b28db2e47b None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:31:21.065753 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1dcfb9-9472-4df1-9929-e0b28db2e47b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:31:21.075874 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1dcfb9-9472-4df1-9929-e0b28db2e47b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:31:21.077299 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1dcfb9-9472-4df1-9929-e0b28db2e47b None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:31:21.094249 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application [None req-4d1dcfb9-9472-4df1-9929-e0b28db2e47b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:31:21.094249 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:31:21.094249 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:31:21.094249 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:31:21.094249 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:31:21.094249 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:31:21.094249 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:31:21.094249 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:31:21.094249 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:31:21.094249 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:31:21.094249 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:31:21.094249 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:31:21.094249 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 14:31:21.094249 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 14:31:21.094249 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 14:31:21.095344 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 14:31:21.095344 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:31:21.095344 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:31:21.095344 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:31:21.095344 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:31:21.095344 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:31:21.095344 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:31:21.095344 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:31:21.095344 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application with Lock( May 25 14:31:21.095344 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:31:21.095344 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self._enter() May 25 14:31:21.095344 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:31:21.095344 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:31:21.095344 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:31:21.095344 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.creator() May 25 14:31:21.095344 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:31:21.095344 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application created_value = creator( May 25 14:31:21.096501 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 14:31:21.096501 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 14:31:21.096501 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:31:21.096501 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application May 25 14:31:21.096501 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 634/1269] 10.222.0.67 () {56 vars in 1108 bytes} [Wed May 25 14:31:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:31:21.100930 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85325022-3e03-49ce-9ff9-d3dde0b11c14 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:31:21.197830 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85325022-3e03-49ce-9ff9-d3dde0b11c14 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:31:21.231098 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5970e1c5-c411-4333-8456-30a827a5661e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:31:21.231758 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5970e1c5-c411-4333-8456-30a827a5661e None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:31:21.232045 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5970e1c5-c411-4333-8456-30a827a5661e None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:31:21.232323 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5970e1c5-c411-4333-8456-30a827a5661e None admin] PATH_INFO: `/v3/domains` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:31:21.233049 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5970e1c5-c411-4333-8456-30a827a5661e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:31:21.233357 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5970e1c5-c411-4333-8456-30a827a5661e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:31:21.234737 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5970e1c5-c411-4333-8456-30a827a5661e None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:31:21.245983 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 636/1270] 10.222.0.67 () {56 vars in 1109 bytes} [Wed May 25 14:31:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:31:21.251913 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1dcfb9-9472-4df1-9929-e0b28db2e47b None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:31:21.284050 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:31:21.351970 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1dcfb9-9472-4df1-9929-e0b28db2e47b None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:31:21.384245 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1268bb3b-8bcc-4f04-9062-1e01ce07bc3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:31:21.385029 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1268bb3b-8bcc-4f04-9062-1e01ce07bc3b None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:31:21.385316 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1268bb3b-8bcc-4f04-9062-1e01ce07bc3b None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:31:21.385598 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1268bb3b-8bcc-4f04-9062-1e01ce07bc3b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:31:21.392727 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1268bb3b-8bcc-4f04-9062-1e01ce07bc3b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:31:21.394165 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1268bb3b-8bcc-4f04-9062-1e01ce07bc3b None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:31:21.408906 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application [None req-1268bb3b-8bcc-4f04-9062-1e01ce07bc3b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 14:31:21.408906 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:31:21.408906 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:31:21.408906 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:31:21.408906 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:31:21.408906 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:31:21.408906 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:31:21.408906 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:31:21.408906 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:31:21.408906 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:31:21.408906 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:31:21.408906 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:31:21.408906 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 14:31:21.408906 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 14:31:21.408906 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 14:31:21.409967 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 14:31:21.409967 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:31:21.409967 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:31:21.409967 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:31:21.409967 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:31:21.409967 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:31:21.409967 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:31:21.409967 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:31:21.409967 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application with Lock( May 25 14:31:21.409967 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:31:21.409967 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self._enter() May 25 14:31:21.409967 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:31:21.409967 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:31:21.409967 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:31:21.409967 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.creator() May 25 14:31:21.409967 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:31:21.409967 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application created_value = creator( May 25 14:31:21.410943 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 14:31:21.410943 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 14:31:21.410943 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 14:31:21.410943 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 14:31:21.410943 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 14:31:21.410943 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 14:31:21.410943 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 14:31:21.410943 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application May 25 14:31:21.410943 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 635/1271] 10.222.0.67 () {56 vars in 1111 bytes} [Wed May 25 14:31:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:31:21.415871 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5970e1c5-c411-4333-8456-30a827a5661e None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:31:21.477965 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:31:21.522675 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5970e1c5-c411-4333-8456-30a827a5661e None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:31:21.554774 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76b9f61-ea37-4bab-b972-243fddf1c4d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:31:21.555396 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76b9f61-ea37-4bab-b972-243fddf1c4d8 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:31:21.555678 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76b9f61-ea37-4bab-b972-243fddf1c4d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:31:21.555950 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76b9f61-ea37-4bab-b972-243fddf1c4d8 None admin] PATH_INFO: `/v3/projects` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:31:21.556726 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76b9f61-ea37-4bab-b972-243fddf1c4d8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:31:21.557028 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76b9f61-ea37-4bab-b972-243fddf1c4d8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:31:21.559110 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76b9f61-ea37-4bab-b972-243fddf1c4d8 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:31:21.571716 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 637/1272] 10.222.0.67 () {56 vars in 1148 bytes} [Wed May 25 14:31:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:31:21.578961 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1268bb3b-8bcc-4f04-9062-1e01ce07bc3b None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:31:21.673634 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:31:21.682698 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1268bb3b-8bcc-4f04-9062-1e01ce07bc3b None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:31:21.717302 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744dd8e1-8ed9-4b1c-92ad-c8b4af3f3590 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:31:21.718171 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744dd8e1-8ed9-4b1c-92ad-c8b4af3f3590 None admin] REQUEST_METHOD: `PUT` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:31:21.718459 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744dd8e1-8ed9-4b1c-92ad-c8b4af3f3590 None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:31:21.718741 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744dd8e1-8ed9-4b1c-92ad-c8b4af3f3590 None admin] PATH_INFO: `/v3/projects/bfe93ee8d32a441295efc0b885de4bd7/users/ad2b99c2122a4311996364e982e1c801/roles/399893e19eac4ab5a8e596f7c07be13c` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:31:21.720702 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744dd8e1-8ed9-4b1c-92ad-c8b4af3f3590 None admin] RBAC: Authorizing `identity:create_grant(project_id=bfe93ee8d32a441295efc0b885de4bd7, user_id=ad2b99c2122a4311996364e982e1c801, role_id=399893e19eac4ab5a8e596f7c07be13c)` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:31:21.722140 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744dd8e1-8ed9-4b1c-92ad-c8b4af3f3590 None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:31:21.734817 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 636/1273] 10.222.0.67 () {58 vars in 1439 bytes} [Wed May 25 14:31:21 2022] PUT /identity/v3/projects/bfe93ee8d32a441295efc0b885de4bd7/users/ad2b99c2122a4311996364e982e1c801/roles/399893e19eac4ab5a8e596f7c07be13c => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 14:31:23.923613 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea5c04a-963f-4919-8ce5-a979c40cc2c3 None None] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:31:23.924161 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea5c04a-963f-4919-8ce5-a979c40cc2c3 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:31:23.924161 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea5c04a-963f-4919-8ce5-a979c40cc2c3 None None] PATH_INFO: `/` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:31:23.925535 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 638/1274] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 14:31:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:31:23.930750 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26646dcd-9219-40f0-8a73-a3258057c204 None None] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:31:23.931221 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26646dcd-9219-40f0-8a73-a3258057c204 None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:31:23.931344 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26646dcd-9219-40f0-8a73-a3258057c204 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:31:23.947784 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.auth.core [None req-26646dcd-9219-40f0-8a73-a3258057c204 None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:31:23.948977 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-26646dcd-9219-40f0-8a73-a3258057c204 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:31:24.015196 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 637/1275] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 14:31:23 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 25 14:31:24.038869 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea5c04a-963f-4919-8ce5-a979c40cc2c3 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:31:24.140032 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea5c04a-963f-4919-8ce5-a979c40cc2c3 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:31:24.157248 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:31:24.174256 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea60b3e0-883c-47f0-9eda-d925647061c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:31:24.175059 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea60b3e0-883c-47f0-9eda-d925647061c9 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:31:24.175348 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea60b3e0-883c-47f0-9eda-d925647061c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:31:24.175624 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea60b3e0-883c-47f0-9eda-d925647061c9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:31:24.185529 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea60b3e0-883c-47f0-9eda-d925647061c9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:31:24.193242 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application [None req-ea60b3e0-883c-47f0-9eda-d925647061c9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 14:31:24.193242 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:31:24.193242 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:31:24.193242 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:31:24.193242 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:31:24.193242 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:31:24.193242 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:31:24.193242 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:31:24.193242 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:31:24.193242 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:31:24.193242 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:31:24.193242 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:31:24.193242 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:31:24.193242 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:31:24.193242 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:31:24.193242 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:31:24.194357 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:31:24.194357 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:31:24.194357 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:31:24.194357 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:31:24.194357 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:31:24.194357 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:31:24.194357 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:31:24.194357 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:31:24.194357 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:31:24.194357 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:31:24.194357 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:31:24.194357 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application with Lock( May 25 14:31:24.194357 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:31:24.194357 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._enter() May 25 14:31:24.194357 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:31:24.194357 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:31:24.195458 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:31:24.195458 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.creator() May 25 14:31:24.195458 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:31:24.195458 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application created_value = creator( May 25 14:31:24.195458 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:31:24.195458 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:31:24.195458 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:31:24.195458 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:31:24.195458 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:31:24.195458 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:31:24.195458 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 14:31:24.195458 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:31:24.195458 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 639/1276] 10.222.0.67 () {56 vars in 1096 bytes} [Wed May 25 14:31:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:31:24.201376 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26646dcd-9219-40f0-8a73-a3258057c204 None None] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:31:24.285042 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:31:24.303577 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26646dcd-9219-40f0-8a73-a3258057c204 None None] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:31:24.338154 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56840f4d-1243-488e-a5bc-4f4b44c4baba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:31:24.338813 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56840f4d-1243-488e-a5bc-4f4b44c4baba None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:31:24.339140 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56840f4d-1243-488e-a5bc-4f4b44c4baba None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:31:24.339983 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56840f4d-1243-488e-a5bc-4f4b44c4baba None admin] PATH_INFO: `/v3/roles` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:31:24.340726 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56840f4d-1243-488e-a5bc-4f4b44c4baba None admin] RBAC: Adding query filter params (name=admin) {{(pid=80474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:31:24.341023 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56840f4d-1243-488e-a5bc-4f4b44c4baba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:31:24.342383 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56840f4d-1243-488e-a5bc-4f4b44c4baba None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:31:24.350126 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 638/1277] 10.222.0.67 () {56 vars in 1099 bytes} [Wed May 25 14:31:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:31:24.356393 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea60b3e0-883c-47f0-9eda-d925647061c9 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:31:24.457244 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea60b3e0-883c-47f0-9eda-d925647061c9 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:31:24.489986 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a97476-54bc-4ee1-9091-d86956a1f72a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:31:24.490754 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a97476-54bc-4ee1-9091-d86956a1f72a None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:31:24.491062 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a97476-54bc-4ee1-9091-d86956a1f72a None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:31:24.491339 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a97476-54bc-4ee1-9091-d86956a1f72a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:31:24.502672 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a97476-54bc-4ee1-9091-d86956a1f72a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:31:24.504150 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a97476-54bc-4ee1-9091-d86956a1f72a None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:31:24.521594 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application [None req-57a97476-54bc-4ee1-9091-d86956a1f72a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:31:24.521594 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:31:24.521594 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:31:24.521594 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:31:24.521594 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:31:24.521594 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:31:24.521594 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:31:24.521594 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:31:24.521594 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:31:24.521594 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:31:24.521594 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:31:24.521594 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:31:24.521594 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 14:31:24.521594 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 14:31:24.521594 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 14:31:24.522660 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 14:31:24.522660 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:31:24.522660 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:31:24.522660 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:31:24.522660 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:31:24.522660 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:31:24.522660 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:31:24.522660 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:31:24.522660 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application with Lock( May 25 14:31:24.522660 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:31:24.522660 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._enter() May 25 14:31:24.522660 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:31:24.522660 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:31:24.522660 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:31:24.522660 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.creator() May 25 14:31:24.522660 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:31:24.522660 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application created_value = creator( May 25 14:31:24.523851 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 14:31:24.523851 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 14:31:24.523851 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:31:24.523851 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:31:24.523851 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 640/1278] 10.222.0.67 () {56 vars in 1108 bytes} [Wed May 25 14:31:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:31:24.529044 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56840f4d-1243-488e-a5bc-4f4b44c4baba None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:31:24.631560 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56840f4d-1243-488e-a5bc-4f4b44c4baba None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:31:24.665196 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ab5f48-ead8-4727-b3a4-2e937c58fed1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:31:24.665857 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ab5f48-ead8-4727-b3a4-2e937c58fed1 None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:31:24.666144 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ab5f48-ead8-4727-b3a4-2e937c58fed1 None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:31:24.666423 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ab5f48-ead8-4727-b3a4-2e937c58fed1 None admin] PATH_INFO: `/v3/domains` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:31:24.667180 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ab5f48-ead8-4727-b3a4-2e937c58fed1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:31:24.667567 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ab5f48-ead8-4727-b3a4-2e937c58fed1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:31:24.668906 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ab5f48-ead8-4727-b3a4-2e937c58fed1 None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:31:24.680389 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 639/1279] 10.222.0.67 () {56 vars in 1109 bytes} [Wed May 25 14:31:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:31:24.686584 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a97476-54bc-4ee1-9091-d86956a1f72a None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:31:24.717332 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:31:24.785735 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a97476-54bc-4ee1-9091-d86956a1f72a None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:31:24.818859 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5e2827-3bf3-4f8d-bafb-5d7b0f6f8505 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:31:24.819672 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5e2827-3bf3-4f8d-bafb-5d7b0f6f8505 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:31:24.819957 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5e2827-3bf3-4f8d-bafb-5d7b0f6f8505 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:31:24.820235 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5e2827-3bf3-4f8d-bafb-5d7b0f6f8505 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:31:24.829962 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5e2827-3bf3-4f8d-bafb-5d7b0f6f8505 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:31:24.831786 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5e2827-3bf3-4f8d-bafb-5d7b0f6f8505 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:31:24.847489 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application [None req-2e5e2827-3bf3-4f8d-bafb-5d7b0f6f8505 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 25 14:31:24.847489 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:31:24.847489 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:31:24.847489 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:31:24.847489 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:31:24.847489 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:31:24.847489 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:31:24.847489 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:31:24.847489 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:31:24.847489 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:31:24.847489 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:31:24.847489 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:31:24.847489 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 14:31:24.847489 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 14:31:24.847489 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 14:31:24.847489 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 14:31:24.848584 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:31:24.848584 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:31:24.848584 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 14:31:24.848584 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 14:31:24.848584 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 14:31:24.848584 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 14:31:24.848584 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:31:24.848584 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:31:24.848584 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:31:24.848584 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:31:24.848584 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:31:24.848584 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application with Lock( May 25 14:31:24.848584 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:31:24.848584 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._enter() May 25 14:31:24.848584 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:31:24.848584 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:31:24.848584 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:31:24.848584 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.creator() May 25 14:31:24.849772 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:31:24.849772 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application created_value = creator( May 25 14:31:24.849772 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 14:31:24.849772 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 14:31:24.849772 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 14:31:24.849772 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 14:31:24.849772 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 14:31:24.849772 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 14:31:24.849772 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 25 14:31:24.849772 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:31:24.849772 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 641/1280] 10.222.0.67 () {56 vars in 1108 bytes} [Wed May 25 14:31:24 2022] GET /identity/v3/users/placement => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:31:24.854446 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ab5f48-ead8-4727-b3a4-2e937c58fed1 None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:31:24.858886 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:31:24.952026 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ab5f48-ead8-4727-b3a4-2e937c58fed1 None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:31:24.984672 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96834be-3c37-4bb9-9a7b-b589b5fd8a83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:31:24.985264 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96834be-3c37-4bb9-9a7b-b589b5fd8a83 None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:31:24.985547 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96834be-3c37-4bb9-9a7b-b589b5fd8a83 None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:31:24.985821 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96834be-3c37-4bb9-9a7b-b589b5fd8a83 None admin] PATH_INFO: `/v3/users` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:31:24.986645 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96834be-3c37-4bb9-9a7b-b589b5fd8a83 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:31:24.986954 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96834be-3c37-4bb9-9a7b-b589b5fd8a83 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:31:24.988396 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96834be-3c37-4bb9-9a7b-b589b5fd8a83 None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:31:25.004999 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 640/1281] 10.222.0.67 () {56 vars in 1143 bytes} [Wed May 25 14:31:24 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:31:25.010672 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5e2827-3bf3-4f8d-bafb-5d7b0f6f8505 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:31:25.099169 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:31:25.108757 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5e2827-3bf3-4f8d-bafb-5d7b0f6f8505 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:31:25.141769 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b40b81-3382-49bd-b516-d07da20e662d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:31:25.142397 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b40b81-3382-49bd-b516-d07da20e662d None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:31:25.142679 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b40b81-3382-49bd-b516-d07da20e662d None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:31:25.142947 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b40b81-3382-49bd-b516-d07da20e662d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:31:25.206715 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b40b81-3382-49bd-b516-d07da20e662d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:31:25.208169 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b40b81-3382-49bd-b516-d07da20e662d None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:31:25.293265 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:31:25.303747 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 642/1282] 10.222.0.67 () {58 vars in 1282 bytes} [Wed May 25 14:31:25 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 25 14:31:25.310198 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96834be-3c37-4bb9-9a7b-b589b5fd8a83 None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:31:25.370265 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:31:25.409421 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96834be-3c37-4bb9-9a7b-b589b5fd8a83 None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:31:25.442145 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1907750c-afcb-4cb0-afe9-f195229b043e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:31:25.442923 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1907750c-afcb-4cb0-afe9-f195229b043e None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:31:25.443232 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1907750c-afcb-4cb0-afe9-f195229b043e None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:31:25.443503 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1907750c-afcb-4cb0-afe9-f195229b043e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:31:25.453685 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1907750c-afcb-4cb0-afe9-f195229b043e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:31:25.455147 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1907750c-afcb-4cb0-afe9-f195229b043e None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:31:25.472138 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application [None req-1907750c-afcb-4cb0-afe9-f195229b043e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:31:25.472138 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:31:25.472138 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:31:25.472138 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:31:25.472138 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:31:25.472138 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:31:25.472138 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:31:25.472138 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:31:25.472138 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:31:25.472138 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:31:25.472138 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:31:25.472138 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:31:25.472138 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 14:31:25.472138 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 14:31:25.472138 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 14:31:25.473238 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 14:31:25.473238 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:31:25.473238 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:31:25.473238 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:31:25.473238 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:31:25.473238 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:31:25.473238 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:31:25.473238 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:31:25.473238 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application with Lock( May 25 14:31:25.473238 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:31:25.473238 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self._enter() May 25 14:31:25.473238 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:31:25.473238 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:31:25.473238 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:31:25.473238 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.creator() May 25 14:31:25.473238 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:31:25.473238 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application created_value = creator( May 25 14:31:25.474498 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 14:31:25.474498 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 14:31:25.474498 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:31:25.474498 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application May 25 14:31:25.474498 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 641/1283] 10.222.0.67 () {56 vars in 1108 bytes} [Wed May 25 14:31:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:31:25.481618 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b40b81-3382-49bd-b516-d07da20e662d None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:31:25.580373 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b40b81-3382-49bd-b516-d07da20e662d None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:31:25.613706 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eadc50a-045c-451d-a728-fec0a678958e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:31:25.614355 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eadc50a-045c-451d-a728-fec0a678958e None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:31:25.614636 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eadc50a-045c-451d-a728-fec0a678958e None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:31:25.614912 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eadc50a-045c-451d-a728-fec0a678958e None admin] PATH_INFO: `/v3/domains` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:31:25.615659 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eadc50a-045c-451d-a728-fec0a678958e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:31:25.615964 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eadc50a-045c-451d-a728-fec0a678958e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:31:25.617325 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eadc50a-045c-451d-a728-fec0a678958e None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:31:25.629450 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 643/1284] 10.222.0.67 () {56 vars in 1109 bytes} [Wed May 25 14:31:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:31:25.635013 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1907750c-afcb-4cb0-afe9-f195229b043e None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:31:25.733433 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1907750c-afcb-4cb0-afe9-f195229b043e None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:31:25.747489 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:31:25.767354 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74dc0c23-61ed-474d-a823-5cd9cf428119 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:31:25.768134 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dc0c23-61ed-474d-a823-5cd9cf428119 None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:31:25.768422 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dc0c23-61ed-474d-a823-5cd9cf428119 None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:31:25.768701 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dc0c23-61ed-474d-a823-5cd9cf428119 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:31:25.775217 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74dc0c23-61ed-474d-a823-5cd9cf428119 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:31:25.776686 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74dc0c23-61ed-474d-a823-5cd9cf428119 None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:31:25.790126 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application [None req-74dc0c23-61ed-474d-a823-5cd9cf428119 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 14:31:25.790126 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:31:25.790126 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:31:25.790126 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:31:25.790126 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:31:25.790126 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:31:25.790126 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:31:25.790126 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:31:25.790126 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:31:25.790126 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:31:25.790126 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:31:25.790126 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:31:25.790126 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 14:31:25.790126 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 14:31:25.790126 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 14:31:25.791220 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 14:31:25.791220 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:31:25.791220 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:31:25.791220 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:31:25.791220 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:31:25.791220 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:31:25.791220 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:31:25.791220 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:31:25.791220 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application with Lock( May 25 14:31:25.791220 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:31:25.791220 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self._enter() May 25 14:31:25.791220 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:31:25.791220 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:31:25.791220 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:31:25.791220 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.creator() May 25 14:31:25.791220 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:31:25.791220 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application created_value = creator( May 25 14:31:25.793046 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 14:31:25.793046 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 14:31:25.793046 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 14:31:25.793046 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 14:31:25.793046 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 14:31:25.793046 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 14:31:25.793046 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 14:31:25.793046 dv-cinder-787296-9-smb devstack@keystone.service[80474]: ERROR keystone.server.flask.application May 25 14:31:25.793046 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 642/1285] 10.222.0.67 () {56 vars in 1111 bytes} [Wed May 25 14:31:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:31:25.797790 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eadc50a-045c-451d-a728-fec0a678958e None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:31:25.847798 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:31:25.897524 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eadc50a-045c-451d-a728-fec0a678958e None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:31:25.929860 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152f7410-256b-4a26-b8cf-f29cf4c05c43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:31:25.930505 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152f7410-256b-4a26-b8cf-f29cf4c05c43 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:31:25.930792 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152f7410-256b-4a26-b8cf-f29cf4c05c43 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:31:25.931097 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152f7410-256b-4a26-b8cf-f29cf4c05c43 None admin] PATH_INFO: `/v3/projects` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:31:25.931885 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152f7410-256b-4a26-b8cf-f29cf4c05c43 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:31:25.932194 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152f7410-256b-4a26-b8cf-f29cf4c05c43 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:31:25.934209 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152f7410-256b-4a26-b8cf-f29cf4c05c43 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:31:25.945846 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 644/1286] 10.222.0.67 () {56 vars in 1148 bytes} [Wed May 25 14:31:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:31:25.952419 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74dc0c23-61ed-474d-a823-5cd9cf428119 None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:31:26.052281 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74dc0c23-61ed-474d-a823-5cd9cf428119 None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:31:26.090615 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041a3ba7-c477-4c60-84a5-21ac92c4f5ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:31:26.091231 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041a3ba7-c477-4c60-84a5-21ac92c4f5ee None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:31:26.091516 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041a3ba7-c477-4c60-84a5-21ac92c4f5ee None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:31:26.091790 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041a3ba7-c477-4c60-84a5-21ac92c4f5ee None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:31:26.092618 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041a3ba7-c477-4c60-84a5-21ac92c4f5ee None admin] RBAC: Adding query filter params (role.id=399893e19eac4ab5a8e596f7c07be13c, scope.project.id=bfe93ee8d32a441295efc0b885de4bd7, user.id=ad2b99c2122a4311996364e982e1c801) {{(pid=80474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:31:26.092930 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041a3ba7-c477-4c60-84a5-21ac92c4f5ee None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:31:26.094370 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041a3ba7-c477-4c60-84a5-21ac92c4f5ee None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:31:26.100104 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 643/1287] 10.222.0.67 () {56 vars in 1374 bytes} [Wed May 25 14:31:25 2022] GET /identity/v3/role_assignments?user.id=ad2b99c2122a4311996364e982e1c801&scope.project.id=bfe93ee8d32a441295efc0b885de4bd7&role.id=399893e19eac4ab5a8e596f7c07be13c => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:31:28.336623 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654f44b6-6533-497f-b72d-2730cc4eb374 None None] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:31:28.337150 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654f44b6-6533-497f-b72d-2730cc4eb374 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:31:28.337271 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654f44b6-6533-497f-b72d-2730cc4eb374 None None] PATH_INFO: `/` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:31:28.338549 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 645/1288] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 14:31:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:31:28.344323 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd09a27d-71ad-4bec-9fd8-409a8587e61b None None] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:31:28.344788 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd09a27d-71ad-4bec-9fd8-409a8587e61b None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:31:28.344881 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd09a27d-71ad-4bec-9fd8-409a8587e61b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:31:28.361951 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.auth.core [None req-cd09a27d-71ad-4bec-9fd8-409a8587e61b None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:31:28.363172 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-cd09a27d-71ad-4bec-9fd8-409a8587e61b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:31:28.392329 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:31:28.430356 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 644/1289] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 14:31:28 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 14:31:28.452938 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654f44b6-6533-497f-b72d-2730cc4eb374 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:31:28.554197 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654f44b6-6533-497f-b72d-2730cc4eb374 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:31:28.565018 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:31:28.590818 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae7d9df-ce27-48a5-b69c-db9c8214e5c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:31:28.591513 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae7d9df-ce27-48a5-b69c-db9c8214e5c9 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:31:28.591804 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae7d9df-ce27-48a5-b69c-db9c8214e5c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:31:28.592133 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae7d9df-ce27-48a5-b69c-db9c8214e5c9 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:31:28.592780 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae7d9df-ce27-48a5-b69c-db9c8214e5c9 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:31:28.594110 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae7d9df-ce27-48a5-b69c-db9c8214e5c9 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:31:28.606811 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application [None req-7ae7d9df-ce27-48a5-b69c-db9c8214e5c9 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 25 14:31:28.606811 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:31:28.606811 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 14:31:28.606811 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 14:31:28.606811 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 14:31:28.606811 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 14:31:28.606811 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 14:31:28.606811 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 14:31:28.606811 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 25 14:31:28.606811 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:31:28.606811 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 14:31:28.606811 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:31:28.606811 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:31:28.606811 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:31:28.606811 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:31:28.606811 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:31:28.606811 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:31:28.608204 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:31:28.608204 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:31:28.608204 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:31:28.608204 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:31:28.608204 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:31:28.608204 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:31:28.608204 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 14:31:28.608204 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 14:31:28.608204 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 14:31:28.608204 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 14:31:28.608204 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:31:28.608204 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:31:28.608204 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:31:28.608204 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:31:28.608204 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:31:28.608204 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:31:28.609398 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:31:28.609398 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application with Lock( May 25 14:31:28.609398 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:31:28.609398 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._enter() May 25 14:31:28.609398 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:31:28.609398 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:31:28.609398 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:31:28.609398 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.creator() May 25 14:31:28.609398 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:31:28.609398 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application created_value = creator( May 25 14:31:28.609398 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 14:31:28.609398 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 14:31:28.609398 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 25 14:31:28.609398 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:31:28.609398 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 646/1290] 10.222.0.67 () {56 vars in 1117 bytes} [Wed May 25 14:31:28 2022] GET /identity/v3/services/placement => generated 90 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:31:28.614065 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd09a27d-71ad-4bec-9fd8-409a8587e61b None None] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:31:28.713576 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd09a27d-71ad-4bec-9fd8-409a8587e61b None None] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:31:28.747066 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1744522-885d-4179-a26b-1857c9f4de5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:31:28.747727 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1744522-885d-4179-a26b-1857c9f4de5f None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:31:28.748013 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1744522-885d-4179-a26b-1857c9f4de5f None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:31:28.748292 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1744522-885d-4179-a26b-1857c9f4de5f None admin] PATH_INFO: `/v3/services` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:31:28.748997 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1744522-885d-4179-a26b-1857c9f4de5f None admin] RBAC: Adding query filter params (name=placement) {{(pid=80474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:31:28.749557 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1744522-885d-4179-a26b-1857c9f4de5f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:31:28.751031 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1744522-885d-4179-a26b-1857c9f4de5f None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:31:28.755867 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 645/1291] 10.222.0.67 () {56 vars in 1116 bytes} [Wed May 25 14:31:28 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:31:28.762220 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae7d9df-ce27-48a5-b69c-db9c8214e5c9 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:31:28.865584 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae7d9df-ce27-48a5-b69c-db9c8214e5c9 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:31:28.899922 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e535ce0-8779-4d52-85ff-82ceef100108 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:31:28.900573 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e535ce0-8779-4d52-85ff-82ceef100108 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:31:28.900858 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e535ce0-8779-4d52-85ff-82ceef100108 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:31:28.901138 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e535ce0-8779-4d52-85ff-82ceef100108 None admin] PATH_INFO: `/v3/services` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:31:28.902943 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e535ce0-8779-4d52-85ff-82ceef100108 None admin] RBAC: Adding query filter params (type=placement) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:31:28.903293 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e535ce0-8779-4d52-85ff-82ceef100108 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:31:28.904668 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e535ce0-8779-4d52-85ff-82ceef100108 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:31:28.909029 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 647/1292] 10.222.0.67 () {56 vars in 1116 bytes} [Wed May 25 14:31:28 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:31:31.069378 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2bdbee-bc14-401a-a2bd-21b0d4d6980b None None] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:31:31.069922 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2bdbee-bc14-401a-a2bd-21b0d4d6980b None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:31:31.069922 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2bdbee-bc14-401a-a2bd-21b0d4d6980b None None] PATH_INFO: `/` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:31:31.071370 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 646/1293] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 14:31:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:31:31.076939 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f58393e-59cb-4771-b0d1-8f7179bb92d6 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:31:31.077337 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f58393e-59cb-4771-b0d1-8f7179bb92d6 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:31:31.077498 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f58393e-59cb-4771-b0d1-8f7179bb92d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:31:31.094499 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-3f58393e-59cb-4771-b0d1-8f7179bb92d6 None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:31:31.095644 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-3f58393e-59cb-4771-b0d1-8f7179bb92d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:31:31.123765 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:31:31.161144 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 648/1294] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 14:31:31 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 14:31:31.183520 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2bdbee-bc14-401a-a2bd-21b0d4d6980b None None] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:31:31.215164 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:31:31.284855 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2bdbee-bc14-401a-a2bd-21b0d4d6980b None None] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:31:31.317784 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b6396d-0893-47c4-90cd-323e6068edfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:31:31.318449 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b6396d-0893-47c4-90cd-323e6068edfb None admin] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:31:31.318717 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b6396d-0893-47c4-90cd-323e6068edfb None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:31:31.319044 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b6396d-0893-47c4-90cd-323e6068edfb None admin] PATH_INFO: `/v3/services` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:31:31.319738 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b6396d-0893-47c4-90cd-323e6068edfb None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:31:31.321099 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b6396d-0893-47c4-90cd-323e6068edfb None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:31:31.335446 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 647/1295] 10.222.0.67 () {60 vars in 1141 bytes} [Wed May 25 14:31:31 2022] POST /identity/v3/services => generated 246 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:31:33.503940 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abc3e1b-869a-4a35-ae0b-ae5499fd70bc None None] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:31:33.504498 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abc3e1b-869a-4a35-ae0b-ae5499fd70bc None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:31:33.504498 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abc3e1b-869a-4a35-ae0b-ae5499fd70bc None None] PATH_INFO: `/` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:31:33.505861 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 649/1296] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 14:31:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:31:33.510930 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da209ce6-fe6a-410b-a4f9-c7a5c8f0f612 None None] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:31:33.511365 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da209ce6-fe6a-410b-a4f9-c7a5c8f0f612 None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:31:33.511515 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da209ce6-fe6a-410b-a4f9-c7a5c8f0f612 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:31:33.528454 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.auth.core [None req-da209ce6-fe6a-410b-a4f9-c7a5c8f0f612 None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:31:33.529634 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-da209ce6-fe6a-410b-a4f9-c7a5c8f0f612 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:31:33.609830 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 648/1297] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 14:31:33 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 14:31:33.632591 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abc3e1b-869a-4a35-ae0b-ae5499fd70bc None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:31:33.733694 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abc3e1b-869a-4a35-ae0b-ae5499fd70bc None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:31:33.767115 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdd03f0-4f03-4b33-9258-af7ecee65d71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:31:33.767905 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdd03f0-4f03-4b33-9258-af7ecee65d71 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:31:33.768188 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdd03f0-4f03-4b33-9258-af7ecee65d71 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:31:33.768464 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdd03f0-4f03-4b33-9258-af7ecee65d71 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:31:33.769120 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdd03f0-4f03-4b33-9258-af7ecee65d71 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:31:33.770494 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdd03f0-4f03-4b33-9258-af7ecee65d71 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:31:33.782902 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application [None req-6bdd03f0-4f03-4b33-9258-af7ecee65d71 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 25 14:31:33.782902 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:31:33.782902 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 14:31:33.782902 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 14:31:33.782902 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 14:31:33.782902 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 14:31:33.782902 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 14:31:33.782902 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 14:31:33.782902 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 25 14:31:33.782902 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:31:33.782902 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 14:31:33.782902 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:31:33.782902 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:31:33.782902 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:31:33.782902 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:31:33.782902 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:31:33.782902 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:31:33.784109 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:31:33.784109 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:31:33.784109 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:31:33.784109 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:31:33.784109 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:31:33.784109 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:31:33.784109 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 14:31:33.784109 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 14:31:33.784109 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 14:31:33.784109 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 14:31:33.784109 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:31:33.784109 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:31:33.784109 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:31:33.784109 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:31:33.784109 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:31:33.784109 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:31:33.785218 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:31:33.785218 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application with Lock( May 25 14:31:33.785218 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:31:33.785218 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._enter() May 25 14:31:33.785218 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:31:33.785218 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:31:33.785218 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:31:33.785218 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.creator() May 25 14:31:33.785218 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:31:33.785218 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application created_value = creator( May 25 14:31:33.785218 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 14:31:33.785218 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 14:31:33.785218 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 25 14:31:33.785218 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:31:33.785218 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 650/1298] 10.222.0.67 () {56 vars in 1117 bytes} [Wed May 25 14:31:33 2022] GET /identity/v3/services/placement => generated 90 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:31:33.790094 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da209ce6-fe6a-410b-a4f9-c7a5c8f0f612 None None] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:31:33.808661 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:31:33.889038 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da209ce6-fe6a-410b-a4f9-c7a5c8f0f612 None None] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:31:33.922265 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98fdc34-cbe2-4997-87e3-62ef6437d97f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:31:33.922931 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98fdc34-cbe2-4997-87e3-62ef6437d97f None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:31:33.923248 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98fdc34-cbe2-4997-87e3-62ef6437d97f None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:31:33.923528 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98fdc34-cbe2-4997-87e3-62ef6437d97f None admin] PATH_INFO: `/v3/services` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:31:33.924238 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98fdc34-cbe2-4997-87e3-62ef6437d97f None admin] RBAC: Adding query filter params (name=placement) {{(pid=80474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:31:33.924548 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98fdc34-cbe2-4997-87e3-62ef6437d97f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:31:33.925919 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98fdc34-cbe2-4997-87e3-62ef6437d97f None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:31:33.930960 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 649/1299] 10.222.0.67 () {56 vars in 1116 bytes} [Wed May 25 14:31:33 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:31:33.936823 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdd03f0-4f03-4b33-9258-af7ecee65d71 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:31:33.968847 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:31:34.035699 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdd03f0-4f03-4b33-9258-af7ecee65d71 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:31:34.067583 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060f9421-26c1-4790-afc2-004e2382971c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:31:34.068224 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060f9421-26c1-4790-afc2-004e2382971c None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:31:34.068512 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060f9421-26c1-4790-afc2-004e2382971c None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:31:34.068790 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060f9421-26c1-4790-afc2-004e2382971c None admin] PATH_INFO: `/v3/endpoints` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:31:34.069574 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060f9421-26c1-4790-afc2-004e2382971c None admin] RBAC: Adding query filter params (interface=public, service_id=b116231f22e849459013b9f3f9252445, region_id=RegionOne) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:31:34.069888 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060f9421-26c1-4790-afc2-004e2382971c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:31:34.071280 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060f9421-26c1-4790-afc2-004e2382971c None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:31:34.076767 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 651/1300] 10.222.0.67 () {56 vars in 1251 bytes} [Wed May 25 14:31:33 2022] GET /identity/v3/endpoints?service_id=b116231f22e849459013b9f3f9252445&interface=public®ion_id=RegionOne => generated 194 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:31:34.082417 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98fdc34-cbe2-4997-87e3-62ef6437d97f None admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:31:34.163449 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:31:34.181800 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98fdc34-cbe2-4997-87e3-62ef6437d97f None admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:31:34.216534 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c12489-21b8-42f9-83c5-81d820769986 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:31:34.217182 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c12489-21b8-42f9-83c5-81d820769986 None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:31:34.217465 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c12489-21b8-42f9-83c5-81d820769986 None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:31:34.217750 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c12489-21b8-42f9-83c5-81d820769986 None admin] PATH_INFO: `/v3/services` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:31:34.218428 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c12489-21b8-42f9-83c5-81d820769986 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:31:34.219830 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c12489-21b8-42f9-83c5-81d820769986 None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:31:34.226445 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 650/1301] 10.222.0.67 () {56 vars in 1087 bytes} [Wed May 25 14:31:34 2022] GET /identity/v3/services => generated 2191 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:31:36.403545 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404754bd-26f8-4dd4-887f-3219d4847c45 None None] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:31:36.404132 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404754bd-26f8-4dd4-887f-3219d4847c45 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:31:36.404132 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404754bd-26f8-4dd4-887f-3219d4847c45 None None] PATH_INFO: `/` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:31:36.405486 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 652/1302] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 14:31:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:31:36.410686 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484f1159-a787-4dd0-b75d-d72724b37b66 None None] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:31:36.411105 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484f1159-a787-4dd0-b75d-d72724b37b66 None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:31:36.411273 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484f1159-a787-4dd0-b75d-d72724b37b66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:31:36.427776 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.auth.core [None req-484f1159-a787-4dd0-b75d-d72724b37b66 None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:31:36.429166 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-484f1159-a787-4dd0-b75d-d72724b37b66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:31:36.496296 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 651/1303] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 14:31:36 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 14:31:36.519381 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404754bd-26f8-4dd4-887f-3219d4847c45 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:31:36.612410 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:31:36.619305 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404754bd-26f8-4dd4-887f-3219d4847c45 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:31:36.654037 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f1ff00-a3ee-47a5-a642-463528e14c27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:31:36.654765 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f1ff00-a3ee-47a5-a642-463528e14c27 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:31:36.655078 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f1ff00-a3ee-47a5-a642-463528e14c27 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:31:36.655359 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f1ff00-a3ee-47a5-a642-463528e14c27 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:31:36.656012 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f1ff00-a3ee-47a5-a642-463528e14c27 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:31:36.657383 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f1ff00-a3ee-47a5-a642-463528e14c27 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:31:36.669632 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application [None req-07f1ff00-a3ee-47a5-a642-463528e14c27 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 25 14:31:36.669632 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:31:36.669632 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 14:31:36.669632 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 14:31:36.669632 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 14:31:36.669632 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 14:31:36.669632 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 14:31:36.669632 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 14:31:36.669632 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 25 14:31:36.669632 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:31:36.669632 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 14:31:36.669632 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:31:36.669632 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:31:36.669632 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:31:36.669632 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:31:36.669632 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:31:36.669632 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:31:36.670903 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:31:36.670903 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:31:36.670903 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:31:36.670903 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:31:36.670903 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:31:36.670903 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:31:36.670903 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 14:31:36.670903 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 14:31:36.670903 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 14:31:36.670903 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 14:31:36.670903 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:31:36.670903 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:31:36.670903 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:31:36.670903 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:31:36.670903 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:31:36.670903 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:31:36.671899 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:31:36.671899 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application with Lock( May 25 14:31:36.671899 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:31:36.671899 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._enter() May 25 14:31:36.671899 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:31:36.671899 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:31:36.671899 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:31:36.671899 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.creator() May 25 14:31:36.671899 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:31:36.671899 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application created_value = creator( May 25 14:31:36.671899 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 14:31:36.671899 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 14:31:36.671899 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 25 14:31:36.671899 dv-cinder-787296-9-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:31:36.671899 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 653/1304] 10.222.0.67 () {56 vars in 1117 bytes} [Wed May 25 14:31:36 2022] GET /identity/v3/services/placement => generated 90 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:31:36.677022 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484f1159-a787-4dd0-b75d-d72724b37b66 None None] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:31:36.753130 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:31:36.777094 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484f1159-a787-4dd0-b75d-d72724b37b66 None None] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:31:36.810822 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a793822-1d24-48ee-8dab-9ff5fe61e771 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:31:36.811502 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a793822-1d24-48ee-8dab-9ff5fe61e771 None admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:31:36.811789 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a793822-1d24-48ee-8dab-9ff5fe61e771 None admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:31:36.812067 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a793822-1d24-48ee-8dab-9ff5fe61e771 None admin] PATH_INFO: `/v3/services` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:31:36.812772 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a793822-1d24-48ee-8dab-9ff5fe61e771 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:31:36.813081 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a793822-1d24-48ee-8dab-9ff5fe61e771 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:31:36.814436 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a793822-1d24-48ee-8dab-9ff5fe61e771 None admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:31:36.819548 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 652/1305] 10.222.0.67 () {56 vars in 1116 bytes} [Wed May 25 14:31:36 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:31:36.825902 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f1ff00-a3ee-47a5-a642-463528e14c27 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:31:36.930197 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f1ff00-a3ee-47a5-a642-463528e14c27 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:31:36.962831 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7157ddc-cfe2-4b86-9907-f8f03e4952ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:31:36.963517 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7157ddc-cfe2-4b86-9907-f8f03e4952ab None admin] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:31:36.963806 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7157ddc-cfe2-4b86-9907-f8f03e4952ab None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:31:36.964263 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7157ddc-cfe2-4b86-9907-f8f03e4952ab None admin] PATH_INFO: `/v3/endpoints` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:31:36.965104 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7157ddc-cfe2-4b86-9907-f8f03e4952ab None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:31:36.966481 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7157ddc-cfe2-4b86-9907-f8f03e4952ab None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:31:36.985087 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 654/1306] 10.222.0.67 () {60 vars in 1144 bytes} [Wed May 25 14:31:36 2022] POST /identity/v3/endpoints => generated 331 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:31:46.816554 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=30 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:31:46.979910 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:32:41.128507 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d83294-b512-4faa-a8e3-dee81f06e85a None None] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:32:41.129049 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d83294-b512-4faa-a8e3-dee81f06e85a None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:32:41.129316 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d83294-b512-4faa-a8e3-dee81f06e85a None None] PATH_INFO: `/` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:32:41.131262 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 653/1307] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 14:32:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:32:41.137356 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcf41af-c177-4fcf-817b-d9c7308983f3 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:32:41.137858 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcf41af-c177-4fcf-817b-d9c7308983f3 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:32:41.137959 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcf41af-c177-4fcf-817b-d9c7308983f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:32:41.283107 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-adcf41af-c177-4fcf-817b-d9c7308983f3 None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:32:41.284327 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-adcf41af-c177-4fcf-817b-d9c7308983f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:32:41.499499 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 655/1308] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 14:32:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 363 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:32:41.563788 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c414c6-c90f-46b3-b8ea-85613c935223 None None] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:32:41.564052 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c414c6-c90f-46b3-b8ea-85613c935223 None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:32:41.564337 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c414c6-c90f-46b3-b8ea-85613c935223 None None] PATH_INFO: `/` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:32:41.565821 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 654/1309] 10.222.0.67 () {54 vars in 964 bytes} [Wed May 25 14:32:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:32:41.572035 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e460512-149f-4a18-b9a9-6b9ff1fa91c0 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:32:41.572388 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e460512-149f-4a18-b9a9-6b9ff1fa91c0 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:32:41.572664 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e460512-149f-4a18-b9a9-6b9ff1fa91c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:32:41.688136 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-6e460512-149f-4a18-b9a9-6b9ff1fa91c0 None None] MFA Rules not processed for user `b68eed985c7b49839bcdd173186ad4ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:32:41.689359 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-6e460512-149f-4a18-b9a9-6b9ff1fa91c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:32:41.714466 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:32:41.785723 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 656/1310] 10.222.0.67 () {58 vars in 1061 bytes} [Wed May 25 14:32:41 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 14:32:41.796604 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c414c6-c90f-46b3-b8ea-85613c935223 None None] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:32:41.798863 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-d1c414c6-c90f-46b3-b8ea-85613c935223 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:32:41.960007 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c414c6-c90f-46b3-b8ea-85613c935223 None None] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:32:42.050952 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708146da-9d8a-4407-8dc6-e62718571ed9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b68eed985c7b49839bcdd173186ad4ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfe93ee8d32a441295efc0b885de4bd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:32:42.051648 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708146da-9d8a-4407-8dc6-e62718571ed9 service neutron] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:32:42.051934 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708146da-9d8a-4407-8dc6-e62718571ed9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:32:42.052486 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708146da-9d8a-4407-8dc6-e62718571ed9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:32:42.054447 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-708146da-9d8a-4407-8dc6-e62718571ed9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:32:42.127604 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:32:42.188353 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708146da-9d8a-4407-8dc6-e62718571ed9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:32:42.190603 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708146da-9d8a-4407-8dc6-e62718571ed9 service neutron] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:32:42.211157 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 655/1311] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 14:32:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:32:44.803572 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de7f23c-6bdf-4a96-91b1-c0cfbf55bdac None None] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:32:44.804124 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de7f23c-6bdf-4a96-91b1-c0cfbf55bdac None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:32:44.804124 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de7f23c-6bdf-4a96-91b1-c0cfbf55bdac None None] PATH_INFO: `/` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:32:44.805519 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 657/1312] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 14:32:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:32:44.811689 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b56c40-834f-4b93-baa2-cc89067ff50f None None] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:32:44.812162 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b56c40-834f-4b93-baa2-cc89067ff50f None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:32:44.812267 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b56c40-834f-4b93-baa2-cc89067ff50f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:32:44.896740 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.auth.core [None req-a2b56c40-834f-4b93-baa2-cc89067ff50f None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:32:44.897933 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-a2b56c40-834f-4b93-baa2-cc89067ff50f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:32:45.008245 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 656/1313] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 14:32:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:32:45.046215 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de7f23c-6bdf-4a96-91b1-c0cfbf55bdac None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:32:45.047817 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-4de7f23c-6bdf-4a96-91b1-c0cfbf55bdac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:32:45.156228 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de7f23c-6bdf-4a96-91b1-c0cfbf55bdac None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:32:45.230056 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:32:45.233050 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0470c7da-79af-4d1b-b632-43d0d707fff3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b68eed985c7b49839bcdd173186ad4ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfe93ee8d32a441295efc0b885de4bd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:32:45.233743 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0470c7da-79af-4d1b-b632-43d0d707fff3 service neutron] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:32:45.234283 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0470c7da-79af-4d1b-b632-43d0d707fff3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:32:45.234732 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0470c7da-79af-4d1b-b632-43d0d707fff3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:32:45.236623 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-0470c7da-79af-4d1b-b632-43d0d707fff3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:32:45.350498 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0470c7da-79af-4d1b-b632-43d0d707fff3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:32:45.351983 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0470c7da-79af-4d1b-b632-43d0d707fff3 service neutron] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:32:45.369729 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 658/1314] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 14:32:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:32:47.889282 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c489a9-f020-469b-b04f-2e1d8f8ae106 None None] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:32:47.889787 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c489a9-f020-469b-b04f-2e1d8f8ae106 None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:32:47.889881 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c489a9-f020-469b-b04f-2e1d8f8ae106 None None] PATH_INFO: `/` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:32:47.891257 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 657/1315] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 14:32:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:32:47.896468 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696c239e-b0e3-493a-920f-06dc0d227a24 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:32:47.896910 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696c239e-b0e3-493a-920f-06dc0d227a24 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:32:47.897038 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696c239e-b0e3-493a-920f-06dc0d227a24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:32:47.960805 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-696c239e-b0e3-493a-920f-06dc0d227a24 None None] MFA Rules not processed for user `57a4a797d2d54ecd9eeb8857c043b617`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:32:47.961991 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-696c239e-b0e3-493a-920f-06dc0d227a24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:32:48.012439 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:32:48.057482 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 659/1316] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 14:32:47 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:32:48.097354 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c489a9-f020-469b-b04f-2e1d8f8ae106 None None] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:32:48.098885 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-c9c489a9-f020-469b-b04f-2e1d8f8ae106 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:32:48.109699 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:32:48.204932 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c489a9-f020-469b-b04f-2e1d8f8ae106 None None] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:32:48.277957 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266298b1-e7c3-48f6-ba38-559f136933c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b68eed985c7b49839bcdd173186ad4ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfe93ee8d32a441295efc0b885de4bd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:32:48.278584 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266298b1-e7c3-48f6-ba38-559f136933c1 service neutron] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:32:48.278863 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266298b1-e7c3-48f6-ba38-559f136933c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:32:48.279167 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266298b1-e7c3-48f6-ba38-559f136933c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:32:48.280786 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-266298b1-e7c3-48f6-ba38-559f136933c1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:32:48.343489 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:32:48.390578 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266298b1-e7c3-48f6-ba38-559f136933c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:32:48.392041 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266298b1-e7c3-48f6-ba38-559f136933c1 service neutron] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:32:48.409888 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 658/1317] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 14:32:48 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:32:51.202961 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11227ab9-2ea3-4a1c-a3af-57bac7687ba9 None None] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:32:51.203481 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11227ab9-2ea3-4a1c-a3af-57bac7687ba9 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:32:51.203602 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11227ab9-2ea3-4a1c-a3af-57bac7687ba9 None None] PATH_INFO: `/` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:32:51.204958 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 660/1318] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 14:32:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:32:51.210063 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a0ccbd-961c-427f-be0e-c255e011864e None None] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:32:51.210503 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a0ccbd-961c-427f-be0e-c255e011864e None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:32:51.210607 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a0ccbd-961c-427f-be0e-c255e011864e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:32:51.274212 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.auth.core [None req-a5a0ccbd-961c-427f-be0e-c255e011864e None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:32:51.276027 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-a5a0ccbd-961c-427f-be0e-c255e011864e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:32:51.369305 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 659/1319] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 14:32:51 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:32:51.408271 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11227ab9-2ea3-4a1c-a3af-57bac7687ba9 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:32:51.409792 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-11227ab9-2ea3-4a1c-a3af-57bac7687ba9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:32:51.511397 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11227ab9-2ea3-4a1c-a3af-57bac7687ba9 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:32:51.584622 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574ba06a-dc59-4c4d-bfa0-a5ae2b8d51c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b68eed985c7b49839bcdd173186ad4ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfe93ee8d32a441295efc0b885de4bd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:32:51.585262 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574ba06a-dc59-4c4d-bfa0-a5ae2b8d51c9 service neutron] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:32:51.585544 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574ba06a-dc59-4c4d-bfa0-a5ae2b8d51c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:32:51.585818 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574ba06a-dc59-4c4d-bfa0-a5ae2b8d51c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:32:51.587463 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-574ba06a-dc59-4c4d-bfa0-a5ae2b8d51c9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:32:51.594236 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:32:51.696063 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574ba06a-dc59-4c4d-bfa0-a5ae2b8d51c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:32:51.698088 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574ba06a-dc59-4c4d-bfa0-a5ae2b8d51c9 service neutron] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:32:51.715808 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 661/1320] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 14:32:51 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:32:54.629196 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f0c29c-934e-4c7a-8998-764cf714a315 None None] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:32:54.629759 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f0c29c-934e-4c7a-8998-764cf714a315 None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:32:54.629759 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f0c29c-934e-4c7a-8998-764cf714a315 None None] PATH_INFO: `/` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:32:54.631152 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 660/1321] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 14:32:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:32:54.636439 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23995aa5-1c20-4d05-b8cd-8629bca80f9e None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:32:54.636868 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23995aa5-1c20-4d05-b8cd-8629bca80f9e None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:32:54.637008 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23995aa5-1c20-4d05-b8cd-8629bca80f9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:32:54.703628 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-23995aa5-1c20-4d05-b8cd-8629bca80f9e None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:32:54.704748 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-23995aa5-1c20-4d05-b8cd-8629bca80f9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:32:54.762217 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:32:54.801346 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 662/1322] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 14:32:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:32:54.836412 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f0c29c-934e-4c7a-8998-764cf714a315 None None] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:32:54.839129 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-54f0c29c-934e-4c7a-8998-764cf714a315 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:32:54.859443 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:32:54.945478 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f0c29c-934e-4c7a-8998-764cf714a315 None None] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:32:55.020871 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd09af1-fbde-4d89-bf03-4dca951143c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b68eed985c7b49839bcdd173186ad4ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfe93ee8d32a441295efc0b885de4bd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:32:55.021519 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd09af1-fbde-4d89-bf03-4dca951143c7 service neutron] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:32:55.021798 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd09af1-fbde-4d89-bf03-4dca951143c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:32:55.022070 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd09af1-fbde-4d89-bf03-4dca951143c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:32:55.023717 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-abd09af1-fbde-4d89-bf03-4dca951143c7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:32:55.098864 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:32:55.142580 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd09af1-fbde-4d89-bf03-4dca951143c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:32:55.144090 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd09af1-fbde-4d89-bf03-4dca951143c7 service neutron] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:32:55.164917 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 661/1323] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 14:32:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:32:57.409152 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9063664c-9809-4f58-bdc6-d026522bd975 None None] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:32:57.409680 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9063664c-9809-4f58-bdc6-d026522bd975 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:32:57.409795 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9063664c-9809-4f58-bdc6-d026522bd975 None None] PATH_INFO: `/` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:32:57.411196 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 663/1324] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 14:32:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:32:57.416983 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed6be91-e023-4873-a5e5-7fa585c486fb None None] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:32:57.417410 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed6be91-e023-4873-a5e5-7fa585c486fb None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:32:57.417531 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed6be91-e023-4873-a5e5-7fa585c486fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:32:57.483954 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.auth.core [None req-6ed6be91-e023-4873-a5e5-7fa585c486fb None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:32:57.485095 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-6ed6be91-e023-4873-a5e5-7fa585c486fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:32:57.581757 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 662/1325] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 14:32:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:32:57.618203 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9063664c-9809-4f58-bdc6-d026522bd975 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:32:57.620035 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-9063664c-9809-4f58-bdc6-d026522bd975 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:32:57.725112 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9063664c-9809-4f58-bdc6-d026522bd975 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:32:57.798926 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ee3493-f833-4022-8200-bc58cc6cb349 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b68eed985c7b49839bcdd173186ad4ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfe93ee8d32a441295efc0b885de4bd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:32:57.799600 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ee3493-f833-4022-8200-bc58cc6cb349 service neutron] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:32:57.799889 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ee3493-f833-4022-8200-bc58cc6cb349 service neutron] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:32:57.800171 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ee3493-f833-4022-8200-bc58cc6cb349 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:32:57.801803 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-57ee3493-f833-4022-8200-bc58cc6cb349 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:32:57.818281 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:32:57.916946 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ee3493-f833-4022-8200-bc58cc6cb349 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:32:57.918368 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ee3493-f833-4022-8200-bc58cc6cb349 service neutron] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:32:57.936002 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 664/1326] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 14:32:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:33:00.248588 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5bdaa0-fc9a-4e60-b061-83b5e0376e21 None None] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:33:00.249120 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5bdaa0-fc9a-4e60-b061-83b5e0376e21 None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:33:00.249120 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5bdaa0-fc9a-4e60-b061-83b5e0376e21 None None] PATH_INFO: `/` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:33:00.250445 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 663/1327] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 14:33:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:33:00.256141 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681f3da5-7672-4c28-97d9-27f7c9386893 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:33:00.256574 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681f3da5-7672-4c28-97d9-27f7c9386893 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:33:00.256691 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681f3da5-7672-4c28-97d9-27f7c9386893 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:33:00.323431 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-681f3da5-7672-4c28-97d9-27f7c9386893 None None] MFA Rules not processed for user `57a4a797d2d54ecd9eeb8857c043b617`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:33:00.324634 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-681f3da5-7672-4c28-97d9-27f7c9386893 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:33:00.407969 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:33:00.441411 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 665/1328] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 14:33:00 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:33:00.480316 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5bdaa0-fc9a-4e60-b061-83b5e0376e21 None None] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:33:00.481824 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-5c5bdaa0-fc9a-4e60-b061-83b5e0376e21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:33:00.513542 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:33:00.588357 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5bdaa0-fc9a-4e60-b061-83b5e0376e21 None None] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:33:00.663654 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918df3b5-1183-424f-95f1-d7d74560d33c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b68eed985c7b49839bcdd173186ad4ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfe93ee8d32a441295efc0b885de4bd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:33:00.664311 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918df3b5-1183-424f-95f1-d7d74560d33c service neutron] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:33:00.664595 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918df3b5-1183-424f-95f1-d7d74560d33c service neutron] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:33:00.664873 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918df3b5-1183-424f-95f1-d7d74560d33c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:33:00.667111 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-918df3b5-1183-424f-95f1-d7d74560d33c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:33:00.746050 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:33:00.778784 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918df3b5-1183-424f-95f1-d7d74560d33c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:33:00.780252 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918df3b5-1183-424f-95f1-d7d74560d33c service neutron] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:33:00.797745 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 664/1329] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 14:33:00 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:33:03.332674 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dd5b64-98e9-4246-a5e4-dfd640f71e24 None None] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:33:03.333240 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dd5b64-98e9-4246-a5e4-dfd640f71e24 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:33:03.333240 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dd5b64-98e9-4246-a5e4-dfd640f71e24 None None] PATH_INFO: `/` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:33:03.334600 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 666/1330] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 14:33:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:33:03.340526 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcaeef2-be9e-4aa0-a7e8-1af8f4b80b82 None None] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:33:03.340961 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcaeef2-be9e-4aa0-a7e8-1af8f4b80b82 None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:33:03.341076 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcaeef2-be9e-4aa0-a7e8-1af8f4b80b82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:33:03.410841 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.auth.core [None req-efcaeef2-be9e-4aa0-a7e8-1af8f4b80b82 None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:33:03.412077 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-efcaeef2-be9e-4aa0-a7e8-1af8f4b80b82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:33:03.519216 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 665/1331] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 14:33:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 14:33:03.555852 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dd5b64-98e9-4246-a5e4-dfd640f71e24 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:33:03.557777 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-22dd5b64-98e9-4246-a5e4-dfd640f71e24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:33:03.664389 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dd5b64-98e9-4246-a5e4-dfd640f71e24 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:33:03.741369 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908d1e38-5f5f-4239-a403-b8eab60e03ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b68eed985c7b49839bcdd173186ad4ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfe93ee8d32a441295efc0b885de4bd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:33:03.741940 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908d1e38-5f5f-4239-a403-b8eab60e03ee service neutron] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:33:03.742224 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908d1e38-5f5f-4239-a403-b8eab60e03ee service neutron] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:33:03.742502 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908d1e38-5f5f-4239-a403-b8eab60e03ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:33:03.744508 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-908d1e38-5f5f-4239-a403-b8eab60e03ee service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:33:03.772810 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:33:03.865310 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908d1e38-5f5f-4239-a403-b8eab60e03ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:33:03.866773 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908d1e38-5f5f-4239-a403-b8eab60e03ee service neutron] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:33:03.887819 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 667/1332] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 14:33:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:33:06.138766 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f51c793-ccf3-40e1-a304-b1255a6540df None None] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:33:06.139366 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f51c793-ccf3-40e1-a304-b1255a6540df None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:33:06.139366 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f51c793-ccf3-40e1-a304-b1255a6540df None None] PATH_INFO: `/` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:33:06.140655 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 666/1333] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 14:33:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:33:06.145787 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f7db80-741a-40ae-941c-26cc6d276898 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:33:06.146226 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f7db80-741a-40ae-941c-26cc6d276898 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:33:06.146333 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f7db80-741a-40ae-941c-26cc6d276898 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:33:06.210974 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-e2f7db80-741a-40ae-941c-26cc6d276898 None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:33:06.212861 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-e2f7db80-741a-40ae-941c-26cc6d276898 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:33:06.285067 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:33:06.308267 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 668/1334] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 14:33:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:33:06.346910 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f51c793-ccf3-40e1-a304-b1255a6540df None None] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:33:06.348478 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-5f51c793-ccf3-40e1-a304-b1255a6540df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:33:06.389141 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:33:06.452211 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f51c793-ccf3-40e1-a304-b1255a6540df None None] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:33:06.524226 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0771185-2a2d-4822-a6b0-b9f0c061707c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b68eed985c7b49839bcdd173186ad4ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfe93ee8d32a441295efc0b885de4bd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:33:06.525465 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0771185-2a2d-4822-a6b0-b9f0c061707c service neutron] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:33:06.525764 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0771185-2a2d-4822-a6b0-b9f0c061707c service neutron] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:33:06.526047 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0771185-2a2d-4822-a6b0-b9f0c061707c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:33:06.527718 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-d0771185-2a2d-4822-a6b0-b9f0c061707c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:33:06.610218 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:33:06.637050 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0771185-2a2d-4822-a6b0-b9f0c061707c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:33:06.638492 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0771185-2a2d-4822-a6b0-b9f0c061707c service neutron] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:33:06.656953 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 667/1335] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 14:33:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:33:09.220415 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a8b8bc-916c-46b1-b282-27bf9823d147 None None] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:33:09.220914 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a8b8bc-916c-46b1-b282-27bf9823d147 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:33:09.221016 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a8b8bc-916c-46b1-b282-27bf9823d147 None None] PATH_INFO: `/` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:33:09.222330 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 669/1336] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 14:33:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:33:09.227458 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e7efc3-d2c3-4a5a-84f2-349778f4bc26 None None] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:33:09.228430 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e7efc3-d2c3-4a5a-84f2-349778f4bc26 None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:33:09.228646 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e7efc3-d2c3-4a5a-84f2-349778f4bc26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:33:09.292208 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.auth.core [None req-08e7efc3-d2c3-4a5a-84f2-349778f4bc26 None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:33:09.293390 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-08e7efc3-d2c3-4a5a-84f2-349778f4bc26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:33:09.389097 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 668/1337] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 14:33:09 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 14:33:09.424344 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a8b8bc-916c-46b1-b282-27bf9823d147 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:33:09.425849 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-c5a8b8bc-916c-46b1-b282-27bf9823d147 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:33:09.527667 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a8b8bc-916c-46b1-b282-27bf9823d147 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:33:09.602667 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4e53bf-4499-421b-8ae9-81ca3bdc7409 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b68eed985c7b49839bcdd173186ad4ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfe93ee8d32a441295efc0b885de4bd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:33:09.603509 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4e53bf-4499-421b-8ae9-81ca3bdc7409 service neutron] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:33:09.603656 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4e53bf-4499-421b-8ae9-81ca3bdc7409 service neutron] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:33:09.603890 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4e53bf-4499-421b-8ae9-81ca3bdc7409 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:33:09.605525 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-4e4e53bf-4499-421b-8ae9-81ca3bdc7409 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:33:09.642961 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:33:09.717776 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4e53bf-4499-421b-8ae9-81ca3bdc7409 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:33:09.719447 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4e53bf-4499-421b-8ae9-81ca3bdc7409 service neutron] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:33:09.738633 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 670/1338] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 14:33:09 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:33:13.953772 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435a2032-a1d2-4cfb-8e81-4805ad654c68 None None] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:33:13.954296 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435a2032-a1d2-4cfb-8e81-4805ad654c68 None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:33:13.954296 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435a2032-a1d2-4cfb-8e81-4805ad654c68 None None] PATH_INFO: `/` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:33:13.955656 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 669/1339] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 14:33:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:33:13.960974 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e3b0c7-1973-4406-85c6-5992d559ec4a None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:33:13.961394 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e3b0c7-1973-4406-85c6-5992d559ec4a None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:33:13.961540 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e3b0c7-1973-4406-85c6-5992d559ec4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:33:14.032402 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-56e3b0c7-1973-4406-85c6-5992d559ec4a None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:33:14.033579 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-56e3b0c7-1973-4406-85c6-5992d559ec4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:33:14.125184 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:33:14.138979 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 671/1340] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 14:33:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:33:14.178489 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435a2032-a1d2-4cfb-8e81-4805ad654c68 None None] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:33:14.180610 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-435a2032-a1d2-4cfb-8e81-4805ad654c68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:33:14.232224 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:33:14.280340 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435a2032-a1d2-4cfb-8e81-4805ad654c68 None None] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:33:14.283931 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3446def-85e4-4bf8-a719-64493df0c4bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b68eed985c7b49839bcdd173186ad4ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfe93ee8d32a441295efc0b885de4bd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:33:14.284581 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3446def-85e4-4bf8-a719-64493df0c4bb service neutron] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:33:14.284864 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3446def-85e4-4bf8-a719-64493df0c4bb service neutron] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:33:14.285141 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3446def-85e4-4bf8-a719-64493df0c4bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:33:14.294869 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3446def-85e4-4bf8-a719-64493df0c4bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:33:14.296352 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3446def-85e4-4bf8-a719-64493df0c4bb service neutron] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:33:14.305775 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 670/1341] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 14:33:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:33:17.168420 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520b7f78-ba19-499c-bcb9-c35e2c9c2099 None None] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:33:17.168930 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520b7f78-ba19-499c-bcb9-c35e2c9c2099 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:33:17.168930 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520b7f78-ba19-499c-bcb9-c35e2c9c2099 None None] PATH_INFO: `/` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:33:17.170262 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 672/1342] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 14:33:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:33:17.175644 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9d5b3f-22dd-41d3-8aef-3b19f73a9fc1 None None] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:33:17.176071 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9d5b3f-22dd-41d3-8aef-3b19f73a9fc1 None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:33:17.176219 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9d5b3f-22dd-41d3-8aef-3b19f73a9fc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:33:17.203533 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.auth.core [None req-9b9d5b3f-22dd-41d3-8aef-3b19f73a9fc1 None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:33:17.204717 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-9b9d5b3f-22dd-41d3-8aef-3b19f73a9fc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:33:17.282972 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 671/1343] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 14:33:17 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:33:17.324613 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520b7f78-ba19-499c-bcb9-c35e2c9c2099 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:33:17.335192 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520b7f78-ba19-499c-bcb9-c35e2c9c2099 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:33:17.339367 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb26729-50d0-4bbe-94ea-114376bd5ac1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b68eed985c7b49839bcdd173186ad4ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfe93ee8d32a441295efc0b885de4bd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:33:17.340006 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb26729-50d0-4bbe-94ea-114376bd5ac1 service neutron] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:33:17.340292 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb26729-50d0-4bbe-94ea-114376bd5ac1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:33:17.340571 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb26729-50d0-4bbe-94ea-114376bd5ac1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:33:17.349921 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb26729-50d0-4bbe-94ea-114376bd5ac1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:33:17.351395 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb26729-50d0-4bbe-94ea-114376bd5ac1 service neutron] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:33:17.361609 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 673/1344] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 14:33:17 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:33:21.553297 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af0d43b-5379-432c-a7c7-6e056a85284f None None] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:33:21.553815 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af0d43b-5379-432c-a7c7-6e056a85284f None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:33:21.553927 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af0d43b-5379-432c-a7c7-6e056a85284f None None] PATH_INFO: `/` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:33:21.555251 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 672/1345] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 14:33:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:33:21.560476 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8fe382-c2c6-4f2a-800a-e9ed49252cb3 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:33:21.560892 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8fe382-c2c6-4f2a-800a-e9ed49252cb3 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:33:21.561031 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8fe382-c2c6-4f2a-800a-e9ed49252cb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:33:21.579188 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-4a8fe382-c2c6-4f2a-800a-e9ed49252cb3 None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:33:21.580309 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-4a8fe382-c2c6-4f2a-800a-e9ed49252cb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:33:21.589427 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 674/1346] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 14:33:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:33:21.626549 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af0d43b-5379-432c-a7c7-6e056a85284f None None] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:33:21.637208 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af0d43b-5379-432c-a7c7-6e056a85284f None None] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:33:21.640713 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e431b4-7ceb-42c7-b7ba-dd92bd3fa916 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b68eed985c7b49839bcdd173186ad4ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfe93ee8d32a441295efc0b885de4bd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:33:21.641348 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e431b4-7ceb-42c7-b7ba-dd92bd3fa916 service neutron] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:33:21.641636 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e431b4-7ceb-42c7-b7ba-dd92bd3fa916 service neutron] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:33:21.641913 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e431b4-7ceb-42c7-b7ba-dd92bd3fa916 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:33:21.651414 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e431b4-7ceb-42c7-b7ba-dd92bd3fa916 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:33:21.652832 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e431b4-7ceb-42c7-b7ba-dd92bd3fa916 service neutron] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:33:21.662150 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 673/1347] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 14:33:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:33:27.054444 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e56290-3989-4b13-a5a7-bbf2b2f8c9e7 None None] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:33:27.054939 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e56290-3989-4b13-a5a7-bbf2b2f8c9e7 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:33:27.055054 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e56290-3989-4b13-a5a7-bbf2b2f8c9e7 None None] PATH_INFO: `/` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:33:27.056950 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 675/1348] 10.222.0.67 () {54 vars in 921 bytes} [Wed May 25 14:33:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:33:27.062284 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87fa573-de2d-4f1a-816e-01efde152ff7 None None] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:33:27.063087 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87fa573-de2d-4f1a-816e-01efde152ff7 None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:33:27.063567 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87fa573-de2d-4f1a-816e-01efde152ff7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:33:27.147910 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.auth.core [None req-c87fa573-de2d-4f1a-816e-01efde152ff7 None None] MFA Rules not processed for user `ad2b99c2122a4311996364e982e1c801`. Rule list: `[]` (Enabled: `True`). {{(pid=80474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:33:27.150465 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-c87fa573-de2d-4f1a-816e-01efde152ff7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:33:27.180219 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:33:27.241182 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 674/1349] 10.222.0.67 () {58 vars in 1018 bytes} [Wed May 25 14:33:27 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:33:31.575442 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=13 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:33:31.645481 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9d5467-521e-4010-808e-72ac8e25006f None None] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:33:31.645860 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9d5467-521e-4010-808e-72ac8e25006f None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:33:31.646067 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9d5467-521e-4010-808e-72ac8e25006f None None] PATH_INFO: `/` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:33:31.647684 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 676/1350] 10.222.0.67 () {54 vars in 921 bytes} [Wed May 25 14:33:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:33:31.652645 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e73eacc-ebdc-4cfc-bfd5-32a8431b3da4 None None] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:33:31.653549 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e73eacc-ebdc-4cfc-bfd5-32a8431b3da4 None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:33:31.654046 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e73eacc-ebdc-4cfc-bfd5-32a8431b3da4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:33:31.676837 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.auth.core [None req-5e73eacc-ebdc-4cfc-bfd5-32a8431b3da4 None None] MFA Rules not processed for user `ad2b99c2122a4311996364e982e1c801`. Rule list: `[]` (Enabled: `True`). {{(pid=80474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:33:31.678699 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-5e73eacc-ebdc-4cfc-bfd5-32a8431b3da4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:33:31.688932 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 675/1351] 10.222.0.67 () {58 vars in 1018 bytes} [Wed May 25 14:33:31 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:33:33.328588 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1784f2c4-0281-4e8e-adc3-bb3bc106b6f5 None None] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:33:33.329113 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1784f2c4-0281-4e8e-adc3-bb3bc106b6f5 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:33:33.329208 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1784f2c4-0281-4e8e-adc3-bb3bc106b6f5 None None] PATH_INFO: `/` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:33:33.330551 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 677/1352] 10.222.0.67 () {54 vars in 921 bytes} [Wed May 25 14:33:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:33:33.335691 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76e6415-2d49-4508-8ed5-bd9b14c5b5dc None None] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:33:33.336094 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76e6415-2d49-4508-8ed5-bd9b14c5b5dc None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:33:33.336245 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76e6415-2d49-4508-8ed5-bd9b14c5b5dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:33:33.354961 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.auth.core [None req-c76e6415-2d49-4508-8ed5-bd9b14c5b5dc None None] MFA Rules not processed for user `ad2b99c2122a4311996364e982e1c801`. Rule list: `[]` (Enabled: `True`). {{(pid=80474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:33:33.356223 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-c76e6415-2d49-4508-8ed5-bd9b14c5b5dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:33:33.364819 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 676/1353] 10.222.0.67 () {58 vars in 1018 bytes} [Wed May 25 14:33:33 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 14:33:37.270484 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48e0570-d996-4945-8cfa-9811af3e93d6 None None] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:33:37.271371 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48e0570-d996-4945-8cfa-9811af3e93d6 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:33:37.271845 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48e0570-d996-4945-8cfa-9811af3e93d6 None None] PATH_INFO: `/` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:33:37.279377 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0bb746-b23d-4222-8783-3b530b549136 None None] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:33:37.279988 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0bb746-b23d-4222-8783-3b530b549136 None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:33:37.280228 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0bb746-b23d-4222-8783-3b530b549136 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:33:37.281928 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 678/1354] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 14:33:37 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:33:37.299514 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.auth.core [None req-bd0bb746-b23d-4222-8783-3b530b549136 None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:33:37.300953 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-bd0bb746-b23d-4222-8783-3b530b549136 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:33:37.319649 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 677/1355] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 14:33:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:33:37.374779 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0cccb4-eca8-40e3-b3c9-1632079e47bc None None] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:33:37.375954 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0cccb4-eca8-40e3-b3c9-1632079e47bc None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:33:37.376424 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0cccb4-eca8-40e3-b3c9-1632079e47bc None None] PATH_INFO: `/` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:33:37.378041 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 679/1356] 10.222.0.67 () {54 vars in 961 bytes} [Wed May 25 14:33:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:33:37.388656 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ca7511-53de-4041-bc67-5b25369b69af None None] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:33:37.389415 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ca7511-53de-4041-bc67-5b25369b69af None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:33:37.389872 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ca7511-53de-4041-bc67-5b25369b69af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:33:37.446940 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.auth.core [None req-29ca7511-53de-4041-bc67-5b25369b69af None None] MFA Rules not processed for user `428ec99478284743943ed41e9d24a603`. Rule list: `[]` (Enabled: `True`). {{(pid=80474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:33:37.448150 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-29ca7511-53de-4041-bc67-5b25369b69af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:33:37.536464 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 678/1357] 10.222.0.67 () {58 vars in 1058 bytes} [Wed May 25 14:33:37 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:33:37.545213 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0cccb4-eca8-40e3-b3c9-1632079e47bc None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:33:37.560030 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0cccb4-eca8-40e3-b3c9-1632079e47bc None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:33:37.565347 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339a4ce5-4b6c-4eb4-99b2-0e0dca99d67a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '428ec99478284743943ed41e9d24a603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfe93ee8d32a441295efc0b885de4bd7', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:33:37.565981 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339a4ce5-4b6c-4eb4-99b2-0e0dca99d67a service nova] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:33:37.566265 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339a4ce5-4b6c-4eb4-99b2-0e0dca99d67a service nova] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:33:37.566541 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339a4ce5-4b6c-4eb4-99b2-0e0dca99d67a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:33:37.575817 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339a4ce5-4b6c-4eb4-99b2-0e0dca99d67a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:33:37.577532 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339a4ce5-4b6c-4eb4-99b2-0e0dca99d67a service nova] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:33:37.588914 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 680/1358] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 14:33:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:33:40.037778 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4527fea7-e0f9-488c-a509-52b000775cf8 None None] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:33:40.038347 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4527fea7-e0f9-488c-a509-52b000775cf8 None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:33:40.038347 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4527fea7-e0f9-488c-a509-52b000775cf8 None None] PATH_INFO: `/` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:33:40.040657 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 679/1359] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 14:33:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:33:40.045679 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b59a69-43b0-473c-bd97-733e4e9a7bb5 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:33:40.046148 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b59a69-43b0-473c-bd97-733e4e9a7bb5 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:33:40.046390 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b59a69-43b0-473c-bd97-733e4e9a7bb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:33:40.066046 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-b7b59a69-43b0-473c-bd97-733e4e9a7bb5 None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:33:40.067579 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-b7b59a69-43b0-473c-bd97-733e4e9a7bb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:33:40.082414 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 681/1360] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 14:33:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:33:40.120183 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4527fea7-e0f9-488c-a509-52b000775cf8 None None] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:33:40.135727 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4527fea7-e0f9-488c-a509-52b000775cf8 None None] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:33:40.141304 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023ad957-2bd5-4009-9911-4d05115788b7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '428ec99478284743943ed41e9d24a603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfe93ee8d32a441295efc0b885de4bd7', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:33:40.142369 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023ad957-2bd5-4009-9911-4d05115788b7 service nova] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:33:40.142722 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023ad957-2bd5-4009-9911-4d05115788b7 service nova] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:33:40.143125 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023ad957-2bd5-4009-9911-4d05115788b7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:33:40.154931 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023ad957-2bd5-4009-9911-4d05115788b7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:33:40.155793 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023ad957-2bd5-4009-9911-4d05115788b7 service nova] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:33:40.167440 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 680/1361] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 14:33:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:33:42.755180 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf98bd73-4060-4b7a-8fd9-7dfb1b7f5984 None None] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:33:42.755711 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf98bd73-4060-4b7a-8fd9-7dfb1b7f5984 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:33:42.755711 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf98bd73-4060-4b7a-8fd9-7dfb1b7f5984 None None] PATH_INFO: `/` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:33:42.757103 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 682/1362] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 14:33:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:33:42.762257 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca598705-e41b-4ae3-a08a-ec07638af554 None None] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:33:42.763078 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca598705-e41b-4ae3-a08a-ec07638af554 None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:33:42.763513 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca598705-e41b-4ae3-a08a-ec07638af554 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:33:42.782638 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.auth.core [None req-ca598705-e41b-4ae3-a08a-ec07638af554 None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:33:42.783870 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-ca598705-e41b-4ae3-a08a-ec07638af554 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:33:42.792174 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 681/1363] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 14:33:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:33:42.836901 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3829ca-ab89-4ecd-ba2e-8b878bbe0d3e None None] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:33:42.837223 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3829ca-ab89-4ecd-ba2e-8b878bbe0d3e None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:33:42.837591 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3829ca-ab89-4ecd-ba2e-8b878bbe0d3e None None] PATH_INFO: `/` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:33:42.838972 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 683/1364] 10.222.0.67 () {54 vars in 961 bytes} [Wed May 25 14:33:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:33:42.846793 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d25157d-fe65-4295-90ce-ae0fd1e24058 None None] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:33:42.847135 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d25157d-fe65-4295-90ce-ae0fd1e24058 None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:33:42.847744 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d25157d-fe65-4295-90ce-ae0fd1e24058 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:33:42.872305 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.auth.core [None req-7d25157d-fe65-4295-90ce-ae0fd1e24058 None None] MFA Rules not processed for user `428ec99478284743943ed41e9d24a603`. Rule list: `[]` (Enabled: `True`). {{(pid=80474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:33:42.876485 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-7d25157d-fe65-4295-90ce-ae0fd1e24058 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:33:42.896421 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 682/1365] 10.222.0.67 () {58 vars in 1058 bytes} [Wed May 25 14:33:42 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:33:42.905980 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3829ca-ab89-4ecd-ba2e-8b878bbe0d3e None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:33:42.920973 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3829ca-ab89-4ecd-ba2e-8b878bbe0d3e None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:33:42.926306 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca20b39a-5f31-44f4-be02-f08dcea2c1e0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '428ec99478284743943ed41e9d24a603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfe93ee8d32a441295efc0b885de4bd7', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:33:42.926938 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca20b39a-5f31-44f4-be02-f08dcea2c1e0 service nova] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:33:42.927248 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca20b39a-5f31-44f4-be02-f08dcea2c1e0 service nova] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:33:42.927522 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca20b39a-5f31-44f4-be02-f08dcea2c1e0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:33:42.936583 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca20b39a-5f31-44f4-be02-f08dcea2c1e0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:33:42.938157 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca20b39a-5f31-44f4-be02-f08dcea2c1e0 service nova] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:33:42.947701 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 684/1366] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 14:33:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:33:45.245194 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61474f42-2dfa-4bba-9243-cf163ebd0ebc None None] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:33:45.245696 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61474f42-2dfa-4bba-9243-cf163ebd0ebc None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:33:45.245961 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61474f42-2dfa-4bba-9243-cf163ebd0ebc None None] PATH_INFO: `/` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:33:45.247577 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 683/1367] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 14:33:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:33:45.253149 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b144fa-8a86-4d3d-8747-2892d780c67b None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:33:45.253898 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b144fa-8a86-4d3d-8747-2892d780c67b None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:33:45.254194 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b144fa-8a86-4d3d-8747-2892d780c67b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:33:45.272610 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-91b144fa-8a86-4d3d-8747-2892d780c67b None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:33:45.274360 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-91b144fa-8a86-4d3d-8747-2892d780c67b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:33:45.282333 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 685/1368] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 14:33:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:33:45.327443 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61474f42-2dfa-4bba-9243-cf163ebd0ebc None None] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:33:45.343173 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61474f42-2dfa-4bba-9243-cf163ebd0ebc None None] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:33:45.348718 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10815acf-04ee-44c4-8a7a-b42dad4a6788 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '428ec99478284743943ed41e9d24a603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfe93ee8d32a441295efc0b885de4bd7', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:33:45.349464 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10815acf-04ee-44c4-8a7a-b42dad4a6788 service nova] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:33:45.349851 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10815acf-04ee-44c4-8a7a-b42dad4a6788 service nova] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:33:45.350231 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10815acf-04ee-44c4-8a7a-b42dad4a6788 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:33:45.359619 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10815acf-04ee-44c4-8a7a-b42dad4a6788 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:33:45.361311 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10815acf-04ee-44c4-8a7a-b42dad4a6788 service nova] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:33:45.372031 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 684/1369] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 14:33:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:33:45.598025 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8b1606-42bf-4d12-84ca-8c27b8becb17 None None] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:33:45.598304 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8b1606-42bf-4d12-84ca-8c27b8becb17 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:33:45.598575 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8b1606-42bf-4d12-84ca-8c27b8becb17 None None] PATH_INFO: `/` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:33:45.600187 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 686/1370] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 14:33:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:33:45.606315 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b207d84d-2398-44ae-b150-02c2acb4705d None None] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:33:45.606626 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b207d84d-2398-44ae-b150-02c2acb4705d None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:33:45.606911 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b207d84d-2398-44ae-b150-02c2acb4705d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:33:45.626855 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.auth.core [None req-b207d84d-2398-44ae-b150-02c2acb4705d None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:33:45.628242 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-b207d84d-2398-44ae-b150-02c2acb4705d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:33:45.636917 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 685/1371] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 14:33:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:33:45.943701 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d69e11c-1a7e-456f-8ab7-bd412ad7f9df None None] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:33:45.943701 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d69e11c-1a7e-456f-8ab7-bd412ad7f9df None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:33:45.944014 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d69e11c-1a7e-456f-8ab7-bd412ad7f9df None None] PATH_INFO: `/` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:33:45.945410 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 687/1372] 10.222.0.67 () {54 vars in 963 bytes} [Wed May 25 14:33:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:33:45.952196 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96075abb-df0d-4869-ba78-aab347e0a0d9 None None] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:33:45.952604 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96075abb-df0d-4869-ba78-aab347e0a0d9 None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:33:45.952988 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96075abb-df0d-4869-ba78-aab347e0a0d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:33:45.960376 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:33:46.015760 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.auth.core [None req-96075abb-df0d-4869-ba78-aab347e0a0d9 None None] MFA Rules not processed for user `6e462acc9da84a61bb23998dd54e1858`. Rule list: `[]` (Enabled: `True`). {{(pid=80474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:33:46.017234 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-96075abb-df0d-4869-ba78-aab347e0a0d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:33:46.082828 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 686/1373] 10.222.0.67 () {58 vars in 1060 bytes} [Wed May 25 14:33:45 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 14:33:46.092934 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d69e11c-1a7e-456f-8ab7-bd412ad7f9df None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:33:46.103672 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d69e11c-1a7e-456f-8ab7-bd412ad7f9df None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:33:46.107114 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4b7ddc-431e-4d2a-9930-aa6079c2b1e3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e462acc9da84a61bb23998dd54e1858', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfe93ee8d32a441295efc0b885de4bd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:33:46.107756 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4b7ddc-431e-4d2a-9930-aa6079c2b1e3 service cinder] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:33:46.108037 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4b7ddc-431e-4d2a-9930-aa6079c2b1e3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:33:46.108308 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4b7ddc-431e-4d2a-9930-aa6079c2b1e3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:33:46.117869 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4b7ddc-431e-4d2a-9930-aa6079c2b1e3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:33:46.119348 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4b7ddc-431e-4d2a-9930-aa6079c2b1e3 service cinder] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:33:46.129298 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 688/1374] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 14:33:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:33:47.679473 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee254dfa-dac3-425d-9ce4-7afe4fffa6dc None None] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:33:47.679982 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee254dfa-dac3-425d-9ce4-7afe4fffa6dc None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:33:47.680212 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee254dfa-dac3-425d-9ce4-7afe4fffa6dc None None] PATH_INFO: `/` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:33:47.682086 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 687/1375] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 14:33:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:33:47.687946 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d9b25f-e3de-48aa-b144-93ff721e6703 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:33:47.688530 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d9b25f-e3de-48aa-b144-93ff721e6703 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:33:47.688530 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d9b25f-e3de-48aa-b144-93ff721e6703 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:33:47.713734 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-82d9b25f-e3de-48aa-b144-93ff721e6703 None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:33:47.714896 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-82d9b25f-e3de-48aa-b144-93ff721e6703 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:33:47.722974 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 689/1376] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 14:33:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:33:47.770560 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee254dfa-dac3-425d-9ce4-7afe4fffa6dc None None] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:33:47.786260 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee254dfa-dac3-425d-9ce4-7afe4fffa6dc None None] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:33:47.792793 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8511c85-934c-4ad0-af25-a12732de9739 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '428ec99478284743943ed41e9d24a603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfe93ee8d32a441295efc0b885de4bd7', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:33:47.793461 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8511c85-934c-4ad0-af25-a12732de9739 service nova] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:33:47.793747 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8511c85-934c-4ad0-af25-a12732de9739 service nova] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:33:47.794029 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8511c85-934c-4ad0-af25-a12732de9739 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:33:47.803170 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8511c85-934c-4ad0-af25-a12732de9739 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:33:47.804848 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8511c85-934c-4ad0-af25-a12732de9739 service nova] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:33:47.815552 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 688/1377] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 14:33:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:33:50.086758 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71a6035-a0ef-4433-bf50-b60465690149 None None] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:33:50.087398 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71a6035-a0ef-4433-bf50-b60465690149 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:33:50.087398 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71a6035-a0ef-4433-bf50-b60465690149 None None] PATH_INFO: `/` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:33:50.088708 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 690/1378] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 14:33:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:33:50.094126 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fb0095-3ed0-43c3-84d0-2963e645753e None None] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:33:50.094559 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fb0095-3ed0-43c3-84d0-2963e645753e None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:33:50.095226 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fb0095-3ed0-43c3-84d0-2963e645753e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:33:50.121615 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.auth.core [None req-61fb0095-3ed0-43c3-84d0-2963e645753e None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:33:50.123628 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-61fb0095-3ed0-43c3-84d0-2963e645753e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:33:50.132698 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 689/1379] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 14:33:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:33:50.181237 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71a6035-a0ef-4433-bf50-b60465690149 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:33:50.200458 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71a6035-a0ef-4433-bf50-b60465690149 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:33:50.206513 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967b0703-e09b-43c1-8175-e51a34d8342f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '428ec99478284743943ed41e9d24a603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfe93ee8d32a441295efc0b885de4bd7', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:33:50.207535 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967b0703-e09b-43c1-8175-e51a34d8342f service nova] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:33:50.208279 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967b0703-e09b-43c1-8175-e51a34d8342f service nova] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:33:50.208853 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967b0703-e09b-43c1-8175-e51a34d8342f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:33:50.219641 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967b0703-e09b-43c1-8175-e51a34d8342f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:33:50.221536 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967b0703-e09b-43c1-8175-e51a34d8342f service nova] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:33:50.243445 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 691/1380] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 14:33:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:33:52.542328 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198cb1f4-9541-4372-847f-162f0a747056 None None] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:33:52.542916 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198cb1f4-9541-4372-847f-162f0a747056 None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:33:52.542916 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198cb1f4-9541-4372-847f-162f0a747056 None None] PATH_INFO: `/` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:33:52.544287 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 690/1381] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 14:33:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:33:52.549539 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81f5041-5e05-4660-bb13-065124c34c1c None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:33:52.549989 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81f5041-5e05-4660-bb13-065124c34c1c None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:33:52.550096 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81f5041-5e05-4660-bb13-065124c34c1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:33:52.569326 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-e81f5041-5e05-4660-bb13-065124c34c1c None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:33:52.571358 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-e81f5041-5e05-4660-bb13-065124c34c1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:33:52.580040 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 692/1382] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 14:33:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:33:52.626170 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198cb1f4-9541-4372-847f-162f0a747056 None None] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:33:52.642501 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198cb1f4-9541-4372-847f-162f0a747056 None None] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:33:52.648399 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8a038b-63c0-4cb6-9f7c-9be4f8d62f7f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '428ec99478284743943ed41e9d24a603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfe93ee8d32a441295efc0b885de4bd7', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:33:52.649409 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8a038b-63c0-4cb6-9f7c-9be4f8d62f7f service nova] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:33:52.649753 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8a038b-63c0-4cb6-9f7c-9be4f8d62f7f service nova] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:33:52.650038 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8a038b-63c0-4cb6-9f7c-9be4f8d62f7f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:33:52.659273 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8a038b-63c0-4cb6-9f7c-9be4f8d62f7f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:33:52.660956 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8a038b-63c0-4cb6-9f7c-9be4f8d62f7f service nova] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:33:52.671811 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 691/1383] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 14:33:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 14:33:54.915527 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c918772a-9285-4398-964e-0ad9ad5f7aab None None] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:33:54.916049 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c918772a-9285-4398-964e-0ad9ad5f7aab None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:33:54.916049 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c918772a-9285-4398-964e-0ad9ad5f7aab None None] PATH_INFO: `/` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:33:54.917395 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 693/1384] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 14:33:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:33:54.922662 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10ab46f-5fe3-436a-9ba8-dbcb5fdb0b06 None None] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:33:54.923125 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10ab46f-5fe3-436a-9ba8-dbcb5fdb0b06 None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:33:54.923247 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10ab46f-5fe3-436a-9ba8-dbcb5fdb0b06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:33:54.941729 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.auth.core [None req-a10ab46f-5fe3-436a-9ba8-dbcb5fdb0b06 None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:33:54.942918 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-a10ab46f-5fe3-436a-9ba8-dbcb5fdb0b06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:33:54.950792 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 692/1385] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 14:33:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:33:54.994547 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c918772a-9285-4398-964e-0ad9ad5f7aab None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:33:55.009257 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c918772a-9285-4398-964e-0ad9ad5f7aab None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:33:55.014671 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77363f72-f75a-4bdd-9d6b-b8f895934e67 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '428ec99478284743943ed41e9d24a603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfe93ee8d32a441295efc0b885de4bd7', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:33:55.015342 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77363f72-f75a-4bdd-9d6b-b8f895934e67 service nova] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:33:55.015630 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77363f72-f75a-4bdd-9d6b-b8f895934e67 service nova] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:33:55.015914 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77363f72-f75a-4bdd-9d6b-b8f895934e67 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:33:55.024662 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77363f72-f75a-4bdd-9d6b-b8f895934e67 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:33:55.026260 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77363f72-f75a-4bdd-9d6b-b8f895934e67 service nova] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:33:55.036014 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 694/1386] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 14:33:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:33:57.297670 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194c6ce2-7de1-4b8a-9e3f-dfe037928ef7 None None] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:33:57.298206 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194c6ce2-7de1-4b8a-9e3f-dfe037928ef7 None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:33:57.298206 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194c6ce2-7de1-4b8a-9e3f-dfe037928ef7 None None] PATH_INFO: `/` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:33:57.299654 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 693/1387] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 14:33:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:33:57.306096 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ec0447-1ca6-4084-bd62-7bddf4099edc None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:33:57.306565 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ec0447-1ca6-4084-bd62-7bddf4099edc None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:33:57.306691 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ec0447-1ca6-4084-bd62-7bddf4099edc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:33:57.325761 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-b3ec0447-1ca6-4084-bd62-7bddf4099edc None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:33:57.327287 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-b3ec0447-1ca6-4084-bd62-7bddf4099edc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:33:57.336899 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 695/1388] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 14:33:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:33:57.381557 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194c6ce2-7de1-4b8a-9e3f-dfe037928ef7 None None] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:33:57.395888 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194c6ce2-7de1-4b8a-9e3f-dfe037928ef7 None None] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:33:57.402487 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcfceb4-d850-40cb-92b3-e86bc2cd6641 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '428ec99478284743943ed41e9d24a603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfe93ee8d32a441295efc0b885de4bd7', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:33:57.403181 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcfceb4-d850-40cb-92b3-e86bc2cd6641 service nova] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:33:57.403475 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcfceb4-d850-40cb-92b3-e86bc2cd6641 service nova] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:33:57.403756 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcfceb4-d850-40cb-92b3-e86bc2cd6641 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:33:57.412835 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bcfceb4-d850-40cb-92b3-e86bc2cd6641 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:33:57.415127 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bcfceb4-d850-40cb-92b3-e86bc2cd6641 service nova] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:33:57.425046 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 694/1389] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 14:33:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:33:59.706382 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787b4380-769c-43cb-8c10-d785988ca665 None None] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:33:59.707070 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787b4380-769c-43cb-8c10-d785988ca665 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:33:59.707178 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787b4380-769c-43cb-8c10-d785988ca665 None None] PATH_INFO: `/` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:33:59.708911 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 696/1390] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 14:33:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:33:59.716181 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0081b7bc-7647-4bf3-8be8-6e749ec5f2f4 None None] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:33:59.716656 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0081b7bc-7647-4bf3-8be8-6e749ec5f2f4 None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:33:59.716910 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0081b7bc-7647-4bf3-8be8-6e749ec5f2f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:33:59.736673 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.auth.core [None req-0081b7bc-7647-4bf3-8be8-6e749ec5f2f4 None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:33:59.738284 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-0081b7bc-7647-4bf3-8be8-6e749ec5f2f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:33:59.751757 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 695/1391] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 14:33:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:33:59.797438 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787b4380-769c-43cb-8c10-d785988ca665 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:33:59.812206 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787b4380-769c-43cb-8c10-d785988ca665 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:33:59.817900 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dee3b64-317a-4d45-830b-da1e295b5544 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '428ec99478284743943ed41e9d24a603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfe93ee8d32a441295efc0b885de4bd7', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:33:59.818539 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dee3b64-317a-4d45-830b-da1e295b5544 service nova] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:33:59.818826 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dee3b64-317a-4d45-830b-da1e295b5544 service nova] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:33:59.819123 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dee3b64-317a-4d45-830b-da1e295b5544 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:33:59.830496 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dee3b64-317a-4d45-830b-da1e295b5544 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:33:59.832266 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dee3b64-317a-4d45-830b-da1e295b5544 service nova] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:33:59.843670 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 697/1392] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 14:33:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:34:01.995220 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e30e58-87e1-4622-b2b5-ea826c21e4b7 None None] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:34:01.995783 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e30e58-87e1-4622-b2b5-ea826c21e4b7 None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:34:01.995783 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e30e58-87e1-4622-b2b5-ea826c21e4b7 None None] PATH_INFO: `/` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:34:01.997153 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 696/1393] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 14:34:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:34:02.002771 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39cfd9c-22dd-488c-a616-7b7ec0c3a468 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:34:02.003225 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39cfd9c-22dd-488c-a616-7b7ec0c3a468 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:34:02.003372 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39cfd9c-22dd-488c-a616-7b7ec0c3a468 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:34:02.009399 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=52 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:34:02.022083 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-d39cfd9c-22dd-488c-a616-7b7ec0c3a468 None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:34:02.023852 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-d39cfd9c-22dd-488c-a616-7b7ec0c3a468 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:34:02.031822 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 698/1394] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 14:34:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:34:02.090591 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f32ed73-38be-404e-a7ba-929266bdde83 None None] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:34:02.091049 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f32ed73-38be-404e-a7ba-929266bdde83 None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:34:02.091364 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f32ed73-38be-404e-a7ba-929266bdde83 None None] PATH_INFO: `/` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:34:02.092851 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 697/1395] 10.222.0.67 () {54 vars in 962 bytes} [Wed May 25 14:34:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:34:02.096215 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fce603c-c5a2-4735-af4f-2d2cdec37066 None None] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:34:02.096515 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fce603c-c5a2-4735-af4f-2d2cdec37066 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:34:02.096802 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fce603c-c5a2-4735-af4f-2d2cdec37066 None None] PATH_INFO: `/` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:34:02.097703 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c311a7a2-fbd0-40c9-9bf7-642a6781eac9 None None] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:34:02.097992 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c311a7a2-fbd0-40c9-9bf7-642a6781eac9 None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:34:02.098166 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 699/1396] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 14:34:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:34:02.098276 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c311a7a2-fbd0-40c9-9bf7-642a6781eac9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:34:02.104583 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3145b5-6cd7-48ef-b915-de41b5663b37 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:34:02.104736 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3145b5-6cd7-48ef-b915-de41b5663b37 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:34:02.104897 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3145b5-6cd7-48ef-b915-de41b5663b37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:34:02.122455 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-de3145b5-6cd7-48ef-b915-de41b5663b37 None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:34:02.123663 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-de3145b5-6cd7-48ef-b915-de41b5663b37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:34:02.131541 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 700/1397] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 14:34:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 14:34:02.149793 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.auth.core [None req-c311a7a2-fbd0-40c9-9bf7-642a6781eac9 None None] MFA Rules not processed for user `b5e4d67668ce40509e057f4f4c994521`. Rule list: `[]` (Enabled: `True`). {{(pid=80474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:34:02.151042 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-c311a7a2-fbd0-40c9-9bf7-642a6781eac9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:34:02.177685 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3145b5-6cd7-48ef-b915-de41b5663b37 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:34:02.190096 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3145b5-6cd7-48ef-b915-de41b5663b37 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:34:02.195331 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166da391-9a5d-470c-b672-d9d2c9f5fbd3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '428ec99478284743943ed41e9d24a603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfe93ee8d32a441295efc0b885de4bd7', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:34:02.195893 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166da391-9a5d-470c-b672-d9d2c9f5fbd3 service nova] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:34:02.196270 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166da391-9a5d-470c-b672-d9d2c9f5fbd3 service nova] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:34:02.196555 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166da391-9a5d-470c-b672-d9d2c9f5fbd3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:34:02.206109 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166da391-9a5d-470c-b672-d9d2c9f5fbd3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:34:02.207555 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:34:02.207768 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166da391-9a5d-470c-b672-d9d2c9f5fbd3 service nova] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:34:02.213643 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 698/1398] 10.222.0.67 () {58 vars in 1059 bytes} [Wed May 25 14:34:02 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 14:34:02.218486 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 701/1399] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 14:34:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 14:34:02.221026 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c311a7a2-fbd0-40c9-9bf7-642a6781eac9 None None] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:34:02.229445 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c311a7a2-fbd0-40c9-9bf7-642a6781eac9 None None] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:34:02.233521 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa384f29-70e4-4556-94f6-16d7fa33bea4 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5e4d67668ce40509e057f4f4c994521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfe93ee8d32a441295efc0b885de4bd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:34:02.234230 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa384f29-70e4-4556-94f6-16d7fa33bea4 service glance] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:34:02.234534 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa384f29-70e4-4556-94f6-16d7fa33bea4 service glance] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:34:02.234903 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa384f29-70e4-4556-94f6-16d7fa33bea4 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:34:02.245037 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa384f29-70e4-4556-94f6-16d7fa33bea4 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:34:02.246517 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa384f29-70e4-4556-94f6-16d7fa33bea4 service glance] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:34:02.256548 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 699/1400] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 14:34:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 14:34:02.800869 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ec3506-6827-4446-900c-06692184829d None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:34:02.801166 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ec3506-6827-4446-900c-06692184829d None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:34:02.801452 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ec3506-6827-4446-900c-06692184829d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:34:02.854149 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-c6ec3506-6827-4446-900c-06692184829d None None] MFA Rules not processed for user `e03f5bb82ffb41a1b1dde935d093e6f4`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:34:02.855412 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-c6ec3506-6827-4446-900c-06692184829d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:34:02.920716 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 702/1401] 10.222.0.67 () {58 vars in 1009 bytes} [Wed May 25 14:34:02 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:34:02.966245 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e15a45c-1eff-4904-a94b-ad4d7fdd2ce5 None None] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:34:02.966614 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e15a45c-1eff-4904-a94b-ad4d7fdd2ce5 None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:34:02.967006 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e15a45c-1eff-4904-a94b-ad4d7fdd2ce5 None None] PATH_INFO: `/` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:34:02.968487 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 700/1402] 10.222.0.67 () {54 vars in 942 bytes} [Wed May 25 14:34:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:34:02.974543 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a1ed8e-99fa-48cf-bbad-023525cbbf0f None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:34:02.974906 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a1ed8e-99fa-48cf-bbad-023525cbbf0f None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:34:02.975297 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a1ed8e-99fa-48cf-bbad-023525cbbf0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:34:03.024887 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-65a1ed8e-99fa-48cf-bbad-023525cbbf0f None None] MFA Rules not processed for user `dbe9e38881834198842a476889678096`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:34:03.026088 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-65a1ed8e-99fa-48cf-bbad-023525cbbf0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:34:03.102102 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 703/1403] 10.222.0.67 () {58 vars in 1039 bytes} [Wed May 25 14:34:02 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 14:34:03.111577 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e15a45c-1eff-4904-a94b-ad4d7fdd2ce5 None None] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:34:03.129054 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e15a45c-1eff-4904-a94b-ad4d7fdd2ce5 None None] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:34:03.136504 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f4f0db-7f78-4e90-8de6-598e0c3f10f8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbe9e38881834198842a476889678096', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfe93ee8d32a441295efc0b885de4bd7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:34:03.136504 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f4f0db-7f78-4e90-8de6-598e0c3f10f8 service swift] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:34:03.136770 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f4f0db-7f78-4e90-8de6-598e0c3f10f8 service swift] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:34:03.136997 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f4f0db-7f78-4e90-8de6-598e0c3f10f8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:34:03.145699 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f4f0db-7f78-4e90-8de6-598e0c3f10f8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:34:03.147314 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f4f0db-7f78-4e90-8de6-598e0c3f10f8 service swift] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:34:03.156133 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 701/1404] 10.222.0.67 () {60 vars in 1384 bytes} [Wed May 25 14:34:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 25 14:34:04.555953 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6831abdd-5798-4956-87fb-7bde3af4b70b None None] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:34:04.556506 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6831abdd-5798-4956-87fb-7bde3af4b70b None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:34:04.556506 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6831abdd-5798-4956-87fb-7bde3af4b70b None None] PATH_INFO: `/` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:34:04.559553 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 704/1405] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 14:34:04 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:34:04.563130 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4307cd-a4b0-4a5e-bebb-8d9dcb51ea95 None None] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:34:04.563551 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4307cd-a4b0-4a5e-bebb-8d9dcb51ea95 None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:34:04.563720 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4307cd-a4b0-4a5e-bebb-8d9dcb51ea95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:34:04.583824 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.auth.core [None req-8b4307cd-a4b0-4a5e-bebb-8d9dcb51ea95 None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:34:04.585044 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-8b4307cd-a4b0-4a5e-bebb-8d9dcb51ea95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:34:04.599403 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 702/1406] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 14:34:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:34:04.647231 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6831abdd-5798-4956-87fb-7bde3af4b70b None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:34:04.663667 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6831abdd-5798-4956-87fb-7bde3af4b70b None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:34:04.670328 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcaeec8b-a29c-4397-aff5-414471816f0f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '428ec99478284743943ed41e9d24a603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfe93ee8d32a441295efc0b885de4bd7', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:34:04.671741 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaeec8b-a29c-4397-aff5-414471816f0f service nova] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:34:04.671741 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaeec8b-a29c-4397-aff5-414471816f0f service nova] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:34:04.671741 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaeec8b-a29c-4397-aff5-414471816f0f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:34:04.681450 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcaeec8b-a29c-4397-aff5-414471816f0f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:34:04.683089 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcaeec8b-a29c-4397-aff5-414471816f0f service nova] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:34:04.687223 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:34:04.709971 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 705/1407] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 14:34:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:34:14.578013 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=16 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:34:14.693233 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=1 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:34:26.810038 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45570d1-21a2-4a36-99d0-84020378c06d None None] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:34:26.810680 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45570d1-21a2-4a36-99d0-84020378c06d None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:34:26.810680 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45570d1-21a2-4a36-99d0-84020378c06d None None] PATH_INFO: `/` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:34:26.812028 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 703/1408] 10.222.0.67 () {54 vars in 918 bytes} [Wed May 25 14:34:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:34:26.817171 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102dc18f-24d4-4951-8d4c-73f08ca8eaf7 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:34:26.817633 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102dc18f-24d4-4951-8d4c-73f08ca8eaf7 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:34:26.817787 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102dc18f-24d4-4951-8d4c-73f08ca8eaf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:34:26.835878 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-102dc18f-24d4-4951-8d4c-73f08ca8eaf7 None None] MFA Rules not processed for user `ad2b99c2122a4311996364e982e1c801`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:34:26.837389 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-102dc18f-24d4-4951-8d4c-73f08ca8eaf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:34:26.845864 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 706/1409] 10.222.0.67 () {58 vars in 1015 bytes} [Wed May 25 14:34:26 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:34:26.860469 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38da3c6-9d63-46b3-8b27-79a9150e6c90 None None] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:34:26.860771 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38da3c6-9d63-46b3-8b27-79a9150e6c90 None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:34:26.861044 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38da3c6-9d63-46b3-8b27-79a9150e6c90 None None] PATH_INFO: `/` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:34:26.862410 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 704/1410] 10.222.0.67 () {54 vars in 918 bytes} [Wed May 25 14:34:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:34:26.866784 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2192ad94-a07e-4f2f-9e63-1bfff376b64a None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:34:26.867103 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2192ad94-a07e-4f2f-9e63-1bfff376b64a None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:34:26.867383 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2192ad94-a07e-4f2f-9e63-1bfff376b64a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:34:26.885811 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-2192ad94-a07e-4f2f-9e63-1bfff376b64a None None] MFA Rules not processed for user `428ec99478284743943ed41e9d24a603`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:34:26.886985 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-2192ad94-a07e-4f2f-9e63-1bfff376b64a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:34:26.895984 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 707/1411] 10.222.0.67 () {58 vars in 1015 bytes} [Wed May 25 14:34:26 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:34:29.756819 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a281c1-8f7d-421e-9403-6e54ad66f382 None None] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:34:29.757395 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a281c1-8f7d-421e-9403-6e54ad66f382 None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:34:29.757395 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a281c1-8f7d-421e-9403-6e54ad66f382 None None] PATH_INFO: `/` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:34:29.758749 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 705/1412] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 25 14:34:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:34:29.764099 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880187eb-0c3b-47e9-ac39-a3428fd71e15 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:34:29.764525 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880187eb-0c3b-47e9-ac39-a3428fd71e15 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:34:29.764656 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880187eb-0c3b-47e9-ac39-a3428fd71e15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:34:29.782104 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-880187eb-0c3b-47e9-ac39-a3428fd71e15 None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:34:29.783315 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-880187eb-0c3b-47e9-ac39-a3428fd71e15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:34:29.791595 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 708/1413] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 25 14:34:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:34:29.834032 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a281c1-8f7d-421e-9403-6e54ad66f382 None None] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:34:29.849429 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a281c1-8f7d-421e-9403-6e54ad66f382 None None] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:34:29.857069 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fac225-5fe9-4b0f-af66-b6587fb61815 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '428ec99478284743943ed41e9d24a603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfe93ee8d32a441295efc0b885de4bd7', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:34:29.857851 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fac225-5fe9-4b0f-af66-b6587fb61815 service nova] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:34:29.858147 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fac225-5fe9-4b0f-af66-b6587fb61815 service nova] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:34:29.858429 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fac225-5fe9-4b0f-af66-b6587fb61815 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:34:29.866721 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fac225-5fe9-4b0f-af66-b6587fb61815 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:34:29.869217 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fac225-5fe9-4b0f-af66-b6587fb61815 service nova] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:34:29.878898 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 706/1414] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 14:34:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:34:30.849663 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1301ded6-70da-4bbd-a49c-7a1b2ff9a32d None None] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:34:30.850088 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1301ded6-70da-4bbd-a49c-7a1b2ff9a32d None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:34:30.850218 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1301ded6-70da-4bbd-a49c-7a1b2ff9a32d None None] PATH_INFO: `/` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:34:30.851734 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 709/1415] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 25 14:34:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:34:30.856739 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3f116d-e246-4589-a0c7-b52d7905a52d None None] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:34:30.857179 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3f116d-e246-4589-a0c7-b52d7905a52d None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:34:30.857308 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3f116d-e246-4589-a0c7-b52d7905a52d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:34:30.875488 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.auth.core [None req-0a3f116d-e246-4589-a0c7-b52d7905a52d None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:34:30.876947 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-0a3f116d-e246-4589-a0c7-b52d7905a52d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:34:30.885246 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 707/1416] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 25 14:34:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:34:31.051437 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1301ded6-70da-4bbd-a49c-7a1b2ff9a32d None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:34:31.066404 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1301ded6-70da-4bbd-a49c-7a1b2ff9a32d None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:34:31.072824 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b65ae95-a785-428f-88d2-b7942109c081 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '428ec99478284743943ed41e9d24a603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfe93ee8d32a441295efc0b885de4bd7', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:34:31.073481 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b65ae95-a785-428f-88d2-b7942109c081 service nova] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:34:31.073768 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b65ae95-a785-428f-88d2-b7942109c081 service nova] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:34:31.074047 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b65ae95-a785-428f-88d2-b7942109c081 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:34:31.082062 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b65ae95-a785-428f-88d2-b7942109c081 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:34:31.083684 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b65ae95-a785-428f-88d2-b7942109c081 service nova] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:34:31.093250 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 710/1417] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 14:34:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:34:32.017703 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d742032-543c-45d9-97ad-fee24ed502b8 None None] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:34:32.018268 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d742032-543c-45d9-97ad-fee24ed502b8 None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:34:32.018268 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d742032-543c-45d9-97ad-fee24ed502b8 None None] PATH_INFO: `/` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:34:32.019662 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 708/1418] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 25 14:34:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:34:32.025648 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b538962-ab97-4096-b950-d2723cc8d3bc None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:34:32.026096 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b538962-ab97-4096-b950-d2723cc8d3bc None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:34:32.026217 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b538962-ab97-4096-b950-d2723cc8d3bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:34:32.044159 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-0b538962-ab97-4096-b950-d2723cc8d3bc None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:34:32.045368 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-0b538962-ab97-4096-b950-d2723cc8d3bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:34:32.053191 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 711/1419] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 25 14:34:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:34:32.211457 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d742032-543c-45d9-97ad-fee24ed502b8 None None] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:34:32.226182 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d742032-543c-45d9-97ad-fee24ed502b8 None None] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:34:32.231982 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73012fc3-9c4b-4cb7-895c-3d39bf4a4910 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '428ec99478284743943ed41e9d24a603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfe93ee8d32a441295efc0b885de4bd7', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:34:32.232613 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73012fc3-9c4b-4cb7-895c-3d39bf4a4910 service nova] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:34:32.232899 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73012fc3-9c4b-4cb7-895c-3d39bf4a4910 service nova] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:34:32.233192 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73012fc3-9c4b-4cb7-895c-3d39bf4a4910 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:34:32.241141 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73012fc3-9c4b-4cb7-895c-3d39bf4a4910 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:34:32.243157 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73012fc3-9c4b-4cb7-895c-3d39bf4a4910 service nova] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:34:32.252632 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 709/1420] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 14:34:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:34:33.171488 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ac36ed-2db5-4367-ba4b-adf2155677e7 None None] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:34:33.172024 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ac36ed-2db5-4367-ba4b-adf2155677e7 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:34:33.172024 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ac36ed-2db5-4367-ba4b-adf2155677e7 None None] PATH_INFO: `/` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:34:33.173354 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 712/1421] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 25 14:34:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:34:33.178333 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca80176-c9d6-4d15-b99a-d82dc4c82adc None None] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:34:33.178726 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca80176-c9d6-4d15-b99a-d82dc4c82adc None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:34:33.178910 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca80176-c9d6-4d15-b99a-d82dc4c82adc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:34:33.197208 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.auth.core [None req-0ca80176-c9d6-4d15-b99a-d82dc4c82adc None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:34:33.198407 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-0ca80176-c9d6-4d15-b99a-d82dc4c82adc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:34:33.206172 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 710/1422] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 25 14:34:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:34:33.360956 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ac36ed-2db5-4367-ba4b-adf2155677e7 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:34:33.375530 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ac36ed-2db5-4367-ba4b-adf2155677e7 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:34:33.381068 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba3d913-3532-4e29-bca2-0664bc1419f9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '428ec99478284743943ed41e9d24a603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfe93ee8d32a441295efc0b885de4bd7', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:34:33.381716 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba3d913-3532-4e29-bca2-0664bc1419f9 service nova] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:34:33.381984 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba3d913-3532-4e29-bca2-0664bc1419f9 service nova] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:34:33.382264 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba3d913-3532-4e29-bca2-0664bc1419f9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:34:33.390775 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba3d913-3532-4e29-bca2-0664bc1419f9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:34:33.392384 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba3d913-3532-4e29-bca2-0664bc1419f9 service nova] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:34:33.402306 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 713/1423] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 14:34:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:34:34.316580 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5ab834-a319-4e02-9399-2b2ab5738c65 None None] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:34:34.317149 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5ab834-a319-4e02-9399-2b2ab5738c65 None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:34:34.317149 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5ab834-a319-4e02-9399-2b2ab5738c65 None None] PATH_INFO: `/` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:34:34.318495 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 711/1424] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 25 14:34:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:34:34.324146 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a518fec-ee28-4545-a38c-6621b6e95180 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:34:34.324598 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a518fec-ee28-4545-a38c-6621b6e95180 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:34:34.324717 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a518fec-ee28-4545-a38c-6621b6e95180 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:34:34.343374 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-5a518fec-ee28-4545-a38c-6621b6e95180 None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:34:34.344568 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-5a518fec-ee28-4545-a38c-6621b6e95180 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:34:34.352432 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 714/1425] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 25 14:34:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:34:34.502136 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5ab834-a319-4e02-9399-2b2ab5738c65 None None] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:34:34.517307 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5ab834-a319-4e02-9399-2b2ab5738c65 None None] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:34:34.522675 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd146022-9a95-48c3-aebe-e96c2b0eae06 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '428ec99478284743943ed41e9d24a603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfe93ee8d32a441295efc0b885de4bd7', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:34:34.523330 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd146022-9a95-48c3-aebe-e96c2b0eae06 service nova] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:34:34.524199 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd146022-9a95-48c3-aebe-e96c2b0eae06 service nova] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:34:34.524472 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd146022-9a95-48c3-aebe-e96c2b0eae06 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:34:34.532365 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd146022-9a95-48c3-aebe-e96c2b0eae06 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:34:34.533921 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd146022-9a95-48c3-aebe-e96c2b0eae06 service nova] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:34:34.543641 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 712/1426] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 14:34:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:34:35.414466 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8273d486-f437-4f11-93c7-2de710840721 None None] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:34:35.415074 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8273d486-f437-4f11-93c7-2de710840721 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:34:35.415074 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8273d486-f437-4f11-93c7-2de710840721 None None] PATH_INFO: `/` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:34:35.416478 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 715/1427] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 25 14:34:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:34:35.421322 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3cd665-f3fe-45a1-b154-521aa2317747 None None] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:34:35.421741 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3cd665-f3fe-45a1-b154-521aa2317747 None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:34:35.421883 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3cd665-f3fe-45a1-b154-521aa2317747 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:34:35.440475 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.auth.core [None req-de3cd665-f3fe-45a1-b154-521aa2317747 None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:34:35.441662 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-de3cd665-f3fe-45a1-b154-521aa2317747 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:34:35.450422 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 713/1428] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 25 14:34:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:34:35.605045 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8273d486-f437-4f11-93c7-2de710840721 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:34:35.620009 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8273d486-f437-4f11-93c7-2de710840721 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:34:35.625349 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cda16f-a5a1-4bd6-b759-8b1d681219b7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '428ec99478284743943ed41e9d24a603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfe93ee8d32a441295efc0b885de4bd7', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:34:35.626229 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cda16f-a5a1-4bd6-b759-8b1d681219b7 service nova] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:34:35.626511 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cda16f-a5a1-4bd6-b759-8b1d681219b7 service nova] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:34:35.626785 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cda16f-a5a1-4bd6-b759-8b1d681219b7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:34:35.635647 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82cda16f-a5a1-4bd6-b759-8b1d681219b7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:34:35.637213 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82cda16f-a5a1-4bd6-b759-8b1d681219b7 service nova] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:34:35.646510 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 716/1429] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 14:34:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:34:36.514387 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0dd9b3-1377-4714-bb40-77d5249b1757 None None] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:34:36.514962 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0dd9b3-1377-4714-bb40-77d5249b1757 None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:34:36.514962 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0dd9b3-1377-4714-bb40-77d5249b1757 None None] PATH_INFO: `/` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:34:36.516356 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 714/1430] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 25 14:34:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:34:36.521251 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa05486c-09c2-40dc-ba9e-9345254ec8ae None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:34:36.521690 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa05486c-09c2-40dc-ba9e-9345254ec8ae None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:34:36.521808 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa05486c-09c2-40dc-ba9e-9345254ec8ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:34:36.541126 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-aa05486c-09c2-40dc-ba9e-9345254ec8ae None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:34:36.542316 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-aa05486c-09c2-40dc-ba9e-9345254ec8ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:34:36.550008 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 717/1431] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 25 14:34:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:34:36.704482 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0dd9b3-1377-4714-bb40-77d5249b1757 None None] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:34:36.718877 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0dd9b3-1377-4714-bb40-77d5249b1757 None None] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:34:36.724215 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a40942b-0807-4c88-a7e3-f66e936163a1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '428ec99478284743943ed41e9d24a603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfe93ee8d32a441295efc0b885de4bd7', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:34:36.724853 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a40942b-0807-4c88-a7e3-f66e936163a1 service nova] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:34:36.725140 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a40942b-0807-4c88-a7e3-f66e936163a1 service nova] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:34:36.725420 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a40942b-0807-4c88-a7e3-f66e936163a1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:34:36.734281 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a40942b-0807-4c88-a7e3-f66e936163a1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:34:36.735890 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a40942b-0807-4c88-a7e3-f66e936163a1 service nova] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:34:36.745962 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 715/1432] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 14:34:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:34:37.593284 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c701d0-492b-4cc6-af9c-b7d2d535e103 None None] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:34:37.593854 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c701d0-492b-4cc6-af9c-b7d2d535e103 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:34:37.593854 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c701d0-492b-4cc6-af9c-b7d2d535e103 None None] PATH_INFO: `/` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:34:37.595305 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 718/1433] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 25 14:34:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:34:37.600330 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32840e0-cb68-4cf2-aa12-b7b0478a233e None None] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:34:37.600785 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32840e0-cb68-4cf2-aa12-b7b0478a233e None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:34:37.600901 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32840e0-cb68-4cf2-aa12-b7b0478a233e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:34:37.619245 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.auth.core [None req-d32840e0-cb68-4cf2-aa12-b7b0478a233e None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:34:37.620418 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-d32840e0-cb68-4cf2-aa12-b7b0478a233e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:34:37.628295 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 716/1434] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 25 14:34:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:34:37.779637 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c701d0-492b-4cc6-af9c-b7d2d535e103 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:34:37.794137 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c701d0-492b-4cc6-af9c-b7d2d535e103 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:34:37.799454 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b4d0dd-d29e-4866-9af2-3b44bb799412 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '428ec99478284743943ed41e9d24a603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfe93ee8d32a441295efc0b885de4bd7', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:34:37.800087 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b4d0dd-d29e-4866-9af2-3b44bb799412 service nova] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:34:37.800371 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b4d0dd-d29e-4866-9af2-3b44bb799412 service nova] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:34:37.800650 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b4d0dd-d29e-4866-9af2-3b44bb799412 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:34:37.809820 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b4d0dd-d29e-4866-9af2-3b44bb799412 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:34:37.811463 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b4d0dd-d29e-4866-9af2-3b44bb799412 service nova] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:34:37.821418 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 719/1435] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 14:34:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:34:38.671296 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3302031-a49a-4d17-b0b5-668beebe9985 None None] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:34:38.671891 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3302031-a49a-4d17-b0b5-668beebe9985 None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:34:38.671891 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3302031-a49a-4d17-b0b5-668beebe9985 None None] PATH_INFO: `/` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:34:38.673235 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 717/1436] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 25 14:34:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:34:38.678171 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9097d93-b74c-4a96-81fc-751d0b2b9431 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:34:38.678613 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9097d93-b74c-4a96-81fc-751d0b2b9431 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:34:38.678719 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9097d93-b74c-4a96-81fc-751d0b2b9431 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:34:38.697601 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-e9097d93-b74c-4a96-81fc-751d0b2b9431 None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:34:38.698772 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-e9097d93-b74c-4a96-81fc-751d0b2b9431 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:34:38.706643 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 720/1437] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 25 14:34:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:34:38.856241 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3302031-a49a-4d17-b0b5-668beebe9985 None None] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:34:38.870865 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3302031-a49a-4d17-b0b5-668beebe9985 None None] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:34:38.876432 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13e4583-32ab-4292-a319-a206f4d71ae9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '428ec99478284743943ed41e9d24a603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfe93ee8d32a441295efc0b885de4bd7', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:34:38.877071 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13e4583-32ab-4292-a319-a206f4d71ae9 service nova] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:34:38.877361 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13e4583-32ab-4292-a319-a206f4d71ae9 service nova] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:34:38.877643 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13e4583-32ab-4292-a319-a206f4d71ae9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:34:38.885960 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13e4583-32ab-4292-a319-a206f4d71ae9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:34:38.887596 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13e4583-32ab-4292-a319-a206f4d71ae9 service nova] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:34:38.896825 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 718/1438] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 14:34:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:34:40.981225 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078775cf-5a3e-4f4b-a594-c1f176b8fed7 None None] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:34:40.981785 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078775cf-5a3e-4f4b-a594-c1f176b8fed7 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:34:40.981785 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078775cf-5a3e-4f4b-a594-c1f176b8fed7 None None] PATH_INFO: `/` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:34:40.983185 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 721/1439] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 25 14:34:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:34:40.988580 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0b1671-1d4b-4daf-8c4b-c4d4353c54a9 None None] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:34:40.988991 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0b1671-1d4b-4daf-8c4b-c4d4353c54a9 None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:34:40.989148 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0b1671-1d4b-4daf-8c4b-c4d4353c54a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:34:41.007486 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.auth.core [None req-6e0b1671-1d4b-4daf-8c4b-c4d4353c54a9 None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:34:41.008752 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-6e0b1671-1d4b-4daf-8c4b-c4d4353c54a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:34:41.016492 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 719/1440] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 25 14:34:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:34:41.054013 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078775cf-5a3e-4f4b-a594-c1f176b8fed7 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:34:41.065402 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078775cf-5a3e-4f4b-a594-c1f176b8fed7 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:34:41.068867 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab28af69-2f3e-43b7-a261-03e8dbf9b3d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b68eed985c7b49839bcdd173186ad4ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfe93ee8d32a441295efc0b885de4bd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:34:41.069498 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab28af69-2f3e-43b7-a261-03e8dbf9b3d0 service neutron] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:34:41.069785 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab28af69-2f3e-43b7-a261-03e8dbf9b3d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:34:41.070072 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab28af69-2f3e-43b7-a261-03e8dbf9b3d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:34:41.079458 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab28af69-2f3e-43b7-a261-03e8dbf9b3d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:34:41.080891 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab28af69-2f3e-43b7-a261-03e8dbf9b3d0 service neutron] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:34:41.090638 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 722/1441] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 14:34:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:34:43.462451 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b285f45-c1f5-4ac8-908f-a94ff885892e None None] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:34:43.463037 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b285f45-c1f5-4ac8-908f-a94ff885892e None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:34:43.463037 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b285f45-c1f5-4ac8-908f-a94ff885892e None None] PATH_INFO: `/` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:34:43.464425 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 720/1442] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 25 14:34:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:34:43.469892 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c9fcff-e43b-4480-bc68-0cb74ab85200 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:34:43.470305 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c9fcff-e43b-4480-bc68-0cb74ab85200 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:34:43.470504 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c9fcff-e43b-4480-bc68-0cb74ab85200 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:34:43.488809 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-d3c9fcff-e43b-4480-bc68-0cb74ab85200 None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:34:43.489994 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-d3c9fcff-e43b-4480-bc68-0cb74ab85200 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:34:43.498168 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 723/1443] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 25 14:34:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:34:43.536507 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b285f45-c1f5-4ac8-908f-a94ff885892e None None] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:34:43.547105 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b285f45-c1f5-4ac8-908f-a94ff885892e None None] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:34:43.550566 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af37ab6e-d7dc-4705-af02-481c67064152 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b68eed985c7b49839bcdd173186ad4ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfe93ee8d32a441295efc0b885de4bd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:34:43.551232 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af37ab6e-d7dc-4705-af02-481c67064152 service neutron] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:34:43.551522 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af37ab6e-d7dc-4705-af02-481c67064152 service neutron] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:34:43.551801 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af37ab6e-d7dc-4705-af02-481c67064152 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:34:43.561237 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af37ab6e-d7dc-4705-af02-481c67064152 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:34:43.562664 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af37ab6e-d7dc-4705-af02-481c67064152 service neutron] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:34:43.572618 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 721/1444] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 14:34:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:34:46.080128 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f325ed-5182-4593-8066-64c47b0c2bbd None None] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:34:46.080689 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f325ed-5182-4593-8066-64c47b0c2bbd None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:34:46.080689 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f325ed-5182-4593-8066-64c47b0c2bbd None None] PATH_INFO: `/` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:34:46.082061 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 724/1445] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 25 14:34:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:34:46.088084 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf33228-b8c0-4545-94a9-218036a46267 None None] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:34:46.088522 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf33228-b8c0-4545-94a9-218036a46267 None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:34:46.088848 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf33228-b8c0-4545-94a9-218036a46267 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:34:46.110124 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.auth.core [None req-bdf33228-b8c0-4545-94a9-218036a46267 None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:34:46.111664 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-bdf33228-b8c0-4545-94a9-218036a46267 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:34:46.121803 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 722/1446] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 25 14:34:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:34:46.167109 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f325ed-5182-4593-8066-64c47b0c2bbd None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:34:46.178479 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f325ed-5182-4593-8066-64c47b0c2bbd None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:34:46.182647 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1f9365-c81e-43f5-bbb2-4ffca57d70d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b68eed985c7b49839bcdd173186ad4ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfe93ee8d32a441295efc0b885de4bd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:34:46.183317 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1f9365-c81e-43f5-bbb2-4ffca57d70d5 service neutron] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:34:46.183602 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1f9365-c81e-43f5-bbb2-4ffca57d70d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:34:46.183876 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1f9365-c81e-43f5-bbb2-4ffca57d70d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:34:46.192778 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1f9365-c81e-43f5-bbb2-4ffca57d70d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:34:46.194206 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1f9365-c81e-43f5-bbb2-4ffca57d70d5 service neutron] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:34:46.204214 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 725/1447] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 14:34:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:34:48.545482 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d845fabb-61c6-4de3-a53e-7e23b8bd1157 None None] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:34:48.546101 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d845fabb-61c6-4de3-a53e-7e23b8bd1157 None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:34:48.546101 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d845fabb-61c6-4de3-a53e-7e23b8bd1157 None None] PATH_INFO: `/` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:34:48.547474 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 723/1448] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 25 14:34:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:34:48.552708 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3692dc-84dd-4c6f-9ad8-5b1bf037b816 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:34:48.553115 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3692dc-84dd-4c6f-9ad8-5b1bf037b816 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:34:48.553268 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3692dc-84dd-4c6f-9ad8-5b1bf037b816 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:34:48.572350 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-dd3692dc-84dd-4c6f-9ad8-5b1bf037b816 None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:34:48.573541 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-dd3692dc-84dd-4c6f-9ad8-5b1bf037b816 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:34:48.581426 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 726/1449] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 25 14:34:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:34:48.620692 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d845fabb-61c6-4de3-a53e-7e23b8bd1157 None None] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:34:48.631754 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d845fabb-61c6-4de3-a53e-7e23b8bd1157 None None] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:34:48.635463 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7146133-c9d7-4b5b-ac0b-0b96f19bc01e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b68eed985c7b49839bcdd173186ad4ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfe93ee8d32a441295efc0b885de4bd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:34:48.636105 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7146133-c9d7-4b5b-ac0b-0b96f19bc01e service neutron] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:34:48.636395 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7146133-c9d7-4b5b-ac0b-0b96f19bc01e service neutron] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:34:48.636678 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7146133-c9d7-4b5b-ac0b-0b96f19bc01e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:34:48.645487 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7146133-c9d7-4b5b-ac0b-0b96f19bc01e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:34:48.646909 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7146133-c9d7-4b5b-ac0b-0b96f19bc01e service neutron] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:34:48.656449 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 724/1450] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 14:34:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:34:50.912853 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db08fe7a-9c13-4aa7-8362-339fcc1da397 None None] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:34:50.913386 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db08fe7a-9c13-4aa7-8362-339fcc1da397 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:34:50.913516 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db08fe7a-9c13-4aa7-8362-339fcc1da397 None None] PATH_INFO: `/` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:34:50.915374 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 727/1451] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 25 14:34:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:34:50.920533 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0c89e2-6c87-419a-a644-b583b74f00f0 None None] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:34:50.920959 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0c89e2-6c87-419a-a644-b583b74f00f0 None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:34:50.921106 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0c89e2-6c87-419a-a644-b583b74f00f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:34:50.939349 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.auth.core [None req-ec0c89e2-6c87-419a-a644-b583b74f00f0 None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:34:50.940549 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-ec0c89e2-6c87-419a-a644-b583b74f00f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:34:50.948479 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 725/1452] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 25 14:34:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:34:50.986451 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db08fe7a-9c13-4aa7-8362-339fcc1da397 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:34:50.999468 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db08fe7a-9c13-4aa7-8362-339fcc1da397 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:34:51.005940 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed375fd1-5e5e-47f6-ad77-d39b607f3c98 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b68eed985c7b49839bcdd173186ad4ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfe93ee8d32a441295efc0b885de4bd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:34:51.006593 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed375fd1-5e5e-47f6-ad77-d39b607f3c98 service neutron] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:34:51.006885 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed375fd1-5e5e-47f6-ad77-d39b607f3c98 service neutron] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:34:51.007201 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed375fd1-5e5e-47f6-ad77-d39b607f3c98 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:34:51.016469 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed375fd1-5e5e-47f6-ad77-d39b607f3c98 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:34:51.017909 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed375fd1-5e5e-47f6-ad77-d39b607f3c98 service neutron] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:34:51.027250 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 728/1453] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 14:34:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:34:53.289288 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39278335-c807-4f7a-9278-6413deba7eb8 None None] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:34:53.289864 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39278335-c807-4f7a-9278-6413deba7eb8 None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:34:53.290029 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39278335-c807-4f7a-9278-6413deba7eb8 None None] PATH_INFO: `/` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:34:53.291460 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 726/1454] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 25 14:34:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:34:53.296704 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbc9d5f-67e2-4da0-bdd8-43d56fb25faf None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:34:53.297151 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbc9d5f-67e2-4da0-bdd8-43d56fb25faf None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:34:53.297271 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbc9d5f-67e2-4da0-bdd8-43d56fb25faf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:34:53.315485 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-edbc9d5f-67e2-4da0-bdd8-43d56fb25faf None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:34:53.316674 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-edbc9d5f-67e2-4da0-bdd8-43d56fb25faf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:34:53.324850 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 729/1455] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 25 14:34:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:34:53.363492 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39278335-c807-4f7a-9278-6413deba7eb8 None None] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:34:53.374093 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39278335-c807-4f7a-9278-6413deba7eb8 None None] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:34:53.377835 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d367dae2-871c-4556-a390-9343c78c61a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b68eed985c7b49839bcdd173186ad4ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfe93ee8d32a441295efc0b885de4bd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:34:53.378463 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d367dae2-871c-4556-a390-9343c78c61a3 service neutron] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:34:53.378749 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d367dae2-871c-4556-a390-9343c78c61a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:34:53.379060 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d367dae2-871c-4556-a390-9343c78c61a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:34:53.387920 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d367dae2-871c-4556-a390-9343c78c61a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:34:53.389342 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d367dae2-871c-4556-a390-9343c78c61a3 service neutron] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:34:53.399238 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 727/1456] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 14:34:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:34:55.793098 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a189f4ff-9ce4-4559-b9b4-14efc48ac097 None None] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:34:55.793637 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a189f4ff-9ce4-4559-b9b4-14efc48ac097 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:34:55.793637 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a189f4ff-9ce4-4559-b9b4-14efc48ac097 None None] PATH_INFO: `/` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:34:55.795037 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 730/1457] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 25 14:34:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:34:55.800425 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d5b8ee-49a1-44a9-a425-80a818c9a700 None None] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:34:55.800854 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d5b8ee-49a1-44a9-a425-80a818c9a700 None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:34:55.800996 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d5b8ee-49a1-44a9-a425-80a818c9a700 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:34:55.808027 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=70 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:34:55.821214 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.auth.core [None req-16d5b8ee-49a1-44a9-a425-80a818c9a700 None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:34:55.822426 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-16d5b8ee-49a1-44a9-a425-80a818c9a700 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:34:55.830274 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 728/1458] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 25 14:34:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:34:55.867962 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a189f4ff-9ce4-4559-b9b4-14efc48ac097 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:34:55.873374 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=73 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:34:55.880003 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a189f4ff-9ce4-4559-b9b4-14efc48ac097 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:34:55.884218 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb207fe9-94ba-41f3-8c22-26a38005a6e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b68eed985c7b49839bcdd173186ad4ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfe93ee8d32a441295efc0b885de4bd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:34:55.884851 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb207fe9-94ba-41f3-8c22-26a38005a6e8 service neutron] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:34:55.885137 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb207fe9-94ba-41f3-8c22-26a38005a6e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:34:55.885420 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb207fe9-94ba-41f3-8c22-26a38005a6e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:34:55.894322 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb207fe9-94ba-41f3-8c22-26a38005a6e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:34:55.895783 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb207fe9-94ba-41f3-8c22-26a38005a6e8 service neutron] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:34:55.905182 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 731/1459] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 14:34:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:34:58.182081 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18abed75-87c8-4d6c-b64f-d7ebe968022d None None] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:34:58.182599 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18abed75-87c8-4d6c-b64f-d7ebe968022d None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:34:58.182599 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18abed75-87c8-4d6c-b64f-d7ebe968022d None None] PATH_INFO: `/` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:34:58.184002 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 729/1460] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 25 14:34:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:34:58.189198 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937aa94d-e127-4e07-965f-353673215d9a None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:34:58.189631 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937aa94d-e127-4e07-965f-353673215d9a None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:34:58.189752 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937aa94d-e127-4e07-965f-353673215d9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:34:58.207788 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-937aa94d-e127-4e07-965f-353673215d9a None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:34:58.208960 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-937aa94d-e127-4e07-965f-353673215d9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:34:58.217060 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 732/1461] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 25 14:34:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:34:58.254489 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18abed75-87c8-4d6c-b64f-d7ebe968022d None None] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:34:58.265355 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18abed75-87c8-4d6c-b64f-d7ebe968022d None None] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:34:58.268904 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8686b3-2e80-490e-a10f-214fdfdf489e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b68eed985c7b49839bcdd173186ad4ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfe93ee8d32a441295efc0b885de4bd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:34:58.269542 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8686b3-2e80-490e-a10f-214fdfdf489e service neutron] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:34:58.269832 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8686b3-2e80-490e-a10f-214fdfdf489e service neutron] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:34:58.270112 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8686b3-2e80-490e-a10f-214fdfdf489e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:34:58.279482 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8686b3-2e80-490e-a10f-214fdfdf489e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:34:58.280903 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8686b3-2e80-490e-a10f-214fdfdf489e service neutron] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:34:58.290541 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 730/1462] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 14:34:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:35:00.521310 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bdfb45-3ac2-4e8b-89cf-1aac7d99072f None None] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:35:00.521882 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bdfb45-3ac2-4e8b-89cf-1aac7d99072f None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:35:00.521882 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bdfb45-3ac2-4e8b-89cf-1aac7d99072f None None] PATH_INFO: `/` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:35:00.524442 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 733/1463] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 25 14:35:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:35:00.529831 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c852645-64c9-4caa-8a39-beaaf4e16169 None None] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:35:00.530300 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c852645-64c9-4caa-8a39-beaaf4e16169 None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:35:00.530407 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c852645-64c9-4caa-8a39-beaaf4e16169 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:35:00.549222 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.auth.core [None req-4c852645-64c9-4caa-8a39-beaaf4e16169 None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:35:00.550412 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-4c852645-64c9-4caa-8a39-beaaf4e16169 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:35:00.559132 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 731/1464] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 25 14:35:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 14:35:00.594546 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bdfb45-3ac2-4e8b-89cf-1aac7d99072f None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:35:00.606416 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bdfb45-3ac2-4e8b-89cf-1aac7d99072f None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:35:00.609870 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25161b5-99b0-43a0-9dbc-b123a15063fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b68eed985c7b49839bcdd173186ad4ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfe93ee8d32a441295efc0b885de4bd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:35:00.610522 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25161b5-99b0-43a0-9dbc-b123a15063fd service neutron] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:35:00.610805 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25161b5-99b0-43a0-9dbc-b123a15063fd service neutron] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:35:00.611124 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25161b5-99b0-43a0-9dbc-b123a15063fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:35:00.621210 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25161b5-99b0-43a0-9dbc-b123a15063fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:35:00.622663 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25161b5-99b0-43a0-9dbc-b123a15063fd service neutron] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:35:00.632457 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 734/1465] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 14:35:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:35:02.882032 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced79ce7-da1f-4ab6-9283-13f7054cc341 None None] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:35:02.882975 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced79ce7-da1f-4ab6-9283-13f7054cc341 None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:35:02.882975 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced79ce7-da1f-4ab6-9283-13f7054cc341 None None] PATH_INFO: `/` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:35:02.884057 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 732/1466] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 25 14:35:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:35:02.889557 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b48b8d-fb83-40d0-9e59-89acf2552ad6 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:35:02.890000 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b48b8d-fb83-40d0-9e59-89acf2552ad6 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:35:02.890108 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b48b8d-fb83-40d0-9e59-89acf2552ad6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:35:02.907753 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-c6b48b8d-fb83-40d0-9e59-89acf2552ad6 None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:35:02.908948 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-c6b48b8d-fb83-40d0-9e59-89acf2552ad6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:35:02.917206 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 735/1467] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 25 14:35:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:35:02.955211 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced79ce7-da1f-4ab6-9283-13f7054cc341 None None] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:35:02.967067 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced79ce7-da1f-4ab6-9283-13f7054cc341 None None] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:35:02.970464 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a84d493-a074-43d0-ba9a-84e1f6de8e81 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b68eed985c7b49839bcdd173186ad4ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfe93ee8d32a441295efc0b885de4bd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:35:02.971140 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a84d493-a074-43d0-ba9a-84e1f6de8e81 service neutron] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:35:02.971422 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a84d493-a074-43d0-ba9a-84e1f6de8e81 service neutron] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:35:02.971696 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a84d493-a074-43d0-ba9a-84e1f6de8e81 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:35:02.980427 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a84d493-a074-43d0-ba9a-84e1f6de8e81 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:35:02.981843 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a84d493-a074-43d0-ba9a-84e1f6de8e81 service neutron] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:35:02.991055 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 733/1468] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 14:35:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:35:12.902660 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=17 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:35:12.986946 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=17 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:35:36.365463 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3910804-2f13-43f3-b4d8-7cd3740e03d2 None None] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:35:36.366114 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3910804-2f13-43f3-b4d8-7cd3740e03d2 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:35:36.366424 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3910804-2f13-43f3-b4d8-7cd3740e03d2 None None] PATH_INFO: `/` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:35:36.367856 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 736/1469] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 14:35:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:35:36.373223 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aceb995-4570-4e72-9254-8a29692d3f1c None None] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:35:36.373656 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aceb995-4570-4e72-9254-8a29692d3f1c None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:35:36.373811 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aceb995-4570-4e72-9254-8a29692d3f1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:35:36.394187 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.auth.core [None req-6aceb995-4570-4e72-9254-8a29692d3f1c None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:35:36.395420 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-6aceb995-4570-4e72-9254-8a29692d3f1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:35:36.403842 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 734/1470] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 14:35:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:35:36.450165 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133c0db6-504f-40b9-b428-3a36d87aa743 None None] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:35:36.450454 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133c0db6-504f-40b9-b428-3a36d87aa743 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:35:36.450744 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133c0db6-504f-40b9-b428-3a36d87aa743 None None] PATH_INFO: `/` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:35:36.452130 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 737/1471] 10.222.0.67 () {54 vars in 962 bytes} [Wed May 25 14:35:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:35:36.456855 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b4afac-95b8-4b9b-af9d-b7eec7aedbe0 None None] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:35:36.457145 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b4afac-95b8-4b9b-af9d-b7eec7aedbe0 None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:35:36.457424 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b4afac-95b8-4b9b-af9d-b7eec7aedbe0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:35:36.475809 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.auth.core [None req-c3b4afac-95b8-4b9b-af9d-b7eec7aedbe0 None None] MFA Rules not processed for user `b5e4d67668ce40509e057f4f4c994521`. Rule list: `[]` (Enabled: `True`). {{(pid=80474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:35:36.476995 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-c3b4afac-95b8-4b9b-af9d-b7eec7aedbe0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:35:36.483378 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 735/1472] 10.222.0.67 () {58 vars in 1059 bytes} [Wed May 25 14:35:36 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:35:36.490294 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133c0db6-504f-40b9-b428-3a36d87aa743 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:35:36.501119 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133c0db6-504f-40b9-b428-3a36d87aa743 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:35:36.504813 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75b7ce4-fb39-4b4e-b37b-7466e430d21f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5e4d67668ce40509e057f4f4c994521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfe93ee8d32a441295efc0b885de4bd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:35:36.505429 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75b7ce4-fb39-4b4e-b37b-7466e430d21f service glance] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:35:36.505710 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75b7ce4-fb39-4b4e-b37b-7466e430d21f service glance] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:35:36.505984 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75b7ce4-fb39-4b4e-b37b-7466e430d21f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:35:36.515218 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75b7ce4-fb39-4b4e-b37b-7466e430d21f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:35:36.516626 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75b7ce4-fb39-4b4e-b37b-7466e430d21f service glance] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:35:36.526346 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 738/1473] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 14:35:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 14:35:38.838829 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da6e33f-644a-4a1e-8398-c2f63bafb237 None None] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:35:38.839424 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da6e33f-644a-4a1e-8398-c2f63bafb237 None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:35:38.839424 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da6e33f-644a-4a1e-8398-c2f63bafb237 None None] PATH_INFO: `/` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:35:38.840842 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 736/1474] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 14:35:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:35:38.846574 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6b1bd6-5e2f-4950-886a-2a097fa12474 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:35:38.847097 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6b1bd6-5e2f-4950-886a-2a097fa12474 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:35:38.847221 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6b1bd6-5e2f-4950-886a-2a097fa12474 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:35:38.864702 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-1b6b1bd6-5e2f-4950-886a-2a097fa12474 None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:35:38.865931 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-1b6b1bd6-5e2f-4950-886a-2a097fa12474 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:35:38.873772 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 739/1475] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 14:35:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:35:38.898180 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da6e33f-644a-4a1e-8398-c2f63bafb237 None None] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:35:38.910467 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da6e33f-644a-4a1e-8398-c2f63bafb237 None None] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:35:38.914868 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8aa194f-41bb-4eda-baa9-94e7681378e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:35:38.915531 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8aa194f-41bb-4eda-baa9-94e7681378e6 admin admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:35:38.915811 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8aa194f-41bb-4eda-baa9-94e7681378e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:35:38.916115 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8aa194f-41bb-4eda-baa9-94e7681378e6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:35:38.916842 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8aa194f-41bb-4eda-baa9-94e7681378e6 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:35:38.918607 dv-cinder-787296-9-smb devstack@keystone.service[80474]: WARNING py.warnings [None req-c8aa194f-41bb-4eda-baa9-94e7681378e6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 25 14:35:38.918607 dv-cinder-787296-9-smb devstack@keystone.service[80474]: warnings.warn(msg) May 25 14:35:38.918607 dv-cinder-787296-9-smb devstack@keystone.service[80474]: May 25 14:35:38.919782 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8aa194f-41bb-4eda-baa9-94e7681378e6 admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:35:38.938209 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 737/1476] 10.222.0.67 () {56 vars in 1108 bytes} [Wed May 25 14:35:38 2022] GET /identity/v3/projects => generated 2553 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:35:41.171464 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727dcfff-cfe4-466b-8dbd-7297a2663d0f None None] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:35:41.171995 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727dcfff-cfe4-466b-8dbd-7297a2663d0f None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:35:41.171995 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727dcfff-cfe4-466b-8dbd-7297a2663d0f None None] PATH_INFO: `/` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:35:41.173316 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 740/1477] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 14:35:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:35:41.178445 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b355e2c8-5295-44c3-b433-2a4b2798c7bf None None] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:35:41.178900 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b355e2c8-5295-44c3-b433-2a4b2798c7bf None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:35:41.179119 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b355e2c8-5295-44c3-b433-2a4b2798c7bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:35:41.197665 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.auth.core [None req-b355e2c8-5295-44c3-b433-2a4b2798c7bf None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:35:41.198849 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-b355e2c8-5295-44c3-b433-2a4b2798c7bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:35:41.206469 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 738/1478] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 14:35:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:35:41.250250 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727dcfff-cfe4-466b-8dbd-7297a2663d0f None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:35:41.265175 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727dcfff-cfe4-466b-8dbd-7297a2663d0f None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:35:41.270480 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f5c024-9012-4f1f-bc5a-30c89fe214ab service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '428ec99478284743943ed41e9d24a603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfe93ee8d32a441295efc0b885de4bd7', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:35:41.271134 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f5c024-9012-4f1f-bc5a-30c89fe214ab service nova] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:35:41.271415 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f5c024-9012-4f1f-bc5a-30c89fe214ab service nova] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:35:41.271684 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f5c024-9012-4f1f-bc5a-30c89fe214ab service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:35:41.279818 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f5c024-9012-4f1f-bc5a-30c89fe214ab service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:35:41.281382 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f5c024-9012-4f1f-bc5a-30c89fe214ab service nova] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:35:41.291343 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 741/1479] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 14:35:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:35:43.687983 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537bffd6-95db-4759-bd0f-447497823a90 None None] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:35:43.688518 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537bffd6-95db-4759-bd0f-447497823a90 None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:35:43.688518 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537bffd6-95db-4759-bd0f-447497823a90 None None] PATH_INFO: `/` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:35:43.689832 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 739/1480] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 14:35:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:35:43.695572 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b82521e-ef49-4a15-a7e3-51702e19e503 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:35:43.696040 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b82521e-ef49-4a15-a7e3-51702e19e503 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:35:43.696135 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b82521e-ef49-4a15-a7e3-51702e19e503 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:35:43.714013 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-3b82521e-ef49-4a15-a7e3-51702e19e503 None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:35:43.715239 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-3b82521e-ef49-4a15-a7e3-51702e19e503 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:35:43.722979 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 742/1481] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 14:35:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:35:43.761390 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537bffd6-95db-4759-bd0f-447497823a90 None None] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:35:43.774019 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537bffd6-95db-4759-bd0f-447497823a90 None None] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:35:43.777604 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd07b284-cacc-42fd-a78a-ce400282eb21 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b68eed985c7b49839bcdd173186ad4ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfe93ee8d32a441295efc0b885de4bd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:35:43.778244 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd07b284-cacc-42fd-a78a-ce400282eb21 service neutron] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:35:43.778531 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd07b284-cacc-42fd-a78a-ce400282eb21 service neutron] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:35:43.778808 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd07b284-cacc-42fd-a78a-ce400282eb21 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:35:43.788166 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd07b284-cacc-42fd-a78a-ce400282eb21 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:35:43.789409 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd07b284-cacc-42fd-a78a-ce400282eb21 service neutron] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:35:43.798696 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 740/1482] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 14:35:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 14:35:46.053745 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c9896a-0afd-4640-8bb3-be1ab21c3c81 None None] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:35:46.054310 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c9896a-0afd-4640-8bb3-be1ab21c3c81 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:35:46.054310 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c9896a-0afd-4640-8bb3-be1ab21c3c81 None None] PATH_INFO: `/` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:35:46.055743 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 743/1483] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 14:35:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:35:46.060842 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fb8cbb-41a7-49dd-b78e-35aeee0017ac None None] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:35:46.061287 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fb8cbb-41a7-49dd-b78e-35aeee0017ac None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:35:46.061394 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fb8cbb-41a7-49dd-b78e-35aeee0017ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:35:46.080013 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.auth.core [None req-a6fb8cbb-41a7-49dd-b78e-35aeee0017ac None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:35:46.081211 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-a6fb8cbb-41a7-49dd-b78e-35aeee0017ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:35:46.089438 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 741/1484] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 14:35:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:35:46.127614 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c9896a-0afd-4640-8bb3-be1ab21c3c81 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:35:46.138862 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c9896a-0afd-4640-8bb3-be1ab21c3c81 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:35:46.142371 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfacb98-1412-43a6-8b4b-c81b449bd09d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b68eed985c7b49839bcdd173186ad4ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfe93ee8d32a441295efc0b885de4bd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:35:46.143032 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfacb98-1412-43a6-8b4b-c81b449bd09d service neutron] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:35:46.143322 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfacb98-1412-43a6-8b4b-c81b449bd09d service neutron] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:35:46.143598 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfacb98-1412-43a6-8b4b-c81b449bd09d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:35:46.152398 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfacb98-1412-43a6-8b4b-c81b449bd09d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:35:46.153836 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfacb98-1412-43a6-8b4b-c81b449bd09d service neutron] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:35:46.163469 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 744/1485] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 14:35:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:35:48.479379 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7052600-8ea1-4f92-8786-29e515104ea3 None None] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:35:48.480040 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7052600-8ea1-4f92-8786-29e515104ea3 None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:35:48.480040 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7052600-8ea1-4f92-8786-29e515104ea3 None None] PATH_INFO: `/` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:35:48.481524 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 742/1486] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 14:35:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:35:48.486492 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246988a8-a728-4db2-b200-1ded32f075a8 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:35:48.486910 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246988a8-a728-4db2-b200-1ded32f075a8 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:35:48.487076 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246988a8-a728-4db2-b200-1ded32f075a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:35:48.505199 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-246988a8-a728-4db2-b200-1ded32f075a8 None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:35:48.506369 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-246988a8-a728-4db2-b200-1ded32f075a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:35:48.514143 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 745/1487] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 14:35:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:35:48.570391 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903a0872-ab39-45f7-96de-6b3d1b9676f0 None None] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:35:48.570672 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903a0872-ab39-45f7-96de-6b3d1b9676f0 None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:35:48.570948 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903a0872-ab39-45f7-96de-6b3d1b9676f0 None None] PATH_INFO: `/` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:35:48.572356 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 743/1488] 10.222.0.67 () {54 vars in 964 bytes} [Wed May 25 14:35:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:35:48.578323 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7397e9-1fcb-4f7d-a28f-3e39eda600e9 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:35:48.578622 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7397e9-1fcb-4f7d-a28f-3e39eda600e9 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:35:48.578909 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7397e9-1fcb-4f7d-a28f-3e39eda600e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:35:48.616128 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-cb7397e9-1fcb-4f7d-a28f-3e39eda600e9 None None] MFA Rules not processed for user `b68eed985c7b49839bcdd173186ad4ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:35:48.617318 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-cb7397e9-1fcb-4f7d-a28f-3e39eda600e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:35:48.623758 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 746/1489] 10.222.0.67 () {58 vars in 1061 bytes} [Wed May 25 14:35:48 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:35:48.633229 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903a0872-ab39-45f7-96de-6b3d1b9676f0 None None] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:35:48.643879 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903a0872-ab39-45f7-96de-6b3d1b9676f0 None None] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:35:48.648512 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eea3c86-1eb0-4a25-a818-7f0d78ed7ba8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b68eed985c7b49839bcdd173186ad4ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfe93ee8d32a441295efc0b885de4bd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:35:48.649142 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eea3c86-1eb0-4a25-a818-7f0d78ed7ba8 service neutron] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:35:48.649427 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eea3c86-1eb0-4a25-a818-7f0d78ed7ba8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:35:48.649704 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eea3c86-1eb0-4a25-a818-7f0d78ed7ba8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:35:48.658739 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eea3c86-1eb0-4a25-a818-7f0d78ed7ba8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:35:48.660214 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eea3c86-1eb0-4a25-a818-7f0d78ed7ba8 service neutron] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:35:48.670592 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 744/1490] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 14:35:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:35:51.540013 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe94005-c6a9-430b-81fa-15736e23b63a None None] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:35:51.540578 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe94005-c6a9-430b-81fa-15736e23b63a None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:35:51.540578 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe94005-c6a9-430b-81fa-15736e23b63a None None] PATH_INFO: `/` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:35:51.541952 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 747/1491] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 14:35:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:35:51.547305 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4033ba-dbc4-4d16-ac1b-a7ba377ff606 None None] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:35:51.547731 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4033ba-dbc4-4d16-ac1b-a7ba377ff606 None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:35:51.547869 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4033ba-dbc4-4d16-ac1b-a7ba377ff606 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:35:51.566061 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.auth.core [None req-bc4033ba-dbc4-4d16-ac1b-a7ba377ff606 None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:35:51.567235 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-bc4033ba-dbc4-4d16-ac1b-a7ba377ff606 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:35:51.575006 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 745/1492] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 14:35:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:35:51.615422 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe94005-c6a9-430b-81fa-15736e23b63a None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:35:51.626918 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe94005-c6a9-430b-81fa-15736e23b63a None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:35:51.630508 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed503c9-f733-4f20-8daa-488a1bbc909a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b68eed985c7b49839bcdd173186ad4ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfe93ee8d32a441295efc0b885de4bd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:35:51.631366 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed503c9-f733-4f20-8daa-488a1bbc909a service neutron] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:35:51.631661 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed503c9-f733-4f20-8daa-488a1bbc909a service neutron] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:35:51.631937 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed503c9-f733-4f20-8daa-488a1bbc909a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:35:51.640991 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed503c9-f733-4f20-8daa-488a1bbc909a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:35:51.642411 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed503c9-f733-4f20-8daa-488a1bbc909a service neutron] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:35:51.651780 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 748/1493] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 14:35:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:36:01.561037 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=33 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:36:01.647715 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=42 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:37:32.484069 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7544768-8005-4ca4-a3f5-c1719208794e None None] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:37:32.484674 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7544768-8005-4ca4-a3f5-c1719208794e None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:37:32.484674 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7544768-8005-4ca4-a3f5-c1719208794e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:37:32.503706 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.auth.core [None req-a7544768-8005-4ca4-a3f5-c1719208794e None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:37:32.505622 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-a7544768-8005-4ca4-a3f5-c1719208794e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:37:32.513809 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 746/1494] 10.222.0.67 () {58 vars in 957 bytes} [Wed May 25 14:37:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:37:32.523038 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c66f124-d7f5-4f3a-b8c4-d76055342d2e None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:37:32.523539 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c66f124-d7f5-4f3a-b8c4-d76055342d2e None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:37:32.523645 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c66f124-d7f5-4f3a-b8c4-d76055342d2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:37:32.541611 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-5c66f124-d7f5-4f3a-b8c4-d76055342d2e None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:37:32.542795 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-5c66f124-d7f5-4f3a-b8c4-d76055342d2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:37:32.550461 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 749/1495] 10.222.0.67 () {58 vars in 957 bytes} [Wed May 25 14:37:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:37:32.555680 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7544768-8005-4ca4-a3f5-c1719208794e None None] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:37:32.565311 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7544768-8005-4ca4-a3f5-c1719208794e None None] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:37:32.570473 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d093c75-d40b-4c3c-9ec4-57900e87d7dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:37:32.571167 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d093c75-d40b-4c3c-9ec4-57900e87d7dc admin admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:37:32.571460 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d093c75-d40b-4c3c-9ec4-57900e87d7dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:37:32.571743 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d093c75-d40b-4c3c-9ec4-57900e87d7dc admin admin] PATH_INFO: `/v3/domains` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:37:32.572473 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d093c75-d40b-4c3c-9ec4-57900e87d7dc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:37:32.572785 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d093c75-d40b-4c3c-9ec4-57900e87d7dc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:37:32.573803 dv-cinder-787296-9-smb devstack@keystone.service[80474]: WARNING py.warnings [None req-5d093c75-d40b-4c3c-9ec4-57900e87d7dc admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 25 14:37:32.573803 dv-cinder-787296-9-smb devstack@keystone.service[80474]: warnings.warn(msg) May 25 14:37:32.573803 dv-cinder-787296-9-smb devstack@keystone.service[80474]: May 25 14:37:32.574712 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d093c75-d40b-4c3c-9ec4-57900e87d7dc admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:37:32.586175 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 747/1496] 10.222.0.67 () {58 vars in 1152 bytes} [Wed May 25 14:37:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:37:32.594411 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c66f124-d7f5-4f3a-b8c4-d76055342d2e None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:37:32.603695 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c66f124-d7f5-4f3a-b8c4-d76055342d2e None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:37:32.608144 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2759d0c2-4995-4dee-a829-812ecdbc65db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:37:32.608792 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2759d0c2-4995-4dee-a829-812ecdbc65db admin admin] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:37:32.609081 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2759d0c2-4995-4dee-a829-812ecdbc65db admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:37:32.609361 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2759d0c2-4995-4dee-a829-812ecdbc65db admin admin] PATH_INFO: `/v3/projects` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:37:32.610049 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2759d0c2-4995-4dee-a829-812ecdbc65db admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:37:32.611861 dv-cinder-787296-9-smb devstack@keystone.service[80475]: WARNING py.warnings [None req-2759d0c2-4995-4dee-a829-812ecdbc65db admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 25 14:37:32.611861 dv-cinder-787296-9-smb devstack@keystone.service[80475]: warnings.warn(msg) May 25 14:37:32.611861 dv-cinder-787296-9-smb devstack@keystone.service[80475]: May 25 14:37:32.613039 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2759d0c2-4995-4dee-a829-812ecdbc65db admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:37:32.651743 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 750/1497] 10.222.0.67 () {60 vars in 1152 bytes} [Wed May 25 14:37:32 2022] POST /identity/v3/projects => generated 379 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:37:32.656019 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d093c75-d40b-4c3c-9ec4-57900e87d7dc admin admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:37:32.666067 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d093c75-d40b-4c3c-9ec4-57900e87d7dc admin admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:37:32.720989 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20548d2d-1510-4dd4-ac7e-d3b2923c224b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:37:32.721655 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20548d2d-1510-4dd4-ac7e-d3b2923c224b admin admin] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:37:32.721937 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20548d2d-1510-4dd4-ac7e-d3b2923c224b admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:37:32.722214 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20548d2d-1510-4dd4-ac7e-d3b2923c224b admin admin] PATH_INFO: `/v3/users` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:37:32.723525 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20548d2d-1510-4dd4-ac7e-d3b2923c224b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:37:32.724528 dv-cinder-787296-9-smb devstack@keystone.service[80474]: WARNING py.warnings [None req-20548d2d-1510-4dd4-ac7e-d3b2923c224b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 25 14:37:32.724528 dv-cinder-787296-9-smb devstack@keystone.service[80474]: warnings.warn(msg) May 25 14:37:32.724528 dv-cinder-787296-9-smb devstack@keystone.service[80474]: May 25 14:37:32.725735 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20548d2d-1510-4dd4-ac7e-d3b2923c224b admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:37:32.746392 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 748/1498] 10.222.0.67 () {60 vars in 1143 bytes} [Wed May 25 14:37:32 2022] POST /identity/v3/users => generated 290 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:37:32.750511 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2759d0c2-4995-4dee-a829-812ecdbc65db admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:37:32.761873 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2759d0c2-4995-4dee-a829-812ecdbc65db admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:37:32.766357 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff8fc1c-553f-4877-93cd-45a3bee7c40f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:37:32.767030 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff8fc1c-553f-4877-93cd-45a3bee7c40f admin admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:37:32.767317 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff8fc1c-553f-4877-93cd-45a3bee7c40f admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:37:32.767595 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff8fc1c-553f-4877-93cd-45a3bee7c40f admin admin] PATH_INFO: `/v3/roles` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:37:32.768314 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff8fc1c-553f-4877-93cd-45a3bee7c40f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:37:32.769331 dv-cinder-787296-9-smb devstack@keystone.service[80475]: WARNING py.warnings [None req-fff8fc1c-553f-4877-93cd-45a3bee7c40f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 25 14:37:32.769331 dv-cinder-787296-9-smb devstack@keystone.service[80475]: warnings.warn(msg) May 25 14:37:32.769331 dv-cinder-787296-9-smb devstack@keystone.service[80475]: May 25 14:37:32.770743 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff8fc1c-553f-4877-93cd-45a3bee7c40f admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:37:32.783748 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 751/1499] 10.222.0.67 () {58 vars in 1121 bytes} [Wed May 25 14:37:32 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:37:32.788358 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20548d2d-1510-4dd4-ac7e-d3b2923c224b admin admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:37:32.798002 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20548d2d-1510-4dd4-ac7e-d3b2923c224b admin admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:37:32.803118 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc40932-a3ef-4495-8fdc-73103fc3dc72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:37:32.803764 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc40932-a3ef-4495-8fdc-73103fc3dc72 admin admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:37:32.804046 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc40932-a3ef-4495-8fdc-73103fc3dc72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:37:32.804318 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc40932-a3ef-4495-8fdc-73103fc3dc72 admin admin] PATH_INFO: `/v3/roles` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:37:32.805034 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc40932-a3ef-4495-8fdc-73103fc3dc72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:37:32.806035 dv-cinder-787296-9-smb devstack@keystone.service[80474]: WARNING py.warnings [None req-ddc40932-a3ef-4495-8fdc-73103fc3dc72 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 25 14:37:32.806035 dv-cinder-787296-9-smb devstack@keystone.service[80474]: warnings.warn(msg) May 25 14:37:32.806035 dv-cinder-787296-9-smb devstack@keystone.service[80474]: May 25 14:37:32.806897 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc40932-a3ef-4495-8fdc-73103fc3dc72 admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:37:32.820199 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 749/1500] 10.222.0.67 () {58 vars in 1121 bytes} [Wed May 25 14:37:32 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:37:32.824818 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff8fc1c-553f-4877-93cd-45a3bee7c40f admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:37:32.835754 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff8fc1c-553f-4877-93cd-45a3bee7c40f admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:37:32.840232 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4aaaca-f23a-4f0b-ab3f-cf903c9ac941 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:37:32.841113 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4aaaca-f23a-4f0b-ab3f-cf903c9ac941 admin admin] REQUEST_METHOD: `PUT` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:37:32.841392 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4aaaca-f23a-4f0b-ab3f-cf903c9ac941 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:37:32.841664 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4aaaca-f23a-4f0b-ab3f-cf903c9ac941 admin admin] PATH_INFO: `/v3/projects/95354b5a66df4edcb553e599f8faeb13/users/6d6fafa81c7c495285404b03b0df13f5/roles/48808901834b4d5eab2c7e6b5b03791e` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:37:32.856930 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4aaaca-f23a-4f0b-ab3f-cf903c9ac941 admin admin] RBAC: Authorizing `identity:create_grant(project_id=95354b5a66df4edcb553e599f8faeb13, user_id=6d6fafa81c7c495285404b03b0df13f5, role_id=48808901834b4d5eab2c7e6b5b03791e)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:37:32.857965 dv-cinder-787296-9-smb devstack@keystone.service[80475]: WARNING py.warnings [None req-6d4aaaca-f23a-4f0b-ab3f-cf903c9ac941 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 25 14:37:32.857965 dv-cinder-787296-9-smb devstack@keystone.service[80475]: warnings.warn(msg) May 25 14:37:32.857965 dv-cinder-787296-9-smb devstack@keystone.service[80475]: May 25 14:37:32.859906 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4aaaca-f23a-4f0b-ab3f-cf903c9ac941 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:37:32.873363 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 752/1501] 10.222.0.67 () {60 vars in 1482 bytes} [Wed May 25 14:37:32 2022] PUT /identity/v3/projects/95354b5a66df4edcb553e599f8faeb13/users/6d6fafa81c7c495285404b03b0df13f5/roles/48808901834b4d5eab2c7e6b5b03791e => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:37:32.884802 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f594da8c-92f6-47a0-805b-1252de3e81f4 None None] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:37:32.885100 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f594da8c-92f6-47a0-805b-1252de3e81f4 None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:37:32.885388 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f594da8c-92f6-47a0-805b-1252de3e81f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:37:32.911728 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.auth.core [None req-f594da8c-92f6-47a0-805b-1252de3e81f4 None None] MFA Rules not processed for user `6d6fafa81c7c495285404b03b0df13f5`. Rule list: `[]` (Enabled: `True`). {{(pid=80474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:37:32.912946 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-f594da8c-92f6-47a0-805b-1252de3e81f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:37:32.976256 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 750/1502] 10.222.0.67 () {58 vars in 957 bytes} [Wed May 25 14:37:32 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 14:37:32.989873 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405695aa-c1e2-4882-9665-acf17a5f9fe7 None None] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:37:32.990167 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405695aa-c1e2-4882-9665-acf17a5f9fe7 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:37:32.990444 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405695aa-c1e2-4882-9665-acf17a5f9fe7 None None] PATH_INFO: `/` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:37:32.991853 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 753/1503] 10.222.0.67 () {54 vars in 963 bytes} [Wed May 25 14:37:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:37:32.996929 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db39a32a-b40d-4ce8-936b-db448aee6127 None None] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:37:32.997169 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db39a32a-b40d-4ce8-936b-db448aee6127 None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:37:32.997457 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db39a32a-b40d-4ce8-936b-db448aee6127 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:37:33.015383 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.auth.core [None req-db39a32a-b40d-4ce8-936b-db448aee6127 None None] MFA Rules not processed for user `6e462acc9da84a61bb23998dd54e1858`. Rule list: `[]` (Enabled: `True`). {{(pid=80474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:37:33.016584 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-db39a32a-b40d-4ce8-936b-db448aee6127 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:37:33.061295 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:37:33.069910 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 751/1504] 10.222.0.67 () {58 vars in 1060 bytes} [Wed May 25 14:37:32 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 14:37:33.077584 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405695aa-c1e2-4882-9665-acf17a5f9fe7 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:37:33.088530 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405695aa-c1e2-4882-9665-acf17a5f9fe7 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:37:33.092325 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34be23bc-eeda-4943-9e11-008cb011583a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e462acc9da84a61bb23998dd54e1858', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfe93ee8d32a441295efc0b885de4bd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:37:33.092987 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34be23bc-eeda-4943-9e11-008cb011583a service cinder] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:37:33.093270 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34be23bc-eeda-4943-9e11-008cb011583a service cinder] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:37:33.093600 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34be23bc-eeda-4943-9e11-008cb011583a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:37:33.102885 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34be23bc-eeda-4943-9e11-008cb011583a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:37:33.104357 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34be23bc-eeda-4943-9e11-008cb011583a service cinder] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:37:33.114028 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 754/1505] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 14:37:33 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:37:33.157217 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3467ae61-3c33-4c78-a6bf-0a20c8fc1e11 None None] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:37:33.157512 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3467ae61-3c33-4c78-a6bf-0a20c8fc1e11 None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:37:33.157802 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3467ae61-3c33-4c78-a6bf-0a20c8fc1e11 None None] PATH_INFO: `/` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:37:33.159163 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 752/1506] 10.222.0.67 () {52 vars in 829 bytes} [Wed May 25 14:37:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:37:33.163411 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34be23bc-eeda-4943-9e11-008cb011583a service cinder] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:37:33.228666 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34be23bc-eeda-4943-9e11-008cb011583a service cinder] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:37:33.233144 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a043fdf-520d-4e89-ab51-0a49c9215c7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:37:33.234013 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a043fdf-520d-4e89-ab51-0a49c9215c7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:37:33.234297 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a043fdf-520d-4e89-ab51-0a49c9215c7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:37:33.234575 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a043fdf-520d-4e89-ab51-0a49c9215c7a admin admin] PATH_INFO: `/v3/users/6d6fafa81c7c495285404b03b0df13f5` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:37:33.235771 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a043fdf-520d-4e89-ab51-0a49c9215c7a admin admin] RBAC: Authorizing `identity:delete_user(user_id=6d6fafa81c7c495285404b03b0df13f5)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:37:33.236802 dv-cinder-787296-9-smb devstack@keystone.service[80475]: WARNING py.warnings [None req-2a043fdf-520d-4e89-ab51-0a49c9215c7a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 25 14:37:33.236802 dv-cinder-787296-9-smb devstack@keystone.service[80475]: warnings.warn(msg) May 25 14:37:33.236802 dv-cinder-787296-9-smb devstack@keystone.service[80475]: May 25 14:37:33.238007 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a043fdf-520d-4e89-ab51-0a49c9215c7a admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:37:33.302922 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-2a043fdf-520d-4e89-ab51-0a49c9215c7a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6d6fafa81c7c495285404b03b0df13f5'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:37:33.312561 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-2a043fdf-520d-4e89-ab51-0a49c9215c7a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6d6fafa81c7c495285404b03b0df13f5'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:37:33.313253 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-2a043fdf-520d-4e89-ab51-0a49c9215c7a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6d6fafa81c7c495285404b03b0df13f5'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:37:33.326040 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-2a043fdf-520d-4e89-ab51-0a49c9215c7a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6d6fafa81c7c495285404b03b0df13f5'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:37:33.342588 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:37:33.345380 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-2a043fdf-520d-4e89-ab51-0a49c9215c7a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6d6fafa81c7c495285404b03b0df13f5'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:37:33.353512 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 755/1507] 10.222.0.67 () {58 vars in 1223 bytes} [Wed May 25 14:37:33 2022] DELETE /identity/v3/users/6d6fafa81c7c495285404b03b0df13f5 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:37:33.357959 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82602ec2-fe17-4920-953d-0f7bb5029252 None None] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:37:33.358290 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82602ec2-fe17-4920-953d-0f7bb5029252 None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:37:33.358497 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82602ec2-fe17-4920-953d-0f7bb5029252 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:37:33.376486 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.auth.core [None req-82602ec2-fe17-4920-953d-0f7bb5029252 None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:37:33.377954 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-82602ec2-fe17-4920-953d-0f7bb5029252 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:37:33.437416 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 753/1508] 10.222.0.67 () {58 vars in 957 bytes} [Wed May 25 14:37:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:37:33.447502 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a043fdf-520d-4e89-ab51-0a49c9215c7a admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:37:33.448963 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-2a043fdf-520d-4e89-ab51-0a49c9215c7a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:37:33.506058 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a043fdf-520d-4e89-ab51-0a49c9215c7a admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:37:33.509630 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386004d7-fc87-4550-b0e8-c93e376b3544 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b68eed985c7b49839bcdd173186ad4ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfe93ee8d32a441295efc0b885de4bd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:37:33.510273 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386004d7-fc87-4550-b0e8-c93e376b3544 service neutron] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:37:33.510562 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386004d7-fc87-4550-b0e8-c93e376b3544 service neutron] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:37:33.510845 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386004d7-fc87-4550-b0e8-c93e376b3544 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:37:33.519658 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386004d7-fc87-4550-b0e8-c93e376b3544 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:37:33.521713 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386004d7-fc87-4550-b0e8-c93e376b3544 service neutron] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:37:33.531077 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 756/1509] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 14:37:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:37:33.884959 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82602ec2-fe17-4920-953d-0f7bb5029252 None None] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:37:33.886394 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-82602ec2-fe17-4920-953d-0f7bb5029252 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:37:33.898171 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82602ec2-fe17-4920-953d-0f7bb5029252 None None] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:37:33.903181 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebca2478-d786-4ae4-a566-0f8835c7adf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:37:33.904056 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebca2478-d786-4ae4-a566-0f8835c7adf8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:37:33.904361 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebca2478-d786-4ae4-a566-0f8835c7adf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:37:33.904642 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebca2478-d786-4ae4-a566-0f8835c7adf8 admin admin] PATH_INFO: `/v3/projects/95354b5a66df4edcb553e599f8faeb13` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:37:33.905835 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebca2478-d786-4ae4-a566-0f8835c7adf8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=95354b5a66df4edcb553e599f8faeb13)` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:37:33.906963 dv-cinder-787296-9-smb devstack@keystone.service[80474]: WARNING py.warnings [None req-ebca2478-d786-4ae4-a566-0f8835c7adf8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 25 14:37:33.906963 dv-cinder-787296-9-smb devstack@keystone.service[80474]: warnings.warn(msg) May 25 14:37:33.906963 dv-cinder-787296-9-smb devstack@keystone.service[80474]: May 25 14:37:33.908249 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebca2478-d786-4ae4-a566-0f8835c7adf8 admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:37:33.969745 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-ebca2478-d786-4ae4-a566-0f8835c7adf8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '95354b5a66df4edcb553e599f8faeb13', 'request_id': 'req-ebca2478-d786-4ae4-a566-0f8835c7adf8'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:37:33.980021 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-ebca2478-d786-4ae4-a566-0f8835c7adf8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '95354b5a66df4edcb553e599f8faeb13', 'request_id': 'req-ebca2478-d786-4ae4-a566-0f8835c7adf8'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:37:33.993958 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-ebca2478-d786-4ae4-a566-0f8835c7adf8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '95354b5a66df4edcb553e599f8faeb13', 'request_id': 'req-ebca2478-d786-4ae4-a566-0f8835c7adf8'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:37:34.004846 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-ebca2478-d786-4ae4-a566-0f8835c7adf8 admin admin] The token cache is being invalidate because project 95354b5a66df4edcb553e599f8faeb13 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80474) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 14:37:34.005749 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-ebca2478-d786-4ae4-a566-0f8835c7adf8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:37:34.006491 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-ebca2478-d786-4ae4-a566-0f8835c7adf8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:37:34.008071 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 754/1510] 10.222.0.67 () {58 vars in 1232 bytes} [Wed May 25 14:37:33 2022] DELETE /identity/v3/projects/95354b5a66df4edcb553e599f8faeb13 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:37:43.526882 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:DELETE=1,keystone:SELECT=28 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:37:44.001718 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=55,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:39:24.671612 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c299852-b8bc-48d9-87d6-8ed12c4bf3cc None None] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:24.672178 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c299852-b8bc-48d9-87d6-8ed12c4bf3cc None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:24.672178 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c299852-b8bc-48d9-87d6-8ed12c4bf3cc None None] PATH_INFO: `/` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:24.673526 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 757/1511] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 25 14:39:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:39:24.678253 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8b3411-a6e1-43af-9c08-9fd411c2a81a None None] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:24.678715 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8b3411-a6e1-43af-9c08-9fd411c2a81a None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:24.678824 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8b3411-a6e1-43af-9c08-9fd411c2a81a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:24.697410 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.auth.core [None req-ce8b3411-a6e1-43af-9c08-9fd411c2a81a None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:39:24.698635 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-ce8b3411-a6e1-43af-9c08-9fd411c2a81a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:39:24.756763 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 755/1512] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 25 14:39:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:39:24.924857 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c299852-b8bc-48d9-87d6-8ed12c4bf3cc None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:24.926461 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-8c299852-b8bc-48d9-87d6-8ed12c4bf3cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:39:24.999461 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c299852-b8bc-48d9-87d6-8ed12c4bf3cc None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:25.004935 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526b67b8-a317-4259-99a6-48401de93c70 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '428ec99478284743943ed41e9d24a603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfe93ee8d32a441295efc0b885de4bd7', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:25.005570 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526b67b8-a317-4259-99a6-48401de93c70 service nova] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:25.005855 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526b67b8-a317-4259-99a6-48401de93c70 service nova] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:25.006127 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526b67b8-a317-4259-99a6-48401de93c70 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:25.014582 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526b67b8-a317-4259-99a6-48401de93c70 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:39:25.016204 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526b67b8-a317-4259-99a6-48401de93c70 service nova] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:39:25.025315 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 758/1513] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 14:39:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:39:25.902496 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba0380f-0c3a-4435-b1aa-9ffa98f0a35f None None] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:25.903565 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba0380f-0c3a-4435-b1aa-9ffa98f0a35f None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:25.903703 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba0380f-0c3a-4435-b1aa-9ffa98f0a35f None None] PATH_INFO: `/` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:25.905063 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 756/1514] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 25 14:39:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:39:25.910033 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a312681-a35a-44d9-ae6d-09ad205672a8 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:25.910439 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a312681-a35a-44d9-ae6d-09ad205672a8 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:25.910603 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a312681-a35a-44d9-ae6d-09ad205672a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:25.929067 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-8a312681-a35a-44d9-ae6d-09ad205672a8 None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:39:25.930265 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-8a312681-a35a-44d9-ae6d-09ad205672a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:39:25.938043 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 759/1515] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 25 14:39:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:39:26.095308 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba0380f-0c3a-4435-b1aa-9ffa98f0a35f None None] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:26.110462 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba0380f-0c3a-4435-b1aa-9ffa98f0a35f None None] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:26.115814 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfa3e2b-cc23-4661-a606-6fb1b3fd4be1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '428ec99478284743943ed41e9d24a603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfe93ee8d32a441295efc0b885de4bd7', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:26.116449 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfa3e2b-cc23-4661-a606-6fb1b3fd4be1 service nova] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:26.116737 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfa3e2b-cc23-4661-a606-6fb1b3fd4be1 service nova] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:26.117018 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfa3e2b-cc23-4661-a606-6fb1b3fd4be1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:26.125522 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfa3e2b-cc23-4661-a606-6fb1b3fd4be1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:39:26.127172 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfa3e2b-cc23-4661-a606-6fb1b3fd4be1 service nova] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:39:26.136621 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 757/1516] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 14:39:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:39:26.594749 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f383eebf-c190-4900-b115-dc61d3f2c4f1 None None] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:26.595074 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f383eebf-c190-4900-b115-dc61d3f2c4f1 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:26.595360 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f383eebf-c190-4900-b115-dc61d3f2c4f1 None None] PATH_INFO: `/v3` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:26.596707 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 760/1517] 10.222.0.91 () {54 vars in 925 bytes} [Wed May 25 14:39:26 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:39:26.603745 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71669fc-f27b-4672-9ef7-f5e77b7a9e07 None None] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:26.604044 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71669fc-f27b-4672-9ef7-f5e77b7a9e07 None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:26.604328 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71669fc-f27b-4672-9ef7-f5e77b7a9e07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:26.622755 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.auth.core [None req-a71669fc-f27b-4672-9ef7-f5e77b7a9e07 None None] MFA Rules not processed for user `ad2b99c2122a4311996364e982e1c801`. Rule list: `[]` (Enabled: `True`). {{(pid=80474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:39:26.624128 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-a71669fc-f27b-4672-9ef7-f5e77b7a9e07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:39:26.686526 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 758/1518] 10.222.0.91 () {58 vars in 1015 bytes} [Wed May 25 14:39:26 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:39:35.923801 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=37 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:39:36.290388 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e45da0-cbce-4773-97ad-02918a7799f9 None None] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:36.290682 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e45da0-cbce-4773-97ad-02918a7799f9 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:36.290965 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e45da0-cbce-4773-97ad-02918a7799f9 None None] PATH_INFO: `/` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:36.292405 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 761/1519] 10.222.0.67 () {54 vars in 960 bytes} [Wed May 25 14:39:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:39:36.297935 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3e2af0-88bc-4e04-8d81-3b2a5260d6c5 None None] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:36.298392 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3e2af0-88bc-4e04-8d81-3b2a5260d6c5 None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:36.298486 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3e2af0-88bc-4e04-8d81-3b2a5260d6c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:36.316942 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.auth.core [None req-fd3e2af0-88bc-4e04-8d81-3b2a5260d6c5 None None] MFA Rules not processed for user `ad2b99c2122a4311996364e982e1c801`. Rule list: `[]` (Enabled: `True`). {{(pid=80474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:39:36.318122 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-fd3e2af0-88bc-4e04-8d81-3b2a5260d6c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:39:36.326473 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 759/1520] 10.222.0.67 () {58 vars in 1057 bytes} [Wed May 25 14:39:36 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:39:36.334097 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e45da0-cbce-4773-97ad-02918a7799f9 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:36.349001 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e45da0-cbce-4773-97ad-02918a7799f9 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:36.353806 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8b4b58-1482-4eb5-97e7-be2bd9d74058 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad2b99c2122a4311996364e982e1c801', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfe93ee8d32a441295efc0b885de4bd7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:36.354439 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8b4b58-1482-4eb5-97e7-be2bd9d74058 service placement] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:36.354720 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8b4b58-1482-4eb5-97e7-be2bd9d74058 service placement] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:36.355092 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8b4b58-1482-4eb5-97e7-be2bd9d74058 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:36.365694 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8b4b58-1482-4eb5-97e7-be2bd9d74058 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:39:36.368020 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8b4b58-1482-4eb5-97e7-be2bd9d74058 service placement] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:39:36.378054 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 762/1521] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 14:39:36 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:39:37.426792 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cad3a6-a67a-458f-9881-b817576e0fa6 None None] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:37.427291 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cad3a6-a67a-458f-9881-b817576e0fa6 None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:37.427387 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cad3a6-a67a-458f-9881-b817576e0fa6 None None] PATH_INFO: `/` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:37.428829 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 760/1522] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 25 14:39:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:39:37.433579 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83113ace-9641-4d21-bdf1-872ac94cf6fc None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:37.434009 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83113ace-9641-4d21-bdf1-872ac94cf6fc None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:37.434192 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83113ace-9641-4d21-bdf1-872ac94cf6fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:37.453215 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-83113ace-9641-4d21-bdf1-872ac94cf6fc None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:39:37.454411 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-83113ace-9641-4d21-bdf1-872ac94cf6fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:39:37.462183 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 763/1523] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 25 14:39:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:39:37.620168 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cad3a6-a67a-458f-9881-b817576e0fa6 None None] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:37.635992 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cad3a6-a67a-458f-9881-b817576e0fa6 None None] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:37.641753 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52290ff4-e688-47f2-83bf-3d84d1670267 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '428ec99478284743943ed41e9d24a603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfe93ee8d32a441295efc0b885de4bd7', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:37.642388 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52290ff4-e688-47f2-83bf-3d84d1670267 service nova] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:37.642672 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52290ff4-e688-47f2-83bf-3d84d1670267 service nova] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:37.642947 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52290ff4-e688-47f2-83bf-3d84d1670267 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:37.650887 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52290ff4-e688-47f2-83bf-3d84d1670267 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:39:37.652515 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52290ff4-e688-47f2-83bf-3d84d1670267 service nova] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:39:37.662397 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 761/1524] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 14:39:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:39:38.563046 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f39011e-9247-4077-9ff1-0e83fb092efa None None] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:38.563578 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f39011e-9247-4077-9ff1-0e83fb092efa None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:38.563696 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f39011e-9247-4077-9ff1-0e83fb092efa None None] PATH_INFO: `/` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:38.564979 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 764/1525] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 25 14:39:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:39:38.569769 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f5500d-6a4c-4755-98fb-b7d2357c67c1 None None] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:38.570199 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f5500d-6a4c-4755-98fb-b7d2357c67c1 None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:38.570325 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f5500d-6a4c-4755-98fb-b7d2357c67c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:38.588726 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.auth.core [None req-16f5500d-6a4c-4755-98fb-b7d2357c67c1 None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:39:38.589918 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-16f5500d-6a4c-4755-98fb-b7d2357c67c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:39:38.598125 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 762/1526] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 25 14:39:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:39:38.748149 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f39011e-9247-4077-9ff1-0e83fb092efa None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:38.762898 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f39011e-9247-4077-9ff1-0e83fb092efa None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:38.768831 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412fdd8a-10f4-4117-9b38-63bf19a52475 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '428ec99478284743943ed41e9d24a603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfe93ee8d32a441295efc0b885de4bd7', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:38.769456 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412fdd8a-10f4-4117-9b38-63bf19a52475 service nova] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:38.769738 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412fdd8a-10f4-4117-9b38-63bf19a52475 service nova] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:38.770012 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412fdd8a-10f4-4117-9b38-63bf19a52475 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:38.777928 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412fdd8a-10f4-4117-9b38-63bf19a52475 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:39:38.779538 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412fdd8a-10f4-4117-9b38-63bf19a52475 service nova] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:39:38.788800 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 765/1527] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 14:39:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:39:42.903247 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388be78b-fcd7-4680-a4b0-936d3e097456 None None] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:42.903800 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388be78b-fcd7-4680-a4b0-936d3e097456 None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:42.903800 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388be78b-fcd7-4680-a4b0-936d3e097456 None None] PATH_INFO: `/` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:42.905196 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 763/1528] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 25 14:39:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:39:42.911115 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd1d812-c14b-4425-8922-2bb72f5cc06a None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:42.911524 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd1d812-c14b-4425-8922-2bb72f5cc06a None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:42.911680 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd1d812-c14b-4425-8922-2bb72f5cc06a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:42.929393 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-4bd1d812-c14b-4425-8922-2bb72f5cc06a None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:39:42.930573 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-4bd1d812-c14b-4425-8922-2bb72f5cc06a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:39:42.938884 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 766/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 25 14:39:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:39:42.975744 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388be78b-fcd7-4680-a4b0-936d3e097456 None None] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:42.977438 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-388be78b-fcd7-4680-a4b0-936d3e097456 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:39:43.037358 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388be78b-fcd7-4680-a4b0-936d3e097456 None None] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:43.040898 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb70ff8-3842-4915-b138-41e42c204f4f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b68eed985c7b49839bcdd173186ad4ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfe93ee8d32a441295efc0b885de4bd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:43.041541 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb70ff8-3842-4915-b138-41e42c204f4f service neutron] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:43.041830 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb70ff8-3842-4915-b138-41e42c204f4f service neutron] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:43.042112 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb70ff8-3842-4915-b138-41e42c204f4f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:43.051100 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb70ff8-3842-4915-b138-41e42c204f4f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:39:43.052803 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb70ff8-3842-4915-b138-41e42c204f4f service neutron] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:39:43.057749 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:39:43.063547 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 764/1530] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 14:39:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:39:45.270416 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d129c7f5-839f-4b77-b390-2f5144f13785 None None] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:45.270965 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d129c7f5-839f-4b77-b390-2f5144f13785 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:45.270965 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d129c7f5-839f-4b77-b390-2f5144f13785 None None] PATH_INFO: `/` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:45.272379 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 767/1531] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 25 14:39:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:39:45.277495 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42b5a0c-931e-4e6a-8566-6b2f723fbf6b None None] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:45.277938 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42b5a0c-931e-4e6a-8566-6b2f723fbf6b None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:45.278065 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42b5a0c-931e-4e6a-8566-6b2f723fbf6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:45.297224 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.auth.core [None req-b42b5a0c-931e-4e6a-8566-6b2f723fbf6b None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:39:45.298428 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-b42b5a0c-931e-4e6a-8566-6b2f723fbf6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:39:45.306221 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 765/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 25 14:39:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:39:45.341548 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d129c7f5-839f-4b77-b390-2f5144f13785 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:45.353024 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d129c7f5-839f-4b77-b390-2f5144f13785 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:45.356565 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ca7118-f1aa-49ce-9369-28db00c865ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b68eed985c7b49839bcdd173186ad4ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfe93ee8d32a441295efc0b885de4bd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:45.357193 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ca7118-f1aa-49ce-9369-28db00c865ff service neutron] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:45.357478 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ca7118-f1aa-49ce-9369-28db00c865ff service neutron] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:45.357756 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ca7118-f1aa-49ce-9369-28db00c865ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:45.367279 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ca7118-f1aa-49ce-9369-28db00c865ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:39:45.368717 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ca7118-f1aa-49ce-9369-28db00c865ff service neutron] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:39:45.377914 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 768/1533] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 14:39:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:39:49.183260 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bd60d4-34d2-4a77-a1b6-93a9210dff36 None None] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:49.183809 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bd60d4-34d2-4a77-a1b6-93a9210dff36 None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:49.183809 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bd60d4-34d2-4a77-a1b6-93a9210dff36 None None] PATH_INFO: `/` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:49.185128 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 766/1534] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 25 14:39:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:39:49.190499 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178b89a9-70ef-4a23-91f0-e47f1eb22d41 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:49.190913 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178b89a9-70ef-4a23-91f0-e47f1eb22d41 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:49.191105 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178b89a9-70ef-4a23-91f0-e47f1eb22d41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:49.208687 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-178b89a9-70ef-4a23-91f0-e47f1eb22d41 None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:39:49.209882 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-178b89a9-70ef-4a23-91f0-e47f1eb22d41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:39:49.217586 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 769/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 25 14:39:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:39:49.490577 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bd60d4-34d2-4a77-a1b6-93a9210dff36 None None] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:49.492252 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-f3bd60d4-34d2-4a77-a1b6-93a9210dff36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:39:49.548731 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bd60d4-34d2-4a77-a1b6-93a9210dff36 None None] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:49.552180 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137213e6-8e2b-49e9-ab58-f5bd0609910f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e462acc9da84a61bb23998dd54e1858', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfe93ee8d32a441295efc0b885de4bd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:49.552814 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137213e6-8e2b-49e9-ab58-f5bd0609910f service cinder] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:49.553097 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137213e6-8e2b-49e9-ab58-f5bd0609910f service cinder] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:49.553368 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137213e6-8e2b-49e9-ab58-f5bd0609910f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:49.562568 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137213e6-8e2b-49e9-ab58-f5bd0609910f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:39:49.564004 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137213e6-8e2b-49e9-ab58-f5bd0609910f service cinder] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:39:49.573122 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 767/1536] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 14:39:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:39:51.813581 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ab86a1-bd3c-439f-ab02-a28a1f66aeac None None] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:51.814172 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ab86a1-bd3c-439f-ab02-a28a1f66aeac None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:51.814172 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ab86a1-bd3c-439f-ab02-a28a1f66aeac None None] PATH_INFO: `/` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:51.815566 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 770/1537] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 25 14:39:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:39:51.820881 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ba6d30-7bb4-4b4c-80c7-a063021504b6 None None] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:51.821303 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ba6d30-7bb4-4b4c-80c7-a063021504b6 None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:51.821450 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ba6d30-7bb4-4b4c-80c7-a063021504b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:51.841311 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.auth.core [None req-f8ba6d30-7bb4-4b4c-80c7-a063021504b6 None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:39:51.842344 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-f8ba6d30-7bb4-4b4c-80c7-a063021504b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:39:51.851667 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 768/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 25 14:39:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:39:52.127939 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ab86a1-bd3c-439f-ab02-a28a1f66aeac None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:39:52.129875 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-d6ab86a1-bd3c-439f-ab02-a28a1f66aeac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:39:52.143664 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ab86a1-bd3c-439f-ab02-a28a1f66aeac None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:39:52.147354 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d85c570-1a60-415a-89b0-2df5d03a05e1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e462acc9da84a61bb23998dd54e1858', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfe93ee8d32a441295efc0b885de4bd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:39:52.147988 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d85c570-1a60-415a-89b0-2df5d03a05e1 service cinder] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:39:52.148270 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d85c570-1a60-415a-89b0-2df5d03a05e1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:39:52.148547 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d85c570-1a60-415a-89b0-2df5d03a05e1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:39:52.157729 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d85c570-1a60-415a-89b0-2df5d03a05e1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:39:52.159207 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d85c570-1a60-415a-89b0-2df5d03a05e1 service cinder] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:39:52.168527 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 771/1539] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 14:39:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:40:01.834835 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=32 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:40:02.164497 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=33 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:41:33.539340 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f60774f-e180-420a-bb28-77ba01680209 None None] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:41:33.539967 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f60774f-e180-420a-bb28-77ba01680209 None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:41:33.539967 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f60774f-e180-420a-bb28-77ba01680209 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:41:33.568736 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.auth.core [None req-2f60774f-e180-420a-bb28-77ba01680209 None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:41:33.570264 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-2f60774f-e180-420a-bb28-77ba01680209 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:41:33.583329 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 769/1540] 10.222.0.67 () {58 vars in 957 bytes} [Wed May 25 14:41:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:41:33.594014 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd74ca3-836a-4d58-9fa4-0248b7517f1a None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:41:33.594603 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd74ca3-836a-4d58-9fa4-0248b7517f1a None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:41:33.594603 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd74ca3-836a-4d58-9fa4-0248b7517f1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:41:33.602010 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75bfe41-79f2-4e59-b418-9ad313d1ea4a None None] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:41:33.602305 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75bfe41-79f2-4e59-b418-9ad313d1ea4a None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:41:33.602589 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75bfe41-79f2-4e59-b418-9ad313d1ea4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:41:33.624436 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-5bd74ca3-836a-4d58-9fa4-0248b7517f1a None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:41:33.625750 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-5bd74ca3-836a-4d58-9fa4-0248b7517f1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:41:33.640044 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.auth.core [None req-e75bfe41-79f2-4e59-b418-9ad313d1ea4a None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:41:33.640360 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 772/1541] 10.222.0.67 () {58 vars in 957 bytes} [Wed May 25 14:41:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:41:33.641507 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-e75bfe41-79f2-4e59-b418-9ad313d1ea4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:41:33.653934 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 770/1542] 10.222.0.67 () {58 vars in 957 bytes} [Wed May 25 14:41:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:41:33.662620 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd74ca3-836a-4d58-9fa4-0248b7517f1a None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:41:33.665302 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8a956f-a4bf-4b27-9c17-70b756a9ae07 None None] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:41:33.665599 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8a956f-a4bf-4b27-9c17-70b756a9ae07 None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:41:33.665889 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8a956f-a4bf-4b27-9c17-70b756a9ae07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:41:33.674897 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd74ca3-836a-4d58-9fa4-0248b7517f1a None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:41:33.689861 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15b08d5-c316-4111-ac8e-2e041f504f87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:41:33.690556 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15b08d5-c316-4111-ac8e-2e041f504f87 admin admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:41:33.690838 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15b08d5-c316-4111-ac8e-2e041f504f87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:41:33.691261 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15b08d5-c316-4111-ac8e-2e041f504f87 admin admin] PATH_INFO: `/v3/domains` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:41:33.692006 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15b08d5-c316-4111-ac8e-2e041f504f87 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:41:33.692311 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15b08d5-c316-4111-ac8e-2e041f504f87 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:41:33.693364 dv-cinder-787296-9-smb devstack@keystone.service[80475]: WARNING py.warnings [None req-c15b08d5-c316-4111-ac8e-2e041f504f87 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 25 14:41:33.693364 dv-cinder-787296-9-smb devstack@keystone.service[80475]: warnings.warn(msg) May 25 14:41:33.693364 dv-cinder-787296-9-smb devstack@keystone.service[80475]: May 25 14:41:33.694260 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15b08d5-c316-4111-ac8e-2e041f504f87 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:41:33.704098 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.auth.core [None req-0c8a956f-a4bf-4b27-9c17-70b756a9ae07 None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:41:33.705837 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-0c8a956f-a4bf-4b27-9c17-70b756a9ae07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:41:33.714784 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 773/1543] 10.222.0.67 () {58 vars in 1152 bytes} [Wed May 25 14:41:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:41:33.716238 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e89cb8-8ec8-4059-a8a9-0f4ec19cbda3 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:41:33.716528 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e89cb8-8ec8-4059-a8a9-0f4ec19cbda3 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:41:33.716951 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e89cb8-8ec8-4059-a8a9-0f4ec19cbda3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:41:33.720802 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 771/1544] 10.222.0.67 () {58 vars in 957 bytes} [Wed May 25 14:41:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 14:41:33.726639 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8a956f-a4bf-4b27-9c17-70b756a9ae07 None None] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:41:33.742439 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8a956f-a4bf-4b27-9c17-70b756a9ae07 None None] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:41:33.752830 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-b1e89cb8-8ec8-4059-a8a9-0f4ec19cbda3 None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:41:33.754150 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-b1e89cb8-8ec8-4059-a8a9-0f4ec19cbda3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:41:33.758008 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920fa367-2086-4df7-9add-2263ae169f51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:41:33.758695 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920fa367-2086-4df7-9add-2263ae169f51 admin admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:41:33.758977 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920fa367-2086-4df7-9add-2263ae169f51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:41:33.759277 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920fa367-2086-4df7-9add-2263ae169f51 admin admin] PATH_INFO: `/v3/domains` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:41:33.760015 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920fa367-2086-4df7-9add-2263ae169f51 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:41:33.760320 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920fa367-2086-4df7-9add-2263ae169f51 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:41:33.763197 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920fa367-2086-4df7-9add-2263ae169f51 admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:41:33.772813 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 774/1545] 10.222.0.67 () {58 vars in 957 bytes} [Wed May 25 14:41:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:41:33.773634 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e89cb8-8ec8-4059-a8a9-0f4ec19cbda3 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:41:33.787400 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 772/1546] 10.222.0.67 () {58 vars in 1152 bytes} [Wed May 25 14:41:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:41:33.788811 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ae9b00-dd6a-4dcf-9a32-5eeaf6523304 None None] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:41:33.789101 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ae9b00-dd6a-4dcf-9a32-5eeaf6523304 None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:41:33.789347 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ae9b00-dd6a-4dcf-9a32-5eeaf6523304 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:41:33.790818 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e89cb8-8ec8-4059-a8a9-0f4ec19cbda3 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:41:33.797617 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb479181-183a-41f5-816b-59f174783bfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:41:33.798289 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb479181-183a-41f5-816b-59f174783bfb admin admin] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:41:33.798571 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb479181-183a-41f5-816b-59f174783bfb admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:41:33.798845 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb479181-183a-41f5-816b-59f174783bfb admin admin] PATH_INFO: `/v3/projects` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:41:33.799628 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb479181-183a-41f5-816b-59f174783bfb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:41:33.801592 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb479181-183a-41f5-816b-59f174783bfb admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:41:33.811670 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.auth.core [None req-90ae9b00-dd6a-4dcf-9a32-5eeaf6523304 None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:41:33.813343 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-90ae9b00-dd6a-4dcf-9a32-5eeaf6523304 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:41:33.823140 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 773/1547] 10.222.0.67 () {58 vars in 957 bytes} [Wed May 25 14:41:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:41:33.827280 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2c4ccc-6bee-40ba-84d1-a97c0dab1af6 None None] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:41:33.827280 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2c4ccc-6bee-40ba-84d1-a97c0dab1af6 None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:41:33.827280 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2c4ccc-6bee-40ba-84d1-a97c0dab1af6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:41:33.866413 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.auth.core [None req-cb2c4ccc-6bee-40ba-84d1-a97c0dab1af6 None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:41:33.867768 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-cb2c4ccc-6bee-40ba-84d1-a97c0dab1af6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:41:33.872544 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 775/1548] 10.222.0.67 () {60 vars in 1152 bytes} [Wed May 25 14:41:33 2022] POST /identity/v3/projects => generated 405 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:41:33.873952 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0094adc8-5c23-4bdc-9f31-041611a83590 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:41:33.874248 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0094adc8-5c23-4bdc-9f31-041611a83590 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:41:33.883712 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0094adc8-5c23-4bdc-9f31-041611a83590 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:41:33.919288 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-0094adc8-5c23-4bdc-9f31-041611a83590 None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:41:33.920495 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-0094adc8-5c23-4bdc-9f31-041611a83590 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:41:33.957782 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 774/1549] 10.222.0.67 () {58 vars in 957 bytes} [Wed May 25 14:41:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:41:33.958573 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2c4ccc-6bee-40ba-84d1-a97c0dab1af6 None None] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:41:33.969362 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2c4ccc-6bee-40ba-84d1-a97c0dab1af6 None None] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:41:33.975648 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5acede-8738-439b-a234-dcadb02e340b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:41:33.976319 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5acede-8738-439b-a234-dcadb02e340b admin admin] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:41:33.976631 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5acede-8738-439b-a234-dcadb02e340b admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:41:33.977045 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5acede-8738-439b-a234-dcadb02e340b admin admin] PATH_INFO: `/v3/projects` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:41:33.977751 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5acede-8738-439b-a234-dcadb02e340b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:41:33.978784 dv-cinder-787296-9-smb devstack@keystone.service[80474]: WARNING py.warnings [None req-9c5acede-8738-439b-a234-dcadb02e340b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 25 14:41:33.978784 dv-cinder-787296-9-smb devstack@keystone.service[80474]: warnings.warn(msg) May 25 14:41:33.978784 dv-cinder-787296-9-smb devstack@keystone.service[80474]: May 25 14:41:33.980133 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5acede-8738-439b-a234-dcadb02e340b admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:41:34.004119 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 776/1550] 10.222.0.67 () {58 vars in 957 bytes} [Wed May 25 14:41:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:41:34.004956 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed2abf3-195b-43c8-9350-9f7aefc7eeca None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:41:34.005495 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed2abf3-195b-43c8-9350-9f7aefc7eeca None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:41:34.005772 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed2abf3-195b-43c8-9350-9f7aefc7eeca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:41:34.024788 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 775/1551] 10.222.0.67 () {60 vars in 1152 bytes} [Wed May 25 14:41:33 2022] POST /identity/v3/projects => generated 371 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:41:34.025668 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5acede-8738-439b-a234-dcadb02e340b admin admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:41:34.026268 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-eed2abf3-195b-43c8-9350-9f7aefc7eeca None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:41:34.027487 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-eed2abf3-195b-43c8-9350-9f7aefc7eeca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:41:34.108068 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 777/1552] 10.222.0.67 () {58 vars in 957 bytes} [Wed May 25 14:41:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:41:34.113603 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5860b8-428a-4098-9d60-9ad8993430b0 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:41:34.113996 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5860b8-428a-4098-9d60-9ad8993430b0 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:41:34.114186 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5860b8-428a-4098-9d60-9ad8993430b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:41:34.116681 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5acede-8738-439b-a234-dcadb02e340b admin admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:41:34.124836 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5203a6c-1070-4631-b7ec-959a6b9608a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:41:34.125426 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5203a6c-1070-4631-b7ec-959a6b9608a0 admin admin] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:41:34.125747 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5203a6c-1070-4631-b7ec-959a6b9608a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:41:34.126170 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5203a6c-1070-4631-b7ec-959a6b9608a0 admin admin] PATH_INFO: `/v3/users` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:41:34.127248 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5203a6c-1070-4631-b7ec-959a6b9608a0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:41:34.131302 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5203a6c-1070-4631-b7ec-959a6b9608a0 admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:41:34.139307 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-1e5860b8-428a-4098-9d60-9ad8993430b0 None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:41:34.141039 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-1e5860b8-428a-4098-9d60-9ad8993430b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:41:34.151521 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 778/1553] 10.222.0.67 () {58 vars in 957 bytes} [Wed May 25 14:41:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:41:34.152579 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5860b8-428a-4098-9d60-9ad8993430b0 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:41:34.161922 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 776/1554] 10.222.0.67 () {60 vars in 1143 bytes} [Wed May 25 14:41:34 2022] POST /identity/v3/users => generated 303 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:41:34.163608 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5860b8-428a-4098-9d60-9ad8993430b0 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:41:34.163966 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e35a41e-1eca-433c-883a-47841beac1e9 None None] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:41:34.164440 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e35a41e-1eca-433c-883a-47841beac1e9 None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:41:34.164959 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e35a41e-1eca-433c-883a-47841beac1e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:41:34.170778 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6acb6a0-b7c4-464b-a934-9626085251cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:41:34.171569 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6acb6a0-b7c4-464b-a934-9626085251cc admin admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:41:34.171885 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6acb6a0-b7c4-464b-a934-9626085251cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:41:34.172165 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6acb6a0-b7c4-464b-a934-9626085251cc admin admin] PATH_INFO: `/v3/domains` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:41:34.172906 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6acb6a0-b7c4-464b-a934-9626085251cc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:41:34.173211 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6acb6a0-b7c4-464b-a934-9626085251cc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:41:34.175770 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6acb6a0-b7c4-464b-a934-9626085251cc admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:41:34.187537 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.auth.core [None req-9e35a41e-1eca-433c-883a-47841beac1e9 None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:41:34.188947 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-9e35a41e-1eca-433c-883a-47841beac1e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:41:34.195177 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 779/1555] 10.222.0.67 () {58 vars in 1152 bytes} [Wed May 25 14:41:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:41:34.195177 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701d7861-f18e-4eab-92fd-b5428c0b7024 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:41:34.195177 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701d7861-f18e-4eab-92fd-b5428c0b7024 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:41:34.195177 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701d7861-f18e-4eab-92fd-b5428c0b7024 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:41:34.202622 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 777/1556] 10.222.0.67 () {58 vars in 957 bytes} [Wed May 25 14:41:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:41:34.204077 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b11793-cde6-4c68-a5b2-7e0dcbd32c0d None None] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:41:34.204371 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b11793-cde6-4c68-a5b2-7e0dcbd32c0d None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:41:34.204657 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b11793-cde6-4c68-a5b2-7e0dcbd32c0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:41:34.213743 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-701d7861-f18e-4eab-92fd-b5428c0b7024 None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:41:34.214958 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-701d7861-f18e-4eab-92fd-b5428c0b7024 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:41:34.223688 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 780/1557] 10.222.0.67 () {58 vars in 957 bytes} [Wed May 25 14:41:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:41:34.223941 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.auth.core [None req-11b11793-cde6-4c68-a5b2-7e0dcbd32c0d None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:41:34.224324 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701d7861-f18e-4eab-92fd-b5428c0b7024 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:41:34.225296 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-11b11793-cde6-4c68-a5b2-7e0dcbd32c0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:41:34.233295 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 778/1558] 10.222.0.67 () {58 vars in 957 bytes} [Wed May 25 14:41:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:41:34.234063 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b11793-cde6-4c68-a5b2-7e0dcbd32c0d None None] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:41:34.237596 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701d7861-f18e-4eab-92fd-b5428c0b7024 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:41:34.243041 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdd0cb4-a085-4bfc-bb3a-9e65de2d4ac7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:41:34.243714 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdd0cb4-a085-4bfc-bb3a-9e65de2d4ac7 admin admin] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:41:34.243998 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdd0cb4-a085-4bfc-bb3a-9e65de2d4ac7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:41:34.244279 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdd0cb4-a085-4bfc-bb3a-9e65de2d4ac7 admin admin] PATH_INFO: `/v3/users` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:41:34.244605 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b11793-cde6-4c68-a5b2-7e0dcbd32c0d None None] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:41:34.244971 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdd0cb4-a085-4bfc-bb3a-9e65de2d4ac7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:41:34.246000 dv-cinder-787296-9-smb devstack@keystone.service[80475]: WARNING py.warnings [None req-0fdd0cb4-a085-4bfc-bb3a-9e65de2d4ac7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 25 14:41:34.246000 dv-cinder-787296-9-smb devstack@keystone.service[80475]: warnings.warn(msg) May 25 14:41:34.246000 dv-cinder-787296-9-smb devstack@keystone.service[80475]: May 25 14:41:34.247394 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdd0cb4-a085-4bfc-bb3a-9e65de2d4ac7 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:41:34.249102 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db173ff0-5258-4414-9f0a-ebcf23fce397 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:41:34.249747 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db173ff0-5258-4414-9f0a-ebcf23fce397 admin admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:41:34.250030 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db173ff0-5258-4414-9f0a-ebcf23fce397 admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:41:34.250305 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db173ff0-5258-4414-9f0a-ebcf23fce397 admin admin] PATH_INFO: `/v3/domains` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:41:34.251054 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db173ff0-5258-4414-9f0a-ebcf23fce397 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:41:34.251361 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db173ff0-5258-4414-9f0a-ebcf23fce397 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:41:34.253029 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db173ff0-5258-4414-9f0a-ebcf23fce397 admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:41:34.273600 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 779/1559] 10.222.0.67 () {58 vars in 1152 bytes} [Wed May 25 14:41:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:41:34.273600 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5938e783-ee81-4d2b-9ebe-b69189ee32f7 None None] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:41:34.273600 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5938e783-ee81-4d2b-9ebe-b69189ee32f7 None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:41:34.273600 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5938e783-ee81-4d2b-9ebe-b69189ee32f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:41:34.274031 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 781/1560] 10.222.0.67 () {60 vars in 1143 bytes} [Wed May 25 14:41:34 2022] POST /identity/v3/users => generated 286 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:41:34.274031 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdd0cb4-a085-4bfc-bb3a-9e65de2d4ac7 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:41:34.276837 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:41:34.279437 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdd0cb4-a085-4bfc-bb3a-9e65de2d4ac7 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:41:34.284599 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce757f7b-9f20-48a1-b5a1-1b827b8a0eaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:41:34.285259 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce757f7b-9f20-48a1-b5a1-1b827b8a0eaf admin admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:41:34.285824 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce757f7b-9f20-48a1-b5a1-1b827b8a0eaf admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:41:34.285824 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce757f7b-9f20-48a1-b5a1-1b827b8a0eaf admin admin] PATH_INFO: `/v3/roles` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:41:34.286546 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce757f7b-9f20-48a1-b5a1-1b827b8a0eaf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:41:34.288183 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce757f7b-9f20-48a1-b5a1-1b827b8a0eaf admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:41:34.290478 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:41:34.291368 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.auth.core [None req-5938e783-ee81-4d2b-9ebe-b69189ee32f7 None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:41:34.292848 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-5938e783-ee81-4d2b-9ebe-b69189ee32f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:41:34.302439 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 780/1561] 10.222.0.67 () {58 vars in 957 bytes} [Wed May 25 14:41:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:41:34.302909 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 782/1562] 10.222.0.67 () {58 vars in 1121 bytes} [Wed May 25 14:41:34 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:41:34.303165 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5938e783-ee81-4d2b-9ebe-b69189ee32f7 None None] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:41:34.304748 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6158cf0e-3195-41b1-a327-c31662aba415 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:41:34.305253 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6158cf0e-3195-41b1-a327-c31662aba415 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:41:34.305688 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6158cf0e-3195-41b1-a327-c31662aba415 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:41:34.312652 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5938e783-ee81-4d2b-9ebe-b69189ee32f7 None None] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:41:34.317517 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c637d7-33d0-4507-8e54-fdb0e5f11904 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:41:34.318186 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c637d7-33d0-4507-8e54-fdb0e5f11904 admin admin] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:41:34.318466 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c637d7-33d0-4507-8e54-fdb0e5f11904 admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:41:34.318740 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c637d7-33d0-4507-8e54-fdb0e5f11904 admin admin] PATH_INFO: `/v3/projects` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:41:34.319454 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c637d7-33d0-4507-8e54-fdb0e5f11904 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:41:34.321332 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c637d7-33d0-4507-8e54-fdb0e5f11904 admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:41:34.323721 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-6158cf0e-3195-41b1-a327-c31662aba415 None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:41:34.324908 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-6158cf0e-3195-41b1-a327-c31662aba415 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:41:34.332746 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 783/1563] 10.222.0.67 () {58 vars in 957 bytes} [Wed May 25 14:41:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:41:34.333589 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6158cf0e-3195-41b1-a327-c31662aba415 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:41:34.343444 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6158cf0e-3195-41b1-a327-c31662aba415 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:41:34.351810 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 781/1564] 10.222.0.67 () {60 vars in 1152 bytes} [Wed May 25 14:41:34 2022] POST /identity/v3/projects => generated 389 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:41:34.351978 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca05d9d-d97d-4077-82db-0a0cb1c28b9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:41:34.351978 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca05d9d-d97d-4077-82db-0a0cb1c28b9c admin admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:41:34.351978 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca05d9d-d97d-4077-82db-0a0cb1c28b9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:41:34.351978 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca05d9d-d97d-4077-82db-0a0cb1c28b9c admin admin] PATH_INFO: `/v3/domains` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:41:34.352370 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765843a2-2c83-4ccf-83d6-8bcd749b1a33 None None] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:41:34.352370 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765843a2-2c83-4ccf-83d6-8bcd749b1a33 None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:41:34.352370 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765843a2-2c83-4ccf-83d6-8bcd749b1a33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:41:34.352630 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca05d9d-d97d-4077-82db-0a0cb1c28b9c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:41:34.352630 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca05d9d-d97d-4077-82db-0a0cb1c28b9c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:41:34.352858 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca05d9d-d97d-4077-82db-0a0cb1c28b9c admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:41:34.372063 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 784/1565] 10.222.0.67 () {58 vars in 1152 bytes} [Wed May 25 14:41:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:41:34.372063 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca05d9d-d97d-4077-82db-0a0cb1c28b9c admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:41:34.372335 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.auth.core [None req-765843a2-2c83-4ccf-83d6-8bcd749b1a33 None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:41:34.372335 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-765843a2-2c83-4ccf-83d6-8bcd749b1a33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:41:34.376090 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca05d9d-d97d-4077-82db-0a0cb1c28b9c admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:41:34.431931 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 782/1566] 10.222.0.67 () {58 vars in 957 bytes} [Wed May 25 14:41:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:41:34.432869 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765843a2-2c83-4ccf-83d6-8bcd749b1a33 None None] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:41:34.433107 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026268dd-7de8-4035-8c6e-22540262b51d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:41:34.433843 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026268dd-7de8-4035-8c6e-22540262b51d admin admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:41:34.434196 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026268dd-7de8-4035-8c6e-22540262b51d admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:41:34.434542 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026268dd-7de8-4035-8c6e-22540262b51d admin admin] PATH_INFO: `/v3/roles` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:41:34.435600 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026268dd-7de8-4035-8c6e-22540262b51d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:41:34.437043 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026268dd-7de8-4035-8c6e-22540262b51d admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:41:34.442638 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765843a2-2c83-4ccf-83d6-8bcd749b1a33 None None] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:41:34.447261 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 785/1567] 10.222.0.67 () {58 vars in 1121 bytes} [Wed May 25 14:41:34 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:41:34.447410 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f05c38-07e4-450e-8585-041e12ced5ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:41:34.448127 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026268dd-7de8-4035-8c6e-22540262b51d admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:41:34.448238 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f05c38-07e4-450e-8585-041e12ced5ce admin admin] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:41:34.448578 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f05c38-07e4-450e-8585-041e12ced5ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:41:34.448918 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f05c38-07e4-450e-8585-041e12ced5ce admin admin] PATH_INFO: `/v3/projects` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:41:34.449673 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f05c38-07e4-450e-8585-041e12ced5ce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:41:34.451685 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f05c38-07e4-450e-8585-041e12ced5ce admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:41:34.457793 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026268dd-7de8-4035-8c6e-22540262b51d admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:41:34.462420 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f958ab29-303c-487e-ab73-4bfec7dc4633 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:41:34.463093 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f958ab29-303c-487e-ab73-4bfec7dc4633 admin admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:41:34.463378 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f958ab29-303c-487e-ab73-4bfec7dc4633 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:41:34.463653 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f958ab29-303c-487e-ab73-4bfec7dc4633 admin admin] PATH_INFO: `/v3/roles` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:41:34.464373 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f958ab29-303c-487e-ab73-4bfec7dc4633 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:41:34.466110 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f958ab29-303c-487e-ab73-4bfec7dc4633 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:41:34.477951 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 786/1568] 10.222.0.67 () {58 vars in 1121 bytes} [Wed May 25 14:41:34 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:41:34.478822 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f958ab29-303c-487e-ab73-4bfec7dc4633 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:41:34.481598 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 783/1569] 10.222.0.67 () {60 vars in 1152 bytes} [Wed May 25 14:41:34 2022] POST /identity/v3/projects => generated 375 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:41:34.481598 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f05c38-07e4-450e-8585-041e12ced5ce admin admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:41:34.491667 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f958ab29-303c-487e-ab73-4bfec7dc4633 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:41:34.545456 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f05c38-07e4-450e-8585-041e12ced5ce admin admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:41:34.548760 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01611012-1731-463c-88bf-a95dd84d9164 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:41:34.550191 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01611012-1731-463c-88bf-a95dd84d9164 admin admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:41:34.550453 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3523c1-1d1e-4f81-8120-6056d5311120 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:41:34.550586 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01611012-1731-463c-88bf-a95dd84d9164 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:41:34.550799 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01611012-1731-463c-88bf-a95dd84d9164 admin admin] PATH_INFO: `/v3/domains` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:41:34.551164 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3523c1-1d1e-4f81-8120-6056d5311120 admin admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:41:34.551450 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3523c1-1d1e-4f81-8120-6056d5311120 admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:41:34.551561 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01611012-1731-463c-88bf-a95dd84d9164 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:41:34.551852 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01611012-1731-463c-88bf-a95dd84d9164 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:41:34.551953 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3523c1-1d1e-4f81-8120-6056d5311120 admin admin] PATH_INFO: `/v3/domains` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:41:34.552581 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3523c1-1d1e-4f81-8120-6056d5311120 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:41:34.552888 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3523c1-1d1e-4f81-8120-6056d5311120 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:41:34.553485 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01611012-1731-463c-88bf-a95dd84d9164 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:41:34.554449 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3523c1-1d1e-4f81-8120-6056d5311120 admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:41:34.572107 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 784/1571] 10.222.0.67 () {58 vars in 1152 bytes} [Wed May 25 14:41:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:41:34.572320 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 787/1571] 10.222.0.67 () {58 vars in 1152 bytes} [Wed May 25 14:41:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:41:34.572320 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01611012-1731-463c-88bf-a95dd84d9164 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:41:34.572514 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3523c1-1d1e-4f81-8120-6056d5311120 admin admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:41:34.582859 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01611012-1731-463c-88bf-a95dd84d9164 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:41:34.583344 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3523c1-1d1e-4f81-8120-6056d5311120 admin admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:41:34.587478 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ec0aab-8dec-4023-9838-fac2e7e926f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:41:34.587997 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4687ca-fa83-4dad-bc77-48875f152204 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:41:34.588123 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ec0aab-8dec-4023-9838-fac2e7e926f9 admin admin] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:41:34.588400 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ec0aab-8dec-4023-9838-fac2e7e926f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:41:34.588655 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4687ca-fa83-4dad-bc77-48875f152204 admin admin] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:41:34.588763 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ec0aab-8dec-4023-9838-fac2e7e926f9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:41:34.588939 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4687ca-fa83-4dad-bc77-48875f152204 admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:41:34.589211 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4687ca-fa83-4dad-bc77-48875f152204 admin admin] PATH_INFO: `/v3/users` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:41:34.589385 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ec0aab-8dec-4023-9838-fac2e7e926f9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:41:34.589891 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4687ca-fa83-4dad-bc77-48875f152204 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:41:34.591355 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ec0aab-8dec-4023-9838-fac2e7e926f9 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:41:34.591848 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4687ca-fa83-4dad-bc77-48875f152204 admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:41:34.614244 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 785/1572] 10.222.0.67 () {60 vars in 1143 bytes} [Wed May 25 14:41:34 2022] POST /identity/v3/users => generated 295 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:41:34.615092 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4687ca-fa83-4dad-bc77-48875f152204 admin admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:41:34.622225 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 788/1573] 10.222.0.67 () {60 vars in 1152 bytes} [Wed May 25 14:41:34 2022] POST /identity/v3/projects => generated 393 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:41:34.622225 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ec0aab-8dec-4023-9838-fac2e7e926f9 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:41:34.628640 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4687ca-fa83-4dad-bc77-48875f152204 admin admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:41:34.655735 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:41:34.666092 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:41:34.689885 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf49ed5-46c3-496a-8e6e-021f274ce086 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:41:34.690564 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf49ed5-46c3-496a-8e6e-021f274ce086 admin admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:41:34.690850 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf49ed5-46c3-496a-8e6e-021f274ce086 admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:41:34.691175 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf49ed5-46c3-496a-8e6e-021f274ce086 admin admin] PATH_INFO: `/v3/domains` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:41:34.691913 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf49ed5-46c3-496a-8e6e-021f274ce086 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:41:34.692226 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf49ed5-46c3-496a-8e6e-021f274ce086 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:41:34.693847 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf49ed5-46c3-496a-8e6e-021f274ce086 admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:41:34.694377 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ec0aab-8dec-4023-9838-fac2e7e926f9 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:41:34.699469 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca42104-ea97-49e0-b542-ea8e71dc3b27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:41:34.700136 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca42104-ea97-49e0-b542-ea8e71dc3b27 admin admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:41:34.700860 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca42104-ea97-49e0-b542-ea8e71dc3b27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:41:34.700860 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca42104-ea97-49e0-b542-ea8e71dc3b27 admin admin] PATH_INFO: `/v3/roles` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:41:34.701397 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca42104-ea97-49e0-b542-ea8e71dc3b27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:41:34.703153 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca42104-ea97-49e0-b542-ea8e71dc3b27 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:41:34.706453 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 786/1574] 10.222.0.67 () {58 vars in 1152 bytes} [Wed May 25 14:41:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:41:34.707442 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf49ed5-46c3-496a-8e6e-021f274ce086 admin admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:41:34.715377 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 789/1575] 10.222.0.67 () {58 vars in 1121 bytes} [Wed May 25 14:41:34 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:41:34.716189 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca42104-ea97-49e0-b542-ea8e71dc3b27 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:41:34.725158 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf49ed5-46c3-496a-8e6e-021f274ce086 admin admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:41:34.727639 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca42104-ea97-49e0-b542-ea8e71dc3b27 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:41:34.729754 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e848f979-3660-47f6-8d86-7702ef4f2efc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:41:34.730641 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e848f979-3660-47f6-8d86-7702ef4f2efc admin admin] REQUEST_METHOD: `PUT` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:41:34.730936 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e848f979-3660-47f6-8d86-7702ef4f2efc admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:41:34.731272 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e848f979-3660-47f6-8d86-7702ef4f2efc admin admin] PATH_INFO: `/v3/projects/f103ef64a62247c08af8789e30599e47/users/d4364a0642ec40b691742ecedd3018cf/roles/48808901834b4d5eab2c7e6b5b03791e` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:41:34.732538 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e556aa-c972-4635-9ef2-637b6d33c87e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:41:34.733198 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e556aa-c972-4635-9ef2-637b6d33c87e admin admin] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:41:34.733666 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e556aa-c972-4635-9ef2-637b6d33c87e admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:41:34.733954 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e556aa-c972-4635-9ef2-637b6d33c87e admin admin] PATH_INFO: `/v3/users` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:41:34.734657 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e556aa-c972-4635-9ef2-637b6d33c87e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:41:34.737296 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e556aa-c972-4635-9ef2-637b6d33c87e admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:41:34.747365 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e848f979-3660-47f6-8d86-7702ef4f2efc admin admin] RBAC: Authorizing `identity:create_grant(project_id=f103ef64a62247c08af8789e30599e47, user_id=d4364a0642ec40b691742ecedd3018cf, role_id=48808901834b4d5eab2c7e6b5b03791e)` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:41:34.748605 dv-cinder-787296-9-smb devstack@keystone.service[80474]: WARNING py.warnings [None req-e848f979-3660-47f6-8d86-7702ef4f2efc admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 25 14:41:34.748605 dv-cinder-787296-9-smb devstack@keystone.service[80474]: warnings.warn(msg) May 25 14:41:34.748605 dv-cinder-787296-9-smb devstack@keystone.service[80474]: May 25 14:41:34.750710 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e848f979-3660-47f6-8d86-7702ef4f2efc admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:41:34.760672 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 790/1576] 10.222.0.67 () {60 vars in 1143 bytes} [Wed May 25 14:41:34 2022] POST /identity/v3/users => generated 288 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:41:34.761548 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e556aa-c972-4635-9ef2-637b6d33c87e admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:41:34.765881 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 787/1577] 10.222.0.67 () {60 vars in 1482 bytes} [Wed May 25 14:41:34 2022] PUT /identity/v3/projects/f103ef64a62247c08af8789e30599e47/users/d4364a0642ec40b691742ecedd3018cf/roles/48808901834b4d5eab2c7e6b5b03791e => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:41:34.766716 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e848f979-3660-47f6-8d86-7702ef4f2efc admin admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:41:34.773003 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e556aa-c972-4635-9ef2-637b6d33c87e admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:41:34.833388 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e848f979-3660-47f6-8d86-7702ef4f2efc admin admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:41:34.834268 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000de106-541c-42fc-ac33-c4e0a539e282 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:41:34.834937 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000de106-541c-42fc-ac33-c4e0a539e282 admin admin] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:41:34.835372 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000de106-541c-42fc-ac33-c4e0a539e282 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:41:34.835764 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000de106-541c-42fc-ac33-c4e0a539e282 admin admin] PATH_INFO: `/v3/projects` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:41:34.836469 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000de106-541c-42fc-ac33-c4e0a539e282 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:41:34.838114 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c854382-199d-436e-b28d-7211c3eb2eb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:41:34.838552 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000de106-541c-42fc-ac33-c4e0a539e282 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:41:34.839155 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c854382-199d-436e-b28d-7211c3eb2eb6 admin admin] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:41:34.839731 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c854382-199d-436e-b28d-7211c3eb2eb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:41:34.840157 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c854382-199d-436e-b28d-7211c3eb2eb6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:41:34.840987 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c854382-199d-436e-b28d-7211c3eb2eb6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:41:34.843212 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c854382-199d-436e-b28d-7211c3eb2eb6 admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:41:34.869168 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 791/1578] 10.222.0.67 () {60 vars in 1152 bytes} [Wed May 25 14:41:34 2022] POST /identity/v3/projects => generated 377 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:41:34.870085 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000de106-541c-42fc-ac33-c4e0a539e282 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:41:34.879914 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 788/1579] 10.222.0.67 () {60 vars in 1152 bytes} [Wed May 25 14:41:34 2022] POST /identity/v3/projects => generated 373 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:41:34.879914 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c854382-199d-436e-b28d-7211c3eb2eb6 admin admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:41:34.935927 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000de106-541c-42fc-ac33-c4e0a539e282 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:41:34.941660 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9074b632-82eb-44b6-986a-6bbf784768ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:41:34.941829 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c854382-199d-436e-b28d-7211c3eb2eb6 admin admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:41:34.942339 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9074b632-82eb-44b6-986a-6bbf784768ff admin admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:41:34.942625 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9074b632-82eb-44b6-986a-6bbf784768ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:41:34.942905 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9074b632-82eb-44b6-986a-6bbf784768ff admin admin] PATH_INFO: `/v3/roles` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:41:34.943682 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9074b632-82eb-44b6-986a-6bbf784768ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:41:34.945281 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9074b632-82eb-44b6-986a-6bbf784768ff admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:41:34.946283 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2eef99-6ac6-4f22-a827-0f5a05b27e29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:41:34.946947 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2eef99-6ac6-4f22-a827-0f5a05b27e29 admin admin] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:41:34.947258 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2eef99-6ac6-4f22-a827-0f5a05b27e29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:41:34.947537 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2eef99-6ac6-4f22-a827-0f5a05b27e29 admin admin] PATH_INFO: `/v3/users` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:41:34.948229 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2eef99-6ac6-4f22-a827-0f5a05b27e29 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:41:34.950137 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2eef99-6ac6-4f22-a827-0f5a05b27e29 admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:41:34.956957 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 792/1580] 10.222.0.67 () {58 vars in 1121 bytes} [Wed May 25 14:41:34 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:41:34.956957 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9074b632-82eb-44b6-986a-6bbf784768ff admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:41:34.967100 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9074b632-82eb-44b6-986a-6bbf784768ff admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:41:34.970741 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 789/1581] 10.222.0.67 () {60 vars in 1143 bytes} [Wed May 25 14:41:34 2022] POST /identity/v3/users => generated 297 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:41:34.972675 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2eef99-6ac6-4f22-a827-0f5a05b27e29 admin admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:41:34.973060 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7ad6e2-5a65-48c2-99e7-b590f6f703ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:41:34.973720 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7ad6e2-5a65-48c2-99e7-b590f6f703ef admin admin] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:41:34.974012 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7ad6e2-5a65-48c2-99e7-b590f6f703ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:41:34.974473 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7ad6e2-5a65-48c2-99e7-b590f6f703ef admin admin] PATH_INFO: `/v3/projects` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:41:34.975064 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7ad6e2-5a65-48c2-99e7-b590f6f703ef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:41:34.976962 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7ad6e2-5a65-48c2-99e7-b590f6f703ef admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:41:34.982535 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2eef99-6ac6-4f22-a827-0f5a05b27e29 admin admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:41:34.987408 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f11846-c40c-4bc9-bd7e-d893c7b64ef0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:41:34.988314 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f11846-c40c-4bc9-bd7e-d893c7b64ef0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:41:34.988601 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f11846-c40c-4bc9-bd7e-d893c7b64ef0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:41:34.988884 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f11846-c40c-4bc9-bd7e-d893c7b64ef0 admin admin] PATH_INFO: `/v3/projects/2bb3b5d269c34d45a2134a921c591027/users/d950f4fb5962489ab534f1a4e4393225/roles/48808901834b4d5eab2c7e6b5b03791e` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:41:35.000554 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:41:35.008617 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 793/1582] 10.222.0.67 () {60 vars in 1152 bytes} [Wed May 25 14:41:34 2022] POST /identity/v3/projects => generated 385 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:41:35.008617 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7ad6e2-5a65-48c2-99e7-b590f6f703ef admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:41:35.009725 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f11846-c40c-4bc9-bd7e-d893c7b64ef0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2bb3b5d269c34d45a2134a921c591027, user_id=d950f4fb5962489ab534f1a4e4393225, role_id=48808901834b4d5eab2c7e6b5b03791e)` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:41:35.012854 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f11846-c40c-4bc9-bd7e-d893c7b64ef0 admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:41:35.022011 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:41:35.027690 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 790/1583] 10.222.0.67 () {60 vars in 1482 bytes} [Wed May 25 14:41:34 2022] PUT /identity/v3/projects/2bb3b5d269c34d45a2134a921c591027/users/d950f4fb5962489ab534f1a4e4393225/roles/48808901834b4d5eab2c7e6b5b03791e => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:41:35.030147 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec58ab8-fa5a-4ed6-88de-b1f6cc8b04d5 None None] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:41:35.030441 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec58ab8-fa5a-4ed6-88de-b1f6cc8b04d5 None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:41:35.030725 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec58ab8-fa5a-4ed6-88de-b1f6cc8b04d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:41:35.047973 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.auth.core [None req-9ec58ab8-fa5a-4ed6-88de-b1f6cc8b04d5 None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:41:35.049341 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-9ec58ab8-fa5a-4ed6-88de-b1f6cc8b04d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:41:35.083167 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7ad6e2-5a65-48c2-99e7-b590f6f703ef admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:41:35.110422 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 791/1584] 10.222.0.67 () {58 vars in 957 bytes} [Wed May 25 14:41:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:41:35.111213 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec58ab8-fa5a-4ed6-88de-b1f6cc8b04d5 None None] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:41:35.120875 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec58ab8-fa5a-4ed6-88de-b1f6cc8b04d5 None None] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:41:35.125665 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7287b3-1151-4f18-a4ba-83fdc5b9aeb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:41:35.126378 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7287b3-1151-4f18-a4ba-83fdc5b9aeb6 admin admin] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:41:35.126910 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7287b3-1151-4f18-a4ba-83fdc5b9aeb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:41:35.126910 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7287b3-1151-4f18-a4ba-83fdc5b9aeb6 admin admin] PATH_INFO: `/v3/users` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:41:35.128295 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7287b3-1151-4f18-a4ba-83fdc5b9aeb6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:41:35.133105 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7287b3-1151-4f18-a4ba-83fdc5b9aeb6 admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:41:35.145334 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9a04e1-f781-493f-bef5-12ba29713ec9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:41:35.146181 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9a04e1-f781-493f-bef5-12ba29713ec9 admin admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:41:35.146558 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9a04e1-f781-493f-bef5-12ba29713ec9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:41:35.146944 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9a04e1-f781-493f-bef5-12ba29713ec9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:41:35.147676 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9a04e1-f781-493f-bef5-12ba29713ec9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:41:35.149535 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9a04e1-f781-493f-bef5-12ba29713ec9 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:41:35.154443 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 792/1585] 10.222.0.67 () {60 vars in 1143 bytes} [Wed May 25 14:41:35 2022] POST /identity/v3/users => generated 289 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:41:35.155493 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7287b3-1151-4f18-a4ba-83fdc5b9aeb6 admin admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:41:35.169103 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 794/1586] 10.222.0.67 () {58 vars in 1121 bytes} [Wed May 25 14:41:35 2022] GET /identity/v3/roles => generated 1420 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:41:35.169327 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7287b3-1151-4f18-a4ba-83fdc5b9aeb6 admin admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:41:35.169433 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9a04e1-f781-493f-bef5-12ba29713ec9 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:41:35.171241 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150e722d-9c9d-4841-a3d6-f5ebd64dbb20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:41:35.171910 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150e722d-9c9d-4841-a3d6-f5ebd64dbb20 admin admin] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:41:35.172192 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150e722d-9c9d-4841-a3d6-f5ebd64dbb20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:41:35.172466 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150e722d-9c9d-4841-a3d6-f5ebd64dbb20 admin admin] PATH_INFO: `/v3/users` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:41:35.173162 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150e722d-9c9d-4841-a3d6-f5ebd64dbb20 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:41:35.175709 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150e722d-9c9d-4841-a3d6-f5ebd64dbb20 admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:41:35.178514 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9a04e1-f781-493f-bef5-12ba29713ec9 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:41:35.184953 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08678fb-6368-4d44-964f-65992b13163d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:41:35.186098 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08678fb-6368-4d44-964f-65992b13163d admin admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:41:35.186501 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08678fb-6368-4d44-964f-65992b13163d admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:41:35.186870 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08678fb-6368-4d44-964f-65992b13163d admin admin] PATH_INFO: `/v3/roles` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:41:35.187783 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08678fb-6368-4d44-964f-65992b13163d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:41:35.189534 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08678fb-6368-4d44-964f-65992b13163d admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:41:35.197061 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 793/1587] 10.222.0.67 () {60 vars in 1143 bytes} [Wed May 25 14:41:35 2022] POST /identity/v3/users => generated 287 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:41:35.197524 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150e722d-9c9d-4841-a3d6-f5ebd64dbb20 admin admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:41:35.206415 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 795/1588] 10.222.0.67 () {58 vars in 1121 bytes} [Wed May 25 14:41:35 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:41:35.206415 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08678fb-6368-4d44-964f-65992b13163d admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:41:35.207476 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150e722d-9c9d-4841-a3d6-f5ebd64dbb20 admin admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:41:35.212276 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fbcaa8-0f36-4402-ba22-a5ad0f65bbe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:41:35.212943 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fbcaa8-0f36-4402-ba22-a5ad0f65bbe2 admin admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:41:35.213227 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fbcaa8-0f36-4402-ba22-a5ad0f65bbe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:41:35.213504 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fbcaa8-0f36-4402-ba22-a5ad0f65bbe2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:41:35.214233 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fbcaa8-0f36-4402-ba22-a5ad0f65bbe2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:41:35.214725 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08678fb-6368-4d44-964f-65992b13163d admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:41:35.215879 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fbcaa8-0f36-4402-ba22-a5ad0f65bbe2 admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:41:35.220024 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232cd6e0-a632-4c98-b332-552c40ad6992 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:41:35.220698 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232cd6e0-a632-4c98-b332-552c40ad6992 admin admin] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:41:35.221542 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232cd6e0-a632-4c98-b332-552c40ad6992 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:41:35.221817 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232cd6e0-a632-4c98-b332-552c40ad6992 admin admin] PATH_INFO: `/v3/users` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:41:35.222517 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232cd6e0-a632-4c98-b332-552c40ad6992 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:41:35.225031 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232cd6e0-a632-4c98-b332-552c40ad6992 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:41:35.229008 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 794/1589] 10.222.0.67 () {58 vars in 1121 bytes} [Wed May 25 14:41:35 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:41:35.230296 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd58218-6a17-44b0-9431-82cfa50d1d79 None None] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:41:35.230585 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd58218-6a17-44b0-9431-82cfa50d1d79 None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:41:35.230860 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd58218-6a17-44b0-9431-82cfa50d1d79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:41:35.247947 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 796/1590] 10.222.0.67 () {60 vars in 1143 bytes} [Wed May 25 14:41:35 2022] POST /identity/v3/users => generated 293 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:41:35.248855 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232cd6e0-a632-4c98-b332-552c40ad6992 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:41:35.261215 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.auth.core [None req-fbd58218-6a17-44b0-9431-82cfa50d1d79 None None] MFA Rules not processed for user `d950f4fb5962489ab534f1a4e4393225`. Rule list: `[]` (Enabled: `True`). {{(pid=80474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:41:35.262578 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-fbd58218-6a17-44b0-9431-82cfa50d1d79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:41:35.305605 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232cd6e0-a632-4c98-b332-552c40ad6992 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:41:35.309228 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c74e0c-3976-4449-bcf4-04b7fc86d86e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b68eed985c7b49839bcdd173186ad4ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfe93ee8d32a441295efc0b885de4bd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:41:35.309874 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c74e0c-3976-4449-bcf4-04b7fc86d86e service neutron] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:41:35.310161 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c74e0c-3976-4449-bcf4-04b7fc86d86e service neutron] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:41:35.310451 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c74e0c-3976-4449-bcf4-04b7fc86d86e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:41:35.320202 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c74e0c-3976-4449-bcf4-04b7fc86d86e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:41:35.321653 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c74e0c-3976-4449-bcf4-04b7fc86d86e service neutron] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:41:35.335119 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 795/1591] 10.222.0.67 () {58 vars in 957 bytes} [Wed May 25 14:41:35 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:41:35.335321 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 797/1592] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 14:41:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:41:35.335441 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd58218-6a17-44b0-9431-82cfa50d1d79 None None] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:41:35.335541 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c74e0c-3976-4449-bcf4-04b7fc86d86e service neutron] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:41:35.344468 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd58218-6a17-44b0-9431-82cfa50d1d79 None None] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:41:35.344725 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c74e0c-3976-4449-bcf4-04b7fc86d86e service neutron] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:41:35.349495 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5cff7c-ea54-48d1-8191-5c208c6783f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:41:35.349797 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ba73c2-9126-4d8f-a0a9-9df6f79f45a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:41:35.350179 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5cff7c-ea54-48d1-8191-5c208c6783f2 admin admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:41:35.350466 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5cff7c-ea54-48d1-8191-5c208c6783f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:41:35.350590 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ba73c2-9126-4d8f-a0a9-9df6f79f45a7 admin admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:41:35.350752 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5cff7c-ea54-48d1-8191-5c208c6783f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:41:35.350873 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ba73c2-9126-4d8f-a0a9-9df6f79f45a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:41:35.351157 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ba73c2-9126-4d8f-a0a9-9df6f79f45a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:41:35.351529 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5cff7c-ea54-48d1-8191-5c208c6783f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:41:35.351882 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ba73c2-9126-4d8f-a0a9-9df6f79f45a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:41:35.353155 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5cff7c-ea54-48d1-8191-5c208c6783f2 admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:41:35.353480 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ba73c2-9126-4d8f-a0a9-9df6f79f45a7 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:41:35.370959 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 796/1593] 10.222.0.67 () {58 vars in 1121 bytes} [Wed May 25 14:41:35 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:41:35.371310 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 798/1594] 10.222.0.67 () {58 vars in 1121 bytes} [Wed May 25 14:41:35 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:41:35.371409 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5cff7c-ea54-48d1-8191-5c208c6783f2 admin admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:41:35.371523 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ba73c2-9126-4d8f-a0a9-9df6f79f45a7 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:41:35.376245 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5cff7c-ea54-48d1-8191-5c208c6783f2 admin admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:41:35.383177 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ba73c2-9126-4d8f-a0a9-9df6f79f45a7 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:41:35.383410 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf100c7-e63a-42d7-97a7-c7ae1e61483a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:41:35.384100 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf100c7-e63a-42d7-97a7-c7ae1e61483a admin admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:41:35.384387 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf100c7-e63a-42d7-97a7-c7ae1e61483a admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:41:35.384696 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf100c7-e63a-42d7-97a7-c7ae1e61483a admin admin] PATH_INFO: `/v3/roles` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:41:35.385400 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf100c7-e63a-42d7-97a7-c7ae1e61483a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:41:35.387080 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf100c7-e63a-42d7-97a7-c7ae1e61483a admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:41:35.391106 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47501af-f1d9-4808-a4ff-f511a350b1a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:41:35.393520 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47501af-f1d9-4808-a4ff-f511a350b1a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:41:35.394209 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47501af-f1d9-4808-a4ff-f511a350b1a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:41:35.394667 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47501af-f1d9-4808-a4ff-f511a350b1a4 admin admin] PATH_INFO: `/v3/projects/103825b93ee544b9ab0401daaf6fc77a/users/4db7e98c4244461daf725c699fb2b9a3/roles/48808901834b4d5eab2c7e6b5b03791e` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:41:35.398223 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 797/1595] 10.222.0.67 () {58 vars in 1121 bytes} [Wed May 25 14:41:35 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:41:35.399148 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf100c7-e63a-42d7-97a7-c7ae1e61483a admin admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:41:35.410746 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf100c7-e63a-42d7-97a7-c7ae1e61483a admin admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:41:35.417020 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7e4a92-e066-499b-98dd-f04c52de4c63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:41:35.417700 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7e4a92-e066-499b-98dd-f04c52de4c63 admin admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:41:35.417986 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7e4a92-e066-499b-98dd-f04c52de4c63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:41:35.418269 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7e4a92-e066-499b-98dd-f04c52de4c63 admin admin] PATH_INFO: `/v3/roles` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:41:35.419134 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7e4a92-e066-499b-98dd-f04c52de4c63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:41:35.420747 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7e4a92-e066-499b-98dd-f04c52de4c63 admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:41:35.420894 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47501af-f1d9-4808-a4ff-f511a350b1a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=103825b93ee544b9ab0401daaf6fc77a, user_id=4db7e98c4244461daf725c699fb2b9a3, role_id=48808901834b4d5eab2c7e6b5b03791e)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:41:35.425479 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47501af-f1d9-4808-a4ff-f511a350b1a4 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:41:35.427205 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:41:35.431283 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:41:35.438837 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 798/1596] 10.222.0.67 () {58 vars in 1121 bytes} [Wed May 25 14:41:35 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:41:35.438837 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7e4a92-e066-499b-98dd-f04c52de4c63 admin admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:41:35.444859 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 799/1597] 10.222.0.67 () {60 vars in 1482 bytes} [Wed May 25 14:41:35 2022] PUT /identity/v3/projects/103825b93ee544b9ab0401daaf6fc77a/users/4db7e98c4244461daf725c699fb2b9a3/roles/48808901834b4d5eab2c7e6b5b03791e => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:41:35.445812 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47501af-f1d9-4808-a4ff-f511a350b1a4 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:41:35.453468 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7e4a92-e066-499b-98dd-f04c52de4c63 admin admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:41:35.527793 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca584b7d-5c3c-4130-b2ae-d10d313f5e5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:41:35.529094 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca584b7d-5c3c-4130-b2ae-d10d313f5e5a admin admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:41:35.529094 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca584b7d-5c3c-4130-b2ae-d10d313f5e5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:41:35.529410 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47501af-f1d9-4808-a4ff-f511a350b1a4 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:41:35.529522 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca584b7d-5c3c-4130-b2ae-d10d313f5e5a admin admin] PATH_INFO: `/v3/roles` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:41:35.529875 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca584b7d-5c3c-4130-b2ae-d10d313f5e5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:41:35.531631 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca584b7d-5c3c-4130-b2ae-d10d313f5e5a admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:41:35.535254 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44072f25-4a7d-4b11-a23f-4a711a892dae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:41:35.536332 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44072f25-4a7d-4b11-a23f-4a711a892dae admin admin] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:41:35.536629 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44072f25-4a7d-4b11-a23f-4a711a892dae admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:41:35.537042 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44072f25-4a7d-4b11-a23f-4a711a892dae admin admin] PATH_INFO: `/v3/projects` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:41:35.538483 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44072f25-4a7d-4b11-a23f-4a711a892dae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:41:35.540517 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44072f25-4a7d-4b11-a23f-4a711a892dae admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:41:35.542905 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 799/1598] 10.222.0.67 () {58 vars in 1121 bytes} [Wed May 25 14:41:35 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:41:35.547220 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca584b7d-5c3c-4130-b2ae-d10d313f5e5a admin admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:41:35.558500 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca584b7d-5c3c-4130-b2ae-d10d313f5e5a admin admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:41:35.563740 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4ef619-b059-4114-8dfb-6ec0dce44bdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:41:35.564659 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4ef619-b059-4114-8dfb-6ec0dce44bdc admin admin] REQUEST_METHOD: `PUT` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:41:35.565479 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4ef619-b059-4114-8dfb-6ec0dce44bdc admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:41:35.565808 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4ef619-b059-4114-8dfb-6ec0dce44bdc admin admin] PATH_INFO: `/v3/projects/4e6496a9b4a44f1daf11c7ed0efdfef3/users/ff5a1f15e8d54a68946c8ccfdd4a3587/roles/48808901834b4d5eab2c7e6b5b03791e` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:41:35.575169 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 800/1599] 10.222.0.67 () {60 vars in 1152 bytes} [Wed May 25 14:41:35 2022] POST /identity/v3/projects => generated 373 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:41:35.575169 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44072f25-4a7d-4b11-a23f-4a711a892dae admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:41:35.583214 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4ef619-b059-4114-8dfb-6ec0dce44bdc admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e6496a9b4a44f1daf11c7ed0efdfef3, user_id=ff5a1f15e8d54a68946c8ccfdd4a3587, role_id=48808901834b4d5eab2c7e6b5b03791e)` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:41:35.585908 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4ef619-b059-4114-8dfb-6ec0dce44bdc admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:41:35.603142 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 800/1600] 10.222.0.67 () {60 vars in 1482 bytes} [Wed May 25 14:41:35 2022] PUT /identity/v3/projects/4e6496a9b4a44f1daf11c7ed0efdfef3/users/ff5a1f15e8d54a68946c8ccfdd4a3587/roles/48808901834b4d5eab2c7e6b5b03791e => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:41:35.603142 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4ef619-b059-4114-8dfb-6ec0dce44bdc admin admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:41:35.650349 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44072f25-4a7d-4b11-a23f-4a711a892dae admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:41:35.702705 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4ef619-b059-4114-8dfb-6ec0dce44bdc admin admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:41:35.707432 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225a8673-c301-4231-83c8-323dd7610d28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:41:35.708103 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225a8673-c301-4231-83c8-323dd7610d28 admin admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:41:35.708389 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225a8673-c301-4231-83c8-323dd7610d28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:41:35.708665 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225a8673-c301-4231-83c8-323dd7610d28 admin admin] PATH_INFO: `/v3/roles` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:41:35.709398 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225a8673-c301-4231-83c8-323dd7610d28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:41:35.711023 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225a8673-c301-4231-83c8-323dd7610d28 admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:41:35.725556 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 801/1601] 10.222.0.67 () {58 vars in 1121 bytes} [Wed May 25 14:41:35 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:41:35.726442 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225a8673-c301-4231-83c8-323dd7610d28 admin admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:41:35.736137 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225a8673-c301-4231-83c8-323dd7610d28 admin admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:41:35.738915 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f762210b-9560-4ca0-b7cc-3f6a7eb4bd10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:41:35.739986 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f762210b-9560-4ca0-b7cc-3f6a7eb4bd10 admin admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:41:35.740439 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f762210b-9560-4ca0-b7cc-3f6a7eb4bd10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:41:35.740722 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f762210b-9560-4ca0-b7cc-3f6a7eb4bd10 admin admin] PATH_INFO: `/v3/roles` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:41:35.741563 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f762210b-9560-4ca0-b7cc-3f6a7eb4bd10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:41:35.742604 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976914db-3189-4bca-aed6-471d646df063 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:41:35.743243 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f762210b-9560-4ca0-b7cc-3f6a7eb4bd10 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:41:35.744245 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976914db-3189-4bca-aed6-471d646df063 admin admin] REQUEST_METHOD: `PUT` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:41:35.744733 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976914db-3189-4bca-aed6-471d646df063 admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:41:35.745223 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976914db-3189-4bca-aed6-471d646df063 admin admin] PATH_INFO: `/v3/projects/74161898e72940608775a2ce35bcd6b0/users/54a9a5bdd9674c1f9700800609062675/roles/48808901834b4d5eab2c7e6b5b03791e` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:41:35.755684 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 801/1602] 10.222.0.67 () {58 vars in 1121 bytes} [Wed May 25 14:41:35 2022] GET /identity/v3/roles => generated 1420 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:41:35.756796 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea03dad-04e5-4ec8-ac90-893717b514d1 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:41:35.757093 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea03dad-04e5-4ec8-ac90-893717b514d1 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:41:35.757374 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea03dad-04e5-4ec8-ac90-893717b514d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:41:35.763193 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976914db-3189-4bca-aed6-471d646df063 admin admin] RBAC: Authorizing `identity:create_grant(project_id=74161898e72940608775a2ce35bcd6b0, user_id=54a9a5bdd9674c1f9700800609062675, role_id=48808901834b4d5eab2c7e6b5b03791e)` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:41:35.765922 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976914db-3189-4bca-aed6-471d646df063 admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:41:35.777127 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-2ea03dad-04e5-4ec8-ac90-893717b514d1 None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:41:35.778372 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-2ea03dad-04e5-4ec8-ac90-893717b514d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:41:35.783161 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 802/1603] 10.222.0.67 () {60 vars in 1482 bytes} [Wed May 25 14:41:35 2022] PUT /identity/v3/projects/74161898e72940608775a2ce35bcd6b0/users/54a9a5bdd9674c1f9700800609062675/roles/48808901834b4d5eab2c7e6b5b03791e => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:41:35.783161 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976914db-3189-4bca-aed6-471d646df063 admin admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:41:35.801348 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:41:35.841643 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:41:35.859011 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 802/1604] 10.222.0.67 () {58 vars in 957 bytes} [Wed May 25 14:41:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:41:35.860112 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea03dad-04e5-4ec8-ac90-893717b514d1 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:41:35.861836 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976914db-3189-4bca-aed6-471d646df063 admin admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:41:35.866620 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b34b983-adab-4d57-832f-f5d57ee13d59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:41:35.867513 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b34b983-adab-4d57-832f-f5d57ee13d59 admin admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:41:35.867742 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b34b983-adab-4d57-832f-f5d57ee13d59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:41:35.868020 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b34b983-adab-4d57-832f-f5d57ee13d59 admin admin] PATH_INFO: `/v3/roles` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:41:35.868755 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b34b983-adab-4d57-832f-f5d57ee13d59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:41:35.870344 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b34b983-adab-4d57-832f-f5d57ee13d59 admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:41:35.879720 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea03dad-04e5-4ec8-ac90-893717b514d1 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:41:35.881867 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 803/1605] 10.222.0.67 () {58 vars in 1121 bytes} [Wed May 25 14:41:35 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:41:35.886104 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b83c7d2-90cc-4a30-886e-2f9c8f30ee1a None None] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:41:35.886262 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c4f8c5-ca34-401f-9be1-82b07bb75118 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:41:35.886391 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b83c7d2-90cc-4a30-886e-2f9c8f30ee1a None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:41:35.886665 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b83c7d2-90cc-4a30-886e-2f9c8f30ee1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:41:35.886847 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c4f8c5-ca34-401f-9be1-82b07bb75118 admin admin] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:41:35.887133 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c4f8c5-ca34-401f-9be1-82b07bb75118 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:41:35.887417 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c4f8c5-ca34-401f-9be1-82b07bb75118 admin admin] PATH_INFO: `/v3/users` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:41:35.888569 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c4f8c5-ca34-401f-9be1-82b07bb75118 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:41:35.891808 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c4f8c5-ca34-401f-9be1-82b07bb75118 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:41:35.913236 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.auth.core [None req-0b83c7d2-90cc-4a30-886e-2f9c8f30ee1a None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:41:35.914371 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-0b83c7d2-90cc-4a30-886e-2f9c8f30ee1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:41:35.915015 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 803/1606] 10.222.0.67 () {60 vars in 1143 bytes} [Wed May 25 14:41:35 2022] POST /identity/v3/users => generated 293 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:41:35.918581 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c4f8c5-ca34-401f-9be1-82b07bb75118 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:41:35.922468 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 804/1607] 10.222.0.67 () {58 vars in 957 bytes} [Wed May 25 14:41:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:41:35.923151 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b83c7d2-90cc-4a30-886e-2f9c8f30ee1a None None] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:41:35.933109 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c4f8c5-ca34-401f-9be1-82b07bb75118 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:41:35.934224 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b83c7d2-90cc-4a30-886e-2f9c8f30ee1a None None] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:41:35.938865 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4d141a-dada-45de-80c1-a330edee0130 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:41:35.939137 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901a5c7b-a0e2-49b4-b247-ce4f74ea100d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:41:35.939895 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4d141a-dada-45de-80c1-a330edee0130 admin admin] REQUEST_METHOD: `PUT` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:41:35.940050 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901a5c7b-a0e2-49b4-b247-ce4f74ea100d admin admin] REQUEST_METHOD: `PUT` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:41:35.940342 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901a5c7b-a0e2-49b4-b247-ce4f74ea100d admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:41:35.940620 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901a5c7b-a0e2-49b4-b247-ce4f74ea100d admin admin] PATH_INFO: `/v3/projects/708858149b6644259e61c8158d34d0e1/users/8cc5c7ff590e40758133e683bd4f7b19/roles/48808901834b4d5eab2c7e6b5b03791e` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:41:35.940801 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4d141a-dada-45de-80c1-a330edee0130 admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:41:35.941049 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4d141a-dada-45de-80c1-a330edee0130 admin admin] PATH_INFO: `/v3/projects/c9f1edfe1afe4c01bb3b137d4b4a7733/users/e07dd69fffaf46819d1362b61c919a51/roles/48808901834b4d5eab2c7e6b5b03791e` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:41:35.957394 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4d141a-dada-45de-80c1-a330edee0130 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c9f1edfe1afe4c01bb3b137d4b4a7733, user_id=e07dd69fffaf46819d1362b61c919a51, role_id=48808901834b4d5eab2c7e6b5b03791e)` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:41:35.957933 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901a5c7b-a0e2-49b4-b247-ce4f74ea100d admin admin] RBAC: Authorizing `identity:create_grant(project_id=708858149b6644259e61c8158d34d0e1, user_id=8cc5c7ff590e40758133e683bd4f7b19, role_id=48808901834b4d5eab2c7e6b5b03791e)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:41:35.960114 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4d141a-dada-45de-80c1-a330edee0130 admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:41:35.960663 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901a5c7b-a0e2-49b4-b247-ce4f74ea100d admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:41:35.976336 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 805/1608] 10.222.0.67 () {60 vars in 1482 bytes} [Wed May 25 14:41:35 2022] PUT /identity/v3/projects/c9f1edfe1afe4c01bb3b137d4b4a7733/users/e07dd69fffaf46819d1362b61c919a51/roles/48808901834b4d5eab2c7e6b5b03791e => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:41:35.977897 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 804/1609] 10.222.0.67 () {60 vars in 1482 bytes} [Wed May 25 14:41:35 2022] PUT /identity/v3/projects/708858149b6644259e61c8158d34d0e1/users/8cc5c7ff590e40758133e683bd4f7b19/roles/48808901834b4d5eab2c7e6b5b03791e => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:41:35.978342 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901a5c7b-a0e2-49b4-b247-ce4f74ea100d admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:41:35.979509 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f593bf7-8cf7-4307-8ae7-78c62ed583cf None None] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:41:35.980287 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f593bf7-8cf7-4307-8ae7-78c62ed583cf None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:41:35.980403 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f593bf7-8cf7-4307-8ae7-78c62ed583cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:41:36.006113 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.auth.core [None req-1f593bf7-8cf7-4307-8ae7-78c62ed583cf None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:41:36.007606 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-1f593bf7-8cf7-4307-8ae7-78c62ed583cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:41:36.053115 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901a5c7b-a0e2-49b4-b247-ce4f74ea100d admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:41:36.056833 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050965b9-b585-4279-bff2-b3e2328be899 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b68eed985c7b49839bcdd173186ad4ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfe93ee8d32a441295efc0b885de4bd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:41:36.057496 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050965b9-b585-4279-bff2-b3e2328be899 service neutron] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:41:36.057888 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050965b9-b585-4279-bff2-b3e2328be899 service neutron] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:41:36.058175 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050965b9-b585-4279-bff2-b3e2328be899 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:41:36.089235 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 806/1610] 10.222.0.67 () {58 vars in 957 bytes} [Wed May 25 14:41:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:41:36.091289 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f593bf7-8cf7-4307-8ae7-78c62ed583cf None None] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:41:36.104003 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f593bf7-8cf7-4307-8ae7-78c62ed583cf None None] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:41:36.109081 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e67903-6a6f-451f-81d1-4d59205ea5b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:41:36.110005 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e67903-6a6f-451f-81d1-4d59205ea5b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:41:36.110285 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e67903-6a6f-451f-81d1-4d59205ea5b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:41:36.110563 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e67903-6a6f-451f-81d1-4d59205ea5b1 admin admin] PATH_INFO: `/v3/projects/d6d7498b8ce64730bc7991cb01f72f1d/users/7878e7b66d184abfb0706c2567046976/roles/48808901834b4d5eab2c7e6b5b03791e` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:41:36.127968 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050965b9-b585-4279-bff2-b3e2328be899 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:41:36.129378 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050965b9-b585-4279-bff2-b3e2328be899 service neutron] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:41:36.129630 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e67903-6a6f-451f-81d1-4d59205ea5b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d6d7498b8ce64730bc7991cb01f72f1d, user_id=7878e7b66d184abfb0706c2567046976, role_id=48808901834b4d5eab2c7e6b5b03791e)` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:41:36.132842 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e67903-6a6f-451f-81d1-4d59205ea5b1 admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:41:36.141764 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 805/1611] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 14:41:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:41:36.142397 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050965b9-b585-4279-bff2-b3e2328be899 service neutron] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:41:36.148182 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 807/1612] 10.222.0.67 () {60 vars in 1482 bytes} [Wed May 25 14:41:36 2022] PUT /identity/v3/projects/d6d7498b8ce64730bc7991cb01f72f1d/users/7878e7b66d184abfb0706c2567046976/roles/48808901834b4d5eab2c7e6b5b03791e => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:41:36.153755 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050965b9-b585-4279-bff2-b3e2328be899 service neutron] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:41:36.159107 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e67903-6a6f-451f-81d1-4d59205ea5b1 admin admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:41:36.194284 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:41:36.218946 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e67903-6a6f-451f-81d1-4d59205ea5b1 admin admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:41:36.224137 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b747c06f-aac6-4cc9-a824-55ae5f8333bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b68eed985c7b49839bcdd173186ad4ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfe93ee8d32a441295efc0b885de4bd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:41:36.224805 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b747c06f-aac6-4cc9-a824-55ae5f8333bd service neutron] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:41:36.225088 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b747c06f-aac6-4cc9-a824-55ae5f8333bd service neutron] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:41:36.225364 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b747c06f-aac6-4cc9-a824-55ae5f8333bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:41:36.232680 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a292260-1dd8-4b97-9a3f-0d0f531ae0e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:41:36.233353 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a292260-1dd8-4b97-9a3f-0d0f531ae0e1 admin admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:41:36.234900 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a292260-1dd8-4b97-9a3f-0d0f531ae0e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:41:36.235210 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a292260-1dd8-4b97-9a3f-0d0f531ae0e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:41:36.237869 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a292260-1dd8-4b97-9a3f-0d0f531ae0e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:41:36.239676 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a292260-1dd8-4b97-9a3f-0d0f531ae0e1 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:41:36.248137 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b747c06f-aac6-4cc9-a824-55ae5f8333bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:41:36.250871 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b747c06f-aac6-4cc9-a824-55ae5f8333bd service neutron] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:41:36.254241 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 806/1613] 10.222.0.67 () {58 vars in 1121 bytes} [Wed May 25 14:41:36 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:41:36.255872 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ea0cf9-a460-490a-823f-2d2a05355c3a None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:41:36.256231 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ea0cf9-a460-490a-823f-2d2a05355c3a None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:41:36.256456 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ea0cf9-a460-490a-823f-2d2a05355c3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:41:36.267555 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 808/1614] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 14:41:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:41:36.269738 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c403b0a6-5c04-448b-87c7-c5e2957a37d9 None None] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:41:36.270139 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c403b0a6-5c04-448b-87c7-c5e2957a37d9 None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:41:36.270523 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c403b0a6-5c04-448b-87c7-c5e2957a37d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:41:36.276671 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-76ea0cf9-a460-490a-823f-2d2a05355c3a None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:41:36.278282 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-76ea0cf9-a460-490a-823f-2d2a05355c3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:41:36.286977 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 807/1615] 10.222.0.67 () {58 vars in 957 bytes} [Wed May 25 14:41:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:41:36.291252 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54e5d63-9036-4894-91d6-ebb11e11fc62 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:41:36.292210 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54e5d63-9036-4894-91d6-ebb11e11fc62 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:41:36.292210 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54e5d63-9036-4894-91d6-ebb11e11fc62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:41:36.302087 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.auth.core [None req-c403b0a6-5c04-448b-87c7-c5e2957a37d9 None None] MFA Rules not processed for user `8cc5c7ff590e40758133e683bd4f7b19`. Rule list: `[]` (Enabled: `True`). {{(pid=80474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:41:36.303478 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-c403b0a6-5c04-448b-87c7-c5e2957a37d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:41:36.320279 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-f54e5d63-9036-4894-91d6-ebb11e11fc62 None None] MFA Rules not processed for user `d4364a0642ec40b691742ecedd3018cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:41:36.321508 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-f54e5d63-9036-4894-91d6-ebb11e11fc62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:41:36.323284 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:41:36.395349 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 809/1616] 10.222.0.67 () {58 vars in 957 bytes} [Wed May 25 14:41:36 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:41:36.396621 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c403b0a6-5c04-448b-87c7-c5e2957a37d9 None None] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:41:36.403894 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 808/1617] 10.222.0.67 () {58 vars in 957 bytes} [Wed May 25 14:41:36 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:41:36.405315 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdd4601-81bd-44c8-89e9-d290a370cf30 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:41:36.405751 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdd4601-81bd-44c8-89e9-d290a370cf30 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:41:36.406141 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdd4601-81bd-44c8-89e9-d290a370cf30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:41:36.407981 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c403b0a6-5c04-448b-87c7-c5e2957a37d9 None None] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:41:36.412501 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b2727b-ff6c-4e03-bad2-e2393d5fce92 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b68eed985c7b49839bcdd173186ad4ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfe93ee8d32a441295efc0b885de4bd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:41:36.413434 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b2727b-ff6c-4e03-bad2-e2393d5fce92 service neutron] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:41:36.413851 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b2727b-ff6c-4e03-bad2-e2393d5fce92 service neutron] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:41:36.414183 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b2727b-ff6c-4e03-bad2-e2393d5fce92 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:41:36.428532 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b2727b-ff6c-4e03-bad2-e2393d5fce92 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:41:36.430194 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b2727b-ff6c-4e03-bad2-e2393d5fce92 service neutron] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:41:36.441532 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-3bdd4601-81bd-44c8-89e9-d290a370cf30 None None] MFA Rules not processed for user `7878e7b66d184abfb0706c2567046976`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:41:36.443417 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-3bdd4601-81bd-44c8-89e9-d290a370cf30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:41:36.443519 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 810/1618] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 14:41:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:41:36.445319 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b2727b-ff6c-4e03-bad2-e2393d5fce92 service neutron] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:41:36.456653 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b2727b-ff6c-4e03-bad2-e2393d5fce92 service neutron] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:41:36.463144 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcf481d-9473-4fe3-adb8-90629e9d3d24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:41:36.464158 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcf481d-9473-4fe3-adb8-90629e9d3d24 admin admin] REQUEST_METHOD: `PUT` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:41:36.464848 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcf481d-9473-4fe3-adb8-90629e9d3d24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:41:36.465156 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcf481d-9473-4fe3-adb8-90629e9d3d24 admin admin] PATH_INFO: `/v3/projects/e1d963b67c604407bcafd15c88396b8f/users/94faa130ecc74b19aa023d726b0d61a6/roles/399893e19eac4ab5a8e596f7c07be13c` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:41:36.483018 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efcf481d-9473-4fe3-adb8-90629e9d3d24 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e1d963b67c604407bcafd15c88396b8f, user_id=94faa130ecc74b19aa023d726b0d61a6, role_id=399893e19eac4ab5a8e596f7c07be13c)` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:41:36.486193 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efcf481d-9473-4fe3-adb8-90629e9d3d24 admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:41:36.502625 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 811/1619] 10.222.0.67 () {60 vars in 1482 bytes} [Wed May 25 14:41:36 2022] PUT /identity/v3/projects/e1d963b67c604407bcafd15c88396b8f/users/94faa130ecc74b19aa023d726b0d61a6/roles/399893e19eac4ab5a8e596f7c07be13c => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:41:36.503742 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcf481d-9473-4fe3-adb8-90629e9d3d24 admin admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:41:36.507493 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-efcf481d-9473-4fe3-adb8-90629e9d3d24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:41:36.523062 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 809/1620] 10.222.0.67 () {58 vars in 957 bytes} [Wed May 25 14:41:36 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:41:36.523062 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdd4601-81bd-44c8-89e9-d290a370cf30 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:41:36.554719 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdd4601-81bd-44c8-89e9-d290a370cf30 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:41:36.581032 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcf481d-9473-4fe3-adb8-90629e9d3d24 admin admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:41:36.585113 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5156f17-4a7f-49dd-9e61-a32c4c95852b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b68eed985c7b49839bcdd173186ad4ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfe93ee8d32a441295efc0b885de4bd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:41:36.586272 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5156f17-4a7f-49dd-9e61-a32c4c95852b service neutron] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:41:36.586571 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5156f17-4a7f-49dd-9e61-a32c4c95852b service neutron] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:41:36.587102 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5156f17-4a7f-49dd-9e61-a32c4c95852b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:41:36.608802 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:41:36.631757 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9df71f-8bad-46a2-a41b-4d9a23799b25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:41:36.632454 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9df71f-8bad-46a2-a41b-4d9a23799b25 admin admin] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:41:36.632753 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9df71f-8bad-46a2-a41b-4d9a23799b25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:41:36.633039 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9df71f-8bad-46a2-a41b-4d9a23799b25 admin admin] PATH_INFO: `/v3/projects` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:41:36.633803 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9df71f-8bad-46a2-a41b-4d9a23799b25 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:41:36.635996 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9df71f-8bad-46a2-a41b-4d9a23799b25 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:41:36.660221 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5156f17-4a7f-49dd-9e61-a32c4c95852b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:41:36.661691 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5156f17-4a7f-49dd-9e61-a32c4c95852b service neutron] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:41:36.669428 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 810/1621] 10.222.0.67 () {60 vars in 1152 bytes} [Wed May 25 14:41:36 2022] POST /identity/v3/projects => generated 405 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:41:36.671306 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abf6e4a-b31a-415a-a621-0b400db21ad0 None None] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:41:36.671702 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abf6e4a-b31a-415a-a621-0b400db21ad0 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:41:36.672081 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abf6e4a-b31a-415a-a621-0b400db21ad0 None None] PATH_INFO: `/` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:41:36.673942 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 812/1622] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 14:41:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:41:36.674743 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5156f17-4a7f-49dd-9e61-a32c4c95852b service neutron] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:41:36.679681 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 811/1623] 10.222.0.67 () {54 vars in 961 bytes} [Wed May 25 14:41:36 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:41:36.681238 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b94903-37c3-4f31-a481-843a97801cb3 None None] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:41:36.681854 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b94903-37c3-4f31-a481-843a97801cb3 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:41:36.682075 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b94903-37c3-4f31-a481-843a97801cb3 None None] PATH_INFO: `/` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:41:36.683835 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 812/1624] 10.222.0.67 () {54 vars in 961 bytes} [Wed May 25 14:41:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:41:36.684997 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b94903-37c3-4f31-a481-843a97801cb3 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:41:36.685238 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5156f17-4a7f-49dd-9e61-a32c4c95852b service neutron] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:41:36.728907 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:41:36.780099 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43101308-6e4b-4959-8d43-603e90ad3fe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:41:36.781839 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43101308-6e4b-4959-8d43-603e90ad3fe3 admin admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:41:36.782521 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43101308-6e4b-4959-8d43-603e90ad3fe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:41:36.782521 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43101308-6e4b-4959-8d43-603e90ad3fe3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:41:36.784290 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43101308-6e4b-4959-8d43-603e90ad3fe3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:41:36.786805 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43101308-6e4b-4959-8d43-603e90ad3fe3 admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:41:36.801049 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 813/1625] 10.222.0.67 () {58 vars in 1121 bytes} [Wed May 25 14:41:36 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:41:36.803023 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4152bfb0-f799-4b2a-a67b-81d5d242bb40 None None] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:41:36.803451 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4152bfb0-f799-4b2a-a67b-81d5d242bb40 None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:41:36.803743 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4152bfb0-f799-4b2a-a67b-81d5d242bb40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:41:36.828869 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b94903-37c3-4f31-a481-843a97801cb3 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:41:36.849192 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8414a38-615d-4c82-abe6-97fb85532e1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:41:36.850048 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8414a38-615d-4c82-abe6-97fb85532e1e admin admin] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:41:36.850398 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8414a38-615d-4c82-abe6-97fb85532e1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:41:36.850777 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8414a38-615d-4c82-abe6-97fb85532e1e admin admin] PATH_INFO: `/v3/users` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:41:36.851606 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8414a38-615d-4c82-abe6-97fb85532e1e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:41:36.853685 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8414a38-615d-4c82-abe6-97fb85532e1e admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:41:36.856294 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.auth.core [None req-4152bfb0-f799-4b2a-a67b-81d5d242bb40 None None] MFA Rules not processed for user `428ec99478284743943ed41e9d24a603`. Rule list: `[]` (Enabled: `True`). {{(pid=80474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:41:36.857938 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-4152bfb0-f799-4b2a-a67b-81d5d242bb40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:41:36.897852 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 813/1626] 10.222.0.67 () {60 vars in 1143 bytes} [Wed May 25 14:41:36 2022] POST /identity/v3/users => generated 309 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:41:36.899426 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20533737-d708-4418-95ba-9bf48aaa92e6 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:41:36.899817 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20533737-d708-4418-95ba-9bf48aaa92e6 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:41:36.900303 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20533737-d708-4418-95ba-9bf48aaa92e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:41:36.929822 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-20533737-d708-4418-95ba-9bf48aaa92e6 None None] MFA Rules not processed for user `428ec99478284743943ed41e9d24a603`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:41:36.931809 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-20533737-d708-4418-95ba-9bf48aaa92e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:41:37.010536 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 814/1627] 10.222.0.67 () {58 vars in 1058 bytes} [Wed May 25 14:41:36 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:41:37.013613 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4152bfb0-f799-4b2a-a67b-81d5d242bb40 None None] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:41:37.032757 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4152bfb0-f799-4b2a-a67b-81d5d242bb40 None None] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:41:37.040337 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 814/1628] 10.222.0.67 () {58 vars in 1058 bytes} [Wed May 25 14:41:36 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:41:37.041353 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20533737-d708-4418-95ba-9bf48aaa92e6 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:41:37.045052 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817b04ce-b9ea-4644-a676-e7c1f693fc39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:41:37.046368 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817b04ce-b9ea-4644-a676-e7c1f693fc39 admin admin] REQUEST_METHOD: `PUT` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:41:37.046949 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817b04ce-b9ea-4644-a676-e7c1f693fc39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:41:37.047421 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817b04ce-b9ea-4644-a676-e7c1f693fc39 admin admin] PATH_INFO: `/v3/projects/e1d963b67c604407bcafd15c88396b8f/users/94faa130ecc74b19aa023d726b0d61a6/roles/399893e19eac4ab5a8e596f7c07be13c` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:41:37.054092 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817b04ce-b9ea-4644-a676-e7c1f693fc39 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e1d963b67c604407bcafd15c88396b8f, user_id=94faa130ecc74b19aa023d726b0d61a6, role_id=399893e19eac4ab5a8e596f7c07be13c)` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:41:37.056135 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20533737-d708-4418-95ba-9bf48aaa92e6 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:41:37.058788 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817b04ce-b9ea-4644-a676-e7c1f693fc39 admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:41:37.063438 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49eee64-ceb6-4b06-a0ea-7fa944c1d5b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:41:37.064419 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49eee64-ceb6-4b06-a0ea-7fa944c1d5b9 admin admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:41:37.065051 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49eee64-ceb6-4b06-a0ea-7fa944c1d5b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:41:37.066718 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49eee64-ceb6-4b06-a0ea-7fa944c1d5b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:41:37.067441 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49eee64-ceb6-4b06-a0ea-7fa944c1d5b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:41:37.070194 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49eee64-ceb6-4b06-a0ea-7fa944c1d5b9 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:41:37.080111 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 815/1629] 10.222.0.67 () {60 vars in 1482 bytes} [Wed May 25 14:41:37 2022] PUT /identity/v3/projects/e1d963b67c604407bcafd15c88396b8f/users/94faa130ecc74b19aa023d726b0d61a6/roles/399893e19eac4ab5a8e596f7c07be13c => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:41:37.083629 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817b04ce-b9ea-4644-a676-e7c1f693fc39 admin admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:41:37.098947 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 815/1630] 10.222.0.67 () {58 vars in 1121 bytes} [Wed May 25 14:41:37 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:41:37.099963 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49eee64-ceb6-4b06-a0ea-7fa944c1d5b9 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:41:37.117820 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49eee64-ceb6-4b06-a0ea-7fa944c1d5b9 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:41:37.194709 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:41:37.249446 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817b04ce-b9ea-4644-a676-e7c1f693fc39 admin admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:41:37.257152 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d447c5-039c-4cf9-8208-a5be17b1701a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '428ec99478284743943ed41e9d24a603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfe93ee8d32a441295efc0b885de4bd7', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:41:37.265309 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440e7edf-59e5-43dc-bb8a-ff01f1bfb507 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '428ec99478284743943ed41e9d24a603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfe93ee8d32a441295efc0b885de4bd7', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:41:37.266336 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440e7edf-59e5-43dc-bb8a-ff01f1bfb507 service nova] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:41:37.266788 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440e7edf-59e5-43dc-bb8a-ff01f1bfb507 service nova] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:41:37.267177 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440e7edf-59e5-43dc-bb8a-ff01f1bfb507 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:41:37.270304 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d447c5-039c-4cf9-8208-a5be17b1701a service nova] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:41:37.270603 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d447c5-039c-4cf9-8208-a5be17b1701a service nova] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:41:37.270889 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d447c5-039c-4cf9-8208-a5be17b1701a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:41:37.350647 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:41:37.353331 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440e7edf-59e5-43dc-bb8a-ff01f1bfb507 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:41:37.355767 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440e7edf-59e5-43dc-bb8a-ff01f1bfb507 service nova] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:41:37.370840 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 816/1631] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 14:41:37 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 271 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:41:37.373040 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a5460c-faf5-469a-9a41-df20a5a1bd93 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:41:37.373337 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a5460c-faf5-469a-9a41-df20a5a1bd93 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:41:37.373615 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a5460c-faf5-469a-9a41-df20a5a1bd93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:41:37.375177 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d447c5-039c-4cf9-8208-a5be17b1701a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:41:37.381902 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d447c5-039c-4cf9-8208-a5be17b1701a service nova] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:41:37.395990 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 816/1632] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 14:41:37 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:41:37.397054 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d447c5-039c-4cf9-8208-a5be17b1701a service nova] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:41:37.407843 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-f7a5460c-faf5-469a-9a41-df20a5a1bd93 None None] MFA Rules not processed for user `94faa130ecc74b19aa023d726b0d61a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:41:37.410239 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-f7a5460c-faf5-469a-9a41-df20a5a1bd93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:41:37.526076 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 817/1633] 10.222.0.67 () {58 vars in 957 bytes} [Wed May 25 14:41:37 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:41:37.538685 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a5460c-faf5-469a-9a41-df20a5a1bd93 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:41:37.654227 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a5460c-faf5-469a-9a41-df20a5a1bd93 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:41:37.667259 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530922aa-c8a2-4942-a315-c137f3161e62 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e462acc9da84a61bb23998dd54e1858', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfe93ee8d32a441295efc0b885de4bd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:41:37.668346 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530922aa-c8a2-4942-a315-c137f3161e62 service cinder] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:41:37.669100 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530922aa-c8a2-4942-a315-c137f3161e62 service cinder] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:41:37.670084 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530922aa-c8a2-4942-a315-c137f3161e62 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:41:37.699681 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530922aa-c8a2-4942-a315-c137f3161e62 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:41:37.704284 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530922aa-c8a2-4942-a315-c137f3161e62 service cinder] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:41:37.732209 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d447c5-039c-4cf9-8208-a5be17b1701a service nova] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:41:37.733579 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 818/1634] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 14:41:37 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 14:41:37.748251 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977a2f0d-8535-412d-8f57-43d3a51100df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:41:37.749158 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977a2f0d-8535-412d-8f57-43d3a51100df admin admin] REQUEST_METHOD: `PUT` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:41:37.749577 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977a2f0d-8535-412d-8f57-43d3a51100df admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:41:37.749868 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977a2f0d-8535-412d-8f57-43d3a51100df admin admin] PATH_INFO: `/v3/projects/e037fb880ce34967985080820c719582/users/1e23a355ce6a4ebab24a9537be353477/roles/399893e19eac4ab5a8e596f7c07be13c` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:41:37.759582 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9581b4-e4fe-4dd1-9025-304a424f9452 None None] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:41:37.759802 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9581b4-e4fe-4dd1-9025-304a424f9452 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:41:37.759966 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9581b4-e4fe-4dd1-9025-304a424f9452 None None] PATH_INFO: `/` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:41:37.761477 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 819/1635] 10.222.0.67 () {54 vars in 912 bytes} [Wed May 25 14:41:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:41:37.771239 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6622441e-14bd-478a-9503-0add3732708b None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:41:37.771489 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6622441e-14bd-478a-9503-0add3732708b None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:41:37.771905 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6622441e-14bd-478a-9503-0add3732708b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:41:37.784524 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977a2f0d-8535-412d-8f57-43d3a51100df admin admin] RBAC: Authorizing `identity:create_grant(project_id=e037fb880ce34967985080820c719582, user_id=1e23a355ce6a4ebab24a9537be353477, role_id=399893e19eac4ab5a8e596f7c07be13c)` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:41:37.787227 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977a2f0d-8535-412d-8f57-43d3a51100df admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:41:37.799775 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:41:37.840457 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 817/1636] 10.222.0.67 () {60 vars in 1482 bytes} [Wed May 25 14:41:37 2022] PUT /identity/v3/projects/e037fb880ce34967985080820c719582/users/1e23a355ce6a4ebab24a9537be353477/roles/399893e19eac4ab5a8e596f7c07be13c => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:41:37.842358 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab1ccc9-7193-465f-82df-98d3a346a8e3 None None] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:41:37.842358 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab1ccc9-7193-465f-82df-98d3a346a8e3 None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:41:37.842641 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab1ccc9-7193-465f-82df-98d3a346a8e3 None None] PATH_INFO: `/` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:41:37.844364 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 818/1637] 10.222.0.67 () {54 vars in 912 bytes} [Wed May 25 14:41:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:41:37.845400 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab1ccc9-7193-465f-82df-98d3a346a8e3 None None] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:41:37.850168 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-6622441e-14bd-478a-9503-0add3732708b None None] MFA Rules not processed for user `428ec99478284743943ed41e9d24a603`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:41:37.853946 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-6622441e-14bd-478a-9503-0add3732708b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:41:37.948463 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab1ccc9-7193-465f-82df-98d3a346a8e3 None None] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:41:37.956129 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7315b1-a111-42c8-b871-20c541f13e81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:41:37.956826 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7315b1-a111-42c8-b871-20c541f13e81 admin admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:41:37.957184 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7315b1-a111-42c8-b871-20c541f13e81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:41:37.957675 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7315b1-a111-42c8-b871-20c541f13e81 admin admin] PATH_INFO: `/v3/roles` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:41:37.958535 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7315b1-a111-42c8-b871-20c541f13e81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:41:37.960413 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7315b1-a111-42c8-b871-20c541f13e81 admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:41:37.976626 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 819/1638] 10.222.0.67 () {58 vars in 1121 bytes} [Wed May 25 14:41:37 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:41:37.978217 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74dd17d-8de8-4d96-882d-8c887cc10838 None None] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:41:37.978583 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74dd17d-8de8-4d96-882d-8c887cc10838 None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:41:37.979050 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74dd17d-8de8-4d96-882d-8c887cc10838 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:41:38.000312 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 820/1639] 10.222.0.67 () {58 vars in 1009 bytes} [Wed May 25 14:41:37 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:41:38.001262 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.auth.core [None req-a74dd17d-8de8-4d96-882d-8c887cc10838 None None] MFA Rules not processed for user `428ec99478284743943ed41e9d24a603`. Rule list: `[]` (Enabled: `True`). {{(pid=80474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:41:38.003734 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-a74dd17d-8de8-4d96-882d-8c887cc10838 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:41:38.009818 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6622441e-14bd-478a-9503-0add3732708b None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:41:38.025770 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 820/1640] 10.222.0.67 () {58 vars in 1009 bytes} [Wed May 25 14:41:37 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:41:38.027298 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74dd17d-8de8-4d96-882d-8c887cc10838 None None] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:41:38.040752 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74dd17d-8de8-4d96-882d-8c887cc10838 None None] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:41:38.046783 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1b980a-87d6-4240-8074-eb25551fd2ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:41:38.048329 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1b980a-87d6-4240-8074-eb25551fd2ef admin admin] REQUEST_METHOD: `PUT` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:41:38.049110 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1b980a-87d6-4240-8074-eb25551fd2ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:41:38.049700 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1b980a-87d6-4240-8074-eb25551fd2ef admin admin] PATH_INFO: `/v3/projects/e037fb880ce34967985080820c719582/users/1e23a355ce6a4ebab24a9537be353477/roles/399893e19eac4ab5a8e596f7c07be13c` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:41:38.052783 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1b980a-87d6-4240-8074-eb25551fd2ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=e037fb880ce34967985080820c719582, user_id=1e23a355ce6a4ebab24a9537be353477, role_id=399893e19eac4ab5a8e596f7c07be13c)` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:41:38.056275 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1b980a-87d6-4240-8074-eb25551fd2ef admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:41:38.079136 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 821/1641] 10.222.0.67 () {60 vars in 1482 bytes} [Wed May 25 14:41:38 2022] PUT /identity/v3/projects/e037fb880ce34967985080820c719582/users/1e23a355ce6a4ebab24a9537be353477/roles/399893e19eac4ab5a8e596f7c07be13c => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:41:38.081792 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1b980a-87d6-4240-8074-eb25551fd2ef admin admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:41:38.092433 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6622441e-14bd-478a-9503-0add3732708b None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:41:38.149815 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:41:38.162487 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393862bb-0fa7-468b-aad9-265c91d2af8c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e462acc9da84a61bb23998dd54e1858', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfe93ee8d32a441295efc0b885de4bd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:41:38.163198 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393862bb-0fa7-468b-aad9-265c91d2af8c service cinder] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:41:38.163563 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393862bb-0fa7-468b-aad9-265c91d2af8c service cinder] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:41:38.163764 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393862bb-0fa7-468b-aad9-265c91d2af8c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:41:38.167843 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1b980a-87d6-4240-8074-eb25551fd2ef admin admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:41:38.172791 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124eeedc-382f-46da-9ef0-11f6f119fff9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e462acc9da84a61bb23998dd54e1858', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfe93ee8d32a441295efc0b885de4bd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:41:38.174015 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124eeedc-382f-46da-9ef0-11f6f119fff9 service cinder] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:41:38.174747 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124eeedc-382f-46da-9ef0-11f6f119fff9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:41:38.175344 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124eeedc-382f-46da-9ef0-11f6f119fff9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:41:38.270836 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393862bb-0fa7-468b-aad9-265c91d2af8c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:41:38.274882 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393862bb-0fa7-468b-aad9-265c91d2af8c service cinder] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:41:38.289209 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124eeedc-382f-46da-9ef0-11f6f119fff9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:41:38.291556 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124eeedc-382f-46da-9ef0-11f6f119fff9 service cinder] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:41:38.297914 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 821/1642] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 14:41:38 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:41:38.308317 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 822/1643] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 14:41:38 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:41:38.780427 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393862bb-0fa7-468b-aad9-265c91d2af8c service cinder] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:41:38.787203 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:41:38.792452 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393862bb-0fa7-468b-aad9-265c91d2af8c service cinder] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:41:38.804957 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0587e087-7c19-4cdf-a879-e269404ba045 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e462acc9da84a61bb23998dd54e1858', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfe93ee8d32a441295efc0b885de4bd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:41:38.805635 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0587e087-7c19-4cdf-a879-e269404ba045 service cinder] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:41:38.805923 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0587e087-7c19-4cdf-a879-e269404ba045 service cinder] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:41:38.806205 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0587e087-7c19-4cdf-a879-e269404ba045 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:41:38.827807 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0587e087-7c19-4cdf-a879-e269404ba045 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:41:38.830975 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0587e087-7c19-4cdf-a879-e269404ba045 service cinder] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:41:38.858059 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 822/1644] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 14:41:38 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:41:40.046466 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e28fd8d-1b96-4751-ac04-63a26c1407eb None None] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:41:40.052216 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e28fd8d-1b96-4751-ac04-63a26c1407eb None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:41:40.054401 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e28fd8d-1b96-4751-ac04-63a26c1407eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:41:40.135619 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.auth.core [None req-0e28fd8d-1b96-4751-ac04-63a26c1407eb None None] MFA Rules not processed for user `e07dd69fffaf46819d1362b61c919a51`. Rule list: `[]` (Enabled: `True`). {{(pid=80474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:41:40.148213 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-0e28fd8d-1b96-4751-ac04-63a26c1407eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:41:40.307400 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441f75f0-4b64-4c51-8dc5-48fe4f090d6f None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:41:40.307898 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441f75f0-4b64-4c51-8dc5-48fe4f090d6f None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:41:40.307986 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441f75f0-4b64-4c51-8dc5-48fe4f090d6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:41:40.387325 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-441f75f0-4b64-4c51-8dc5-48fe4f090d6f None None] MFA Rules not processed for user `1e23a355ce6a4ebab24a9537be353477`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:41:40.402517 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 823/1645] 10.222.0.67 () {58 vars in 957 bytes} [Wed May 25 14:41:40 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 350 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 14:41:40.402517 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812506c7-baaf-4a46-ac3d-caba22f125bf None None] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:41:40.405112 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812506c7-baaf-4a46-ac3d-caba22f125bf None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:41:40.405112 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812506c7-baaf-4a46-ac3d-caba22f125bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:41:40.409343 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-441f75f0-4b64-4c51-8dc5-48fe4f090d6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:41:40.449872 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.auth.core [None req-812506c7-baaf-4a46-ac3d-caba22f125bf None None] MFA Rules not processed for user `e07dd69fffaf46819d1362b61c919a51`. Rule list: `[]` (Enabled: `True`). {{(pid=80474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:41:40.452613 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-812506c7-baaf-4a46-ac3d-caba22f125bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:41:40.482096 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 824/1646] 10.222.0.67 () {58 vars in 957 bytes} [Wed May 25 14:41:40 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:41:40.500464 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812506c7-baaf-4a46-ac3d-caba22f125bf None None] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:41:40.526051 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812506c7-baaf-4a46-ac3d-caba22f125bf None None] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:41:40.537894 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e2d49b-9251-4509-8ca0-b53ba8f20eb5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '428ec99478284743943ed41e9d24a603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfe93ee8d32a441295efc0b885de4bd7', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:41:40.538585 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e2d49b-9251-4509-8ca0-b53ba8f20eb5 service nova] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:41:40.538870 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e2d49b-9251-4509-8ca0-b53ba8f20eb5 service nova] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:41:40.542259 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e2d49b-9251-4509-8ca0-b53ba8f20eb5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:41:40.559896 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e2d49b-9251-4509-8ca0-b53ba8f20eb5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:41:40.561955 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e2d49b-9251-4509-8ca0-b53ba8f20eb5 service nova] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:41:40.570414 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 823/1647] 10.222.0.67 () {58 vars in 957 bytes} [Wed May 25 14:41:40 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 14:41:40.591128 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 825/1648] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 14:41:40 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:41:41.206459 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42395476-1b5f-4e1c-bc8f-47c869a2adbc None None] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:41:41.206888 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42395476-1b5f-4e1c-bc8f-47c869a2adbc None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:41:41.207197 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42395476-1b5f-4e1c-bc8f-47c869a2adbc None None] PATH_INFO: `/` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:41:41.209357 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 824/1649] 10.222.0.67 () {54 vars in 912 bytes} [Wed May 25 14:41:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:41:41.217525 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28483da-377a-4547-9858-b61a6ab27765 None None] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:41:41.223891 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28483da-377a-4547-9858-b61a6ab27765 None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:41:41.224407 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28483da-377a-4547-9858-b61a6ab27765 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:41:41.278340 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.auth.core [None req-e28483da-377a-4547-9858-b61a6ab27765 None None] MFA Rules not processed for user `b68eed985c7b49839bcdd173186ad4ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:41:41.281384 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-e28483da-377a-4547-9858-b61a6ab27765 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:41:41.391427 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 826/1650] 10.222.0.67 () {58 vars in 1009 bytes} [Wed May 25 14:41:41 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:41:41.456084 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42395476-1b5f-4e1c-bc8f-47c869a2adbc None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:41:41.476240 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42395476-1b5f-4e1c-bc8f-47c869a2adbc None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:41:41.499527 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4425d82-574f-4946-b2be-80f7bc4ff9f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b68eed985c7b49839bcdd173186ad4ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfe93ee8d32a441295efc0b885de4bd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:41:41.500667 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4425d82-574f-4946-b2be-80f7bc4ff9f1 service neutron] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:41:41.504171 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4425d82-574f-4946-b2be-80f7bc4ff9f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:41:41.506239 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4425d82-574f-4946-b2be-80f7bc4ff9f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:41:41.534088 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4425d82-574f-4946-b2be-80f7bc4ff9f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:41:41.537756 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4425d82-574f-4946-b2be-80f7bc4ff9f1 service neutron] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:41:41.555964 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 825/1651] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 14:41:41 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:41:42.804645 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28483da-377a-4547-9858-b61a6ab27765 None None] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:41:42.809954 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:41:42.952135 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28483da-377a-4547-9858-b61a6ab27765 None None] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:41:42.961043 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0521d635-4142-40e4-a4a4-2b5578f6efdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:41:42.962623 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0521d635-4142-40e4-a4a4-2b5578f6efdb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:41:42.963281 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0521d635-4142-40e4-a4a4-2b5578f6efdb admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:41:42.963895 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0521d635-4142-40e4-a4a4-2b5578f6efdb admin admin] PATH_INFO: `/v3/users/8cc5c7ff590e40758133e683bd4f7b19` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:41:42.965349 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0521d635-4142-40e4-a4a4-2b5578f6efdb admin admin] RBAC: Authorizing `identity:delete_user(user_id=8cc5c7ff590e40758133e683bd4f7b19)` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:41:42.966646 dv-cinder-787296-9-smb devstack@keystone.service[80474]: WARNING py.warnings [None req-0521d635-4142-40e4-a4a4-2b5578f6efdb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 25 14:41:42.966646 dv-cinder-787296-9-smb devstack@keystone.service[80474]: warnings.warn(msg) May 25 14:41:42.966646 dv-cinder-787296-9-smb devstack@keystone.service[80474]: May 25 14:41:42.968124 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0521d635-4142-40e4-a4a4-2b5578f6efdb admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:41:43.068085 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-0521d635-4142-40e4-a4a4-2b5578f6efdb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8cc5c7ff590e40758133e683bd4f7b19'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:41:43.068808 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-0521d635-4142-40e4-a4a4-2b5578f6efdb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8cc5c7ff590e40758133e683bd4f7b19'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:41:43.069549 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-0521d635-4142-40e4-a4a4-2b5578f6efdb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8cc5c7ff590e40758133e683bd4f7b19'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:41:43.094936 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-0521d635-4142-40e4-a4a4-2b5578f6efdb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8cc5c7ff590e40758133e683bd4f7b19'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:41:43.110926 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-0521d635-4142-40e4-a4a4-2b5578f6efdb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8cc5c7ff590e40758133e683bd4f7b19'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:41:43.151145 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 827/1652] 10.222.0.67 () {58 vars in 1223 bytes} [Wed May 25 14:41:42 2022] DELETE /identity/v3/users/8cc5c7ff590e40758133e683bd4f7b19 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:41:43.154088 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0437f12f-ae2f-473a-b25a-662970b003c6 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:41:43.154603 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0437f12f-ae2f-473a-b25a-662970b003c6 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:41:43.154684 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0437f12f-ae2f-473a-b25a-662970b003c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:41:43.222187 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-0437f12f-ae2f-473a-b25a-662970b003c6 None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:41:43.223488 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-0437f12f-ae2f-473a-b25a-662970b003c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:41:43.412245 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 826/1653] 10.222.0.67 () {58 vars in 957 bytes} [Wed May 25 14:41:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:41:43.479490 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0521d635-4142-40e4-a4a4-2b5578f6efdb admin admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:41:43.483583 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-0521d635-4142-40e4-a4a4-2b5578f6efdb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:41:43.538556 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a3604f-16e1-4724-9e50-4ae3e6458ba9 None None] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:41:43.539146 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a3604f-16e1-4724-9e50-4ae3e6458ba9 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:41:43.539627 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a3604f-16e1-4724-9e50-4ae3e6458ba9 None None] PATH_INFO: `/` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:41:43.541563 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 827/1654] 10.222.0.67 () {54 vars in 921 bytes} [Wed May 25 14:41:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 14:41:43.550085 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df06ea7d-32d3-4992-b8c3-7800bf5c051a None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:41:43.550696 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df06ea7d-32d3-4992-b8c3-7800bf5c051a None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:41:43.551204 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df06ea7d-32d3-4992-b8c3-7800bf5c051a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:41:43.607427 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-df06ea7d-32d3-4992-b8c3-7800bf5c051a None None] MFA Rules not processed for user `ad2b99c2122a4311996364e982e1c801`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:41:43.609015 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-df06ea7d-32d3-4992-b8c3-7800bf5c051a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:41:43.746056 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0521d635-4142-40e4-a4a4-2b5578f6efdb admin admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:41:43.755664 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212017ce-6790-4f51-80ec-defe6b7e9a82 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b68eed985c7b49839bcdd173186ad4ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfe93ee8d32a441295efc0b885de4bd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:41:43.757486 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212017ce-6790-4f51-80ec-defe6b7e9a82 service neutron] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:41:43.758333 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212017ce-6790-4f51-80ec-defe6b7e9a82 service neutron] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:41:43.758333 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212017ce-6790-4f51-80ec-defe6b7e9a82 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:41:43.792952 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212017ce-6790-4f51-80ec-defe6b7e9a82 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:41:43.804264 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212017ce-6790-4f51-80ec-defe6b7e9a82 service neutron] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:41:43.854299 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:41:43.888620 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 828/1655] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 14:41:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:41:43.891659 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 828/1656] 10.222.0.67 () {58 vars in 1018 bytes} [Wed May 25 14:41:43 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 343 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 14:41:43.987371 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be32b1b3-5ee9-4479-9e47-5c8db4f62369 None None] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:41:43.987789 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be32b1b3-5ee9-4479-9e47-5c8db4f62369 None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:41:43.988280 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be32b1b3-5ee9-4479-9e47-5c8db4f62369 None None] PATH_INFO: `/` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:41:43.990419 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 829/1657] 10.222.0.67 () {54 vars in 960 bytes} [Wed May 25 14:41:43 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:41:44.004127 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee2d2f3-dc0b-470b-92b6-479019eae9b6 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:41:44.004418 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee2d2f3-dc0b-470b-92b6-479019eae9b6 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:41:44.005555 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee2d2f3-dc0b-470b-92b6-479019eae9b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:41:44.012470 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be32b1b3-5ee9-4479-9e47-5c8db4f62369 None None] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:41:44.014389 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-be32b1b3-5ee9-4479-9e47-5c8db4f62369 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:41:44.097449 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be32b1b3-5ee9-4479-9e47-5c8db4f62369 None None] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:41:44.099860 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-5ee2d2f3-dc0b-470b-92b6-479019eae9b6 None None] MFA Rules not processed for user `ad2b99c2122a4311996364e982e1c801`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:41:44.112984 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-5ee2d2f3-dc0b-470b-92b6-479019eae9b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:41:44.119962 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e4a35d-f351-402b-8106-b0314f7b4e22 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad2b99c2122a4311996364e982e1c801', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfe93ee8d32a441295efc0b885de4bd7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:41:44.124927 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e4a35d-f351-402b-8106-b0314f7b4e22 service placement] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:41:44.125270 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e4a35d-f351-402b-8106-b0314f7b4e22 service placement] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:41:44.125561 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e4a35d-f351-402b-8106-b0314f7b4e22 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:41:44.129787 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 829/1658] 10.222.0.67 () {58 vars in 1057 bytes} [Wed May 25 14:41:44 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:41:44.131874 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-39e4a35d-f351-402b-8106-b0314f7b4e22 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:41:44.138440 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee2d2f3-dc0b-470b-92b6-479019eae9b6 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:41:44.174649 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee2d2f3-dc0b-470b-92b6-479019eae9b6 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:41:44.199128 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e4a35d-f351-402b-8106-b0314f7b4e22 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:41:44.201740 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e4a35d-f351-402b-8106-b0314f7b4e22 service placement] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:41:44.216643 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d69966-7152-4f67-8c3d-3aa7b4f29d1e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad2b99c2122a4311996364e982e1c801', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfe93ee8d32a441295efc0b885de4bd7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:41:44.219606 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d69966-7152-4f67-8c3d-3aa7b4f29d1e service placement] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:41:44.222018 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d69966-7152-4f67-8c3d-3aa7b4f29d1e service placement] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:41:44.224695 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d69966-7152-4f67-8c3d-3aa7b4f29d1e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:41:44.240631 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 830/1659] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 14:41:44 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 14:41:44.242632 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d69966-7152-4f67-8c3d-3aa7b4f29d1e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:41:44.245163 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d69966-7152-4f67-8c3d-3aa7b4f29d1e service placement] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:41:44.258222 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 830/1660] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 14:41:44 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:41:45.422135 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e4a35d-f351-402b-8106-b0314f7b4e22 service placement] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:41:45.423791 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-39e4a35d-f351-402b-8106-b0314f7b4e22 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:41:45.456598 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e4a35d-f351-402b-8106-b0314f7b4e22 service placement] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:41:45.477773 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bddd62b-6b89-45a9-8b6b-9b3f5cc92534 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:41:45.478678 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bddd62b-6b89-45a9-8b6b-9b3f5cc92534 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:41:45.478969 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bddd62b-6b89-45a9-8b6b-9b3f5cc92534 admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:41:45.479304 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bddd62b-6b89-45a9-8b6b-9b3f5cc92534 admin admin] PATH_INFO: `/v3/projects/708858149b6644259e61c8158d34d0e1` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:41:45.480803 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bddd62b-6b89-45a9-8b6b-9b3f5cc92534 admin admin] RBAC: Authorizing `identity:delete_project(project_id=708858149b6644259e61c8158d34d0e1)` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:41:45.485776 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bddd62b-6b89-45a9-8b6b-9b3f5cc92534 admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:41:45.506703 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:41:45.605297 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-1bddd62b-6b89-45a9-8b6b-9b3f5cc92534 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '708858149b6644259e61c8158d34d0e1', 'request_id': 'req-1bddd62b-6b89-45a9-8b6b-9b3f5cc92534'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:41:45.633416 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-1bddd62b-6b89-45a9-8b6b-9b3f5cc92534 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '708858149b6644259e61c8158d34d0e1', 'request_id': 'req-1bddd62b-6b89-45a9-8b6b-9b3f5cc92534'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:41:45.642791 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-1bddd62b-6b89-45a9-8b6b-9b3f5cc92534 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '708858149b6644259e61c8158d34d0e1', 'request_id': 'req-1bddd62b-6b89-45a9-8b6b-9b3f5cc92534'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:41:45.665525 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-1bddd62b-6b89-45a9-8b6b-9b3f5cc92534 admin admin] The token cache is being invalidate because project 708858149b6644259e61c8158d34d0e1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80474) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 14:41:45.665761 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-1bddd62b-6b89-45a9-8b6b-9b3f5cc92534 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:41:45.668345 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-1bddd62b-6b89-45a9-8b6b-9b3f5cc92534 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:41:45.675755 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 831/1661] 10.222.0.67 () {58 vars in 1232 bytes} [Wed May 25 14:41:45 2022] DELETE /identity/v3/projects/708858149b6644259e61c8158d34d0e1 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:41:45.680863 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7f082a-c443-4249-b6b1-fdad204fe5dc None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:41:45.681809 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7f082a-c443-4249-b6b1-fdad204fe5dc None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:41:45.682101 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7f082a-c443-4249-b6b1-fdad204fe5dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:41:45.736731 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-0d7f082a-c443-4249-b6b1-fdad204fe5dc None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:41:45.738593 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-0d7f082a-c443-4249-b6b1-fdad204fe5dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:41:45.794978 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bddd62b-6b89-45a9-8b6b-9b3f5cc92534 admin admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:41:45.794978 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-1bddd62b-6b89-45a9-8b6b-9b3f5cc92534 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:41:45.925697 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 831/1662] 10.222.0.67 () {58 vars in 957 bytes} [Wed May 25 14:41:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:41:45.933652 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c47c8a-7cba-4c87-aab3-69512ed225c5 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:41:45.934252 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c47c8a-7cba-4c87-aab3-69512ed225c5 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:41:45.934739 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c47c8a-7cba-4c87-aab3-69512ed225c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:41:45.969061 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-84c47c8a-7cba-4c87-aab3-69512ed225c5 None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:41:45.970702 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-84c47c8a-7cba-4c87-aab3-69512ed225c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:41:45.992055 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 832/1663] 10.222.0.67 () {58 vars in 957 bytes} [Wed May 25 14:41:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 14:41:45.995695 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c47c8a-7cba-4c87-aab3-69512ed225c5 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:41:46.012791 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c47c8a-7cba-4c87-aab3-69512ed225c5 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:41:46.026008 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5474e50b-6097-4317-9270-40d9fcbf68bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:41:46.040237 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5474e50b-6097-4317-9270-40d9fcbf68bb admin admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:41:46.042145 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5474e50b-6097-4317-9270-40d9fcbf68bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:41:46.042559 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5474e50b-6097-4317-9270-40d9fcbf68bb admin admin] PATH_INFO: `/v3/domains` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:41:46.043264 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bddd62b-6b89-45a9-8b6b-9b3f5cc92534 admin admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:41:46.049493 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5474e50b-6097-4317-9270-40d9fcbf68bb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:41:46.050968 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5474e50b-6097-4317-9270-40d9fcbf68bb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:41:46.059239 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5474e50b-6097-4317-9270-40d9fcbf68bb admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:41:46.067723 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f767fe56-a765-42da-abd5-048b5fb517a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:41:46.068643 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f767fe56-a765-42da-abd5-048b5fb517a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:41:46.068913 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f767fe56-a765-42da-abd5-048b5fb517a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:41:46.069222 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f767fe56-a765-42da-abd5-048b5fb517a5 admin admin] PATH_INFO: `/v3/users/7878e7b66d184abfb0706c2567046976` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:41:46.071772 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f767fe56-a765-42da-abd5-048b5fb517a5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7878e7b66d184abfb0706c2567046976)` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:41:46.073804 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f767fe56-a765-42da-abd5-048b5fb517a5 admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:41:46.098079 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 833/1664] 10.222.0.67 () {58 vars in 1152 bytes} [Wed May 25 14:41:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:41:46.099258 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5474e50b-6097-4317-9270-40d9fcbf68bb admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:41:46.116674 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5474e50b-6097-4317-9270-40d9fcbf68bb admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:41:46.132426 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d44283-0f07-41d9-978d-5ef466cd161e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:41:46.133387 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d44283-0f07-41d9-978d-5ef466cd161e admin admin] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:41:46.133889 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d44283-0f07-41d9-978d-5ef466cd161e admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:41:46.134377 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d44283-0f07-41d9-978d-5ef466cd161e admin admin] PATH_INFO: `/v3/projects` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:41:46.135332 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d44283-0f07-41d9-978d-5ef466cd161e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:41:46.137506 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d44283-0f07-41d9-978d-5ef466cd161e admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:41:46.198104 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-f767fe56-a765-42da-abd5-048b5fb517a5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7878e7b66d184abfb0706c2567046976'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:41:46.198832 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-f767fe56-a765-42da-abd5-048b5fb517a5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7878e7b66d184abfb0706c2567046976'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:41:46.199490 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-f767fe56-a765-42da-abd5-048b5fb517a5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7878e7b66d184abfb0706c2567046976'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:41:46.201267 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 834/1665] 10.222.0.67 () {60 vars in 1152 bytes} [Wed May 25 14:41:46 2022] POST /identity/v3/projects => generated 363 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:41:46.205793 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d44283-0f07-41d9-978d-5ef466cd161e admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:41:46.211756 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-20d44283-0f07-41d9-978d-5ef466cd161e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:41:46.241069 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-f767fe56-a765-42da-abd5-048b5fb517a5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7878e7b66d184abfb0706c2567046976'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:41:46.268414 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-f767fe56-a765-42da-abd5-048b5fb517a5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7878e7b66d184abfb0706c2567046976'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:41:46.303321 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 832/1666] 10.222.0.67 () {58 vars in 1223 bytes} [Wed May 25 14:41:45 2022] DELETE /identity/v3/users/7878e7b66d184abfb0706c2567046976 => generated 0 bytes in 511 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:41:46.307986 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231dbf51-d051-451b-9bdd-924b73dccd3f None None] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:41:46.308229 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231dbf51-d051-451b-9bdd-924b73dccd3f None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:41:46.308390 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231dbf51-d051-451b-9bdd-924b73dccd3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:41:46.389229 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.auth.core [None req-231dbf51-d051-451b-9bdd-924b73dccd3f None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:41:46.391716 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-231dbf51-d051-451b-9bdd-924b73dccd3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:41:46.426635 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:41:46.437460 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d44283-0f07-41d9-978d-5ef466cd161e admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:41:46.587354 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:41:46.628618 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474fd14d-5fa1-4b2d-8c25-58377fc1f299 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:41:46.628864 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474fd14d-5fa1-4b2d-8c25-58377fc1f299 admin admin] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:41:46.629132 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474fd14d-5fa1-4b2d-8c25-58377fc1f299 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:41:46.629355 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474fd14d-5fa1-4b2d-8c25-58377fc1f299 admin admin] PATH_INFO: `/v3/users` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:41:46.630951 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474fd14d-5fa1-4b2d-8c25-58377fc1f299 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:41:46.635617 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474fd14d-5fa1-4b2d-8c25-58377fc1f299 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:41:46.639583 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 833/1667] 10.222.0.67 () {58 vars in 957 bytes} [Wed May 25 14:41:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 333 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:41:46.653482 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231dbf51-d051-451b-9bdd-924b73dccd3f None None] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:41:46.658651 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-231dbf51-d051-451b-9bdd-924b73dccd3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:41:46.703626 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 835/1668] 10.222.0.67 () {60 vars in 1143 bytes} [Wed May 25 14:41:46 2022] POST /identity/v3/users => generated 282 bytes in 499 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:41:46.708060 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474fd14d-5fa1-4b2d-8c25-58377fc1f299 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:41:46.734228 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474fd14d-5fa1-4b2d-8c25-58377fc1f299 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:41:46.751287 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170235f7-3005-4695-92e1-d2fd8ded1c27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:41:46.752779 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170235f7-3005-4695-92e1-d2fd8ded1c27 admin admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:41:46.753559 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170235f7-3005-4695-92e1-d2fd8ded1c27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:41:46.753984 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170235f7-3005-4695-92e1-d2fd8ded1c27 admin admin] PATH_INFO: `/v3/roles` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:41:46.754875 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170235f7-3005-4695-92e1-d2fd8ded1c27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:41:46.759908 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170235f7-3005-4695-92e1-d2fd8ded1c27 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:41:46.789130 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 836/1669] 10.222.0.67 () {58 vars in 1121 bytes} [Wed May 25 14:41:46 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:41:46.793894 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170235f7-3005-4695-92e1-d2fd8ded1c27 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:41:46.820266 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170235f7-3005-4695-92e1-d2fd8ded1c27 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:41:46.835859 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730c644e-595f-48b9-97c8-1fd0c4cfe29a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:41:46.836409 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730c644e-595f-48b9-97c8-1fd0c4cfe29a admin admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:41:46.836698 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730c644e-595f-48b9-97c8-1fd0c4cfe29a admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:41:46.836980 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730c644e-595f-48b9-97c8-1fd0c4cfe29a admin admin] PATH_INFO: `/v3/roles` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:41:46.837719 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730c644e-595f-48b9-97c8-1fd0c4cfe29a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:41:46.839715 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730c644e-595f-48b9-97c8-1fd0c4cfe29a admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:41:46.879819 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 837/1670] 10.222.0.67 () {58 vars in 1121 bytes} [Wed May 25 14:41:46 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:41:46.883375 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730c644e-595f-48b9-97c8-1fd0c4cfe29a admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:41:46.893027 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231dbf51-d051-451b-9bdd-924b73dccd3f None None] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:41:46.897357 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd9f80b-a192-4a94-9fe1-8ab36d0e990c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b68eed985c7b49839bcdd173186ad4ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfe93ee8d32a441295efc0b885de4bd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:41:46.899982 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd9f80b-a192-4a94-9fe1-8ab36d0e990c service neutron] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:41:46.902548 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd9f80b-a192-4a94-9fe1-8ab36d0e990c service neutron] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:41:46.902855 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd9f80b-a192-4a94-9fe1-8ab36d0e990c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:41:46.909916 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730c644e-595f-48b9-97c8-1fd0c4cfe29a admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:41:46.924620 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e50dc9-21ec-4ec0-b94f-e60551fcafbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:41:46.925546 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e50dc9-21ec-4ec0-b94f-e60551fcafbb admin admin] REQUEST_METHOD: `PUT` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:41:46.925834 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e50dc9-21ec-4ec0-b94f-e60551fcafbb admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:41:46.926114 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e50dc9-21ec-4ec0-b94f-e60551fcafbb admin admin] PATH_INFO: `/v3/projects/bbaf9bf5b9da433f9898ea81f50e6c8b/users/b6af7bfc44384f32a0774304a7a14a95/roles/48808901834b4d5eab2c7e6b5b03791e` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:41:46.930458 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd9f80b-a192-4a94-9fe1-8ab36d0e990c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:41:46.932961 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd9f80b-a192-4a94-9fe1-8ab36d0e990c service neutron] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:41:46.970041 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 834/1671] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 14:41:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 14:41:46.981550 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e50dc9-21ec-4ec0-b94f-e60551fcafbb admin admin] RBAC: Authorizing `identity:create_grant(project_id=bbaf9bf5b9da433f9898ea81f50e6c8b, user_id=b6af7bfc44384f32a0774304a7a14a95, role_id=48808901834b4d5eab2c7e6b5b03791e)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:41:46.985099 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e50dc9-21ec-4ec0-b94f-e60551fcafbb admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:41:47.017272 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 838/1672] 10.222.0.67 () {60 vars in 1482 bytes} [Wed May 25 14:41:46 2022] PUT /identity/v3/projects/bbaf9bf5b9da433f9898ea81f50e6c8b/users/b6af7bfc44384f32a0774304a7a14a95/roles/48808901834b4d5eab2c7e6b5b03791e => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:41:47.031120 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2c1054-c15e-49a5-ac3d-8b5b276cc46c None None] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:41:47.031462 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2c1054-c15e-49a5-ac3d-8b5b276cc46c None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:41:47.033927 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2c1054-c15e-49a5-ac3d-8b5b276cc46c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:41:47.122836 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.auth.core [None req-7b2c1054-c15e-49a5-ac3d-8b5b276cc46c None None] MFA Rules not processed for user `b6af7bfc44384f32a0774304a7a14a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:41:47.122836 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-7b2c1054-c15e-49a5-ac3d-8b5b276cc46c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:41:47.275474 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 835/1673] 10.222.0.67 () {58 vars in 957 bytes} [Wed May 25 14:41:47 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:41:47.281251 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e50dc9-21ec-4ec0-b94f-e60551fcafbb admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:41:47.456715 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e50dc9-21ec-4ec0-b94f-e60551fcafbb admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:41:47.465438 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef7bcba-af17-4076-8fae-f8452cca3863 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:41:47.465971 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef7bcba-af17-4076-8fae-f8452cca3863 admin admin] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:41:47.466260 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef7bcba-af17-4076-8fae-f8452cca3863 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:41:47.466546 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef7bcba-af17-4076-8fae-f8452cca3863 admin admin] PATH_INFO: `/v3/projects` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:41:47.467351 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef7bcba-af17-4076-8fae-f8452cca3863 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:41:47.469376 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef7bcba-af17-4076-8fae-f8452cca3863 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:41:47.537432 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 839/1674] 10.222.0.67 () {60 vars in 1152 bytes} [Wed May 25 14:41:47 2022] POST /identity/v3/projects => generated 365 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:41:47.542894 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2c1054-c15e-49a5-ac3d-8b5b276cc46c None None] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:41:47.562745 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2c1054-c15e-49a5-ac3d-8b5b276cc46c None None] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:41:47.637802 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:41:47.655022 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d344155a-9754-4245-a658-d4f23541126f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:41:47.656663 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d344155a-9754-4245-a658-d4f23541126f admin admin] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:41:47.657186 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d344155a-9754-4245-a658-d4f23541126f admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:41:47.657789 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d344155a-9754-4245-a658-d4f23541126f admin admin] PATH_INFO: `/v3/users` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:41:47.659896 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d344155a-9754-4245-a658-d4f23541126f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:41:47.662580 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d344155a-9754-4245-a658-d4f23541126f admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:41:47.691434 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 836/1675] 10.222.0.67 () {60 vars in 1143 bytes} [Wed May 25 14:41:47 2022] POST /identity/v3/users => generated 289 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:41:47.695192 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef7bcba-af17-4076-8fae-f8452cca3863 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:41:47.730200 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef7bcba-af17-4076-8fae-f8452cca3863 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:41:47.746881 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72e4fec-0745-4a98-a70a-d4ff95a3d152 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:41:47.748528 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72e4fec-0745-4a98-a70a-d4ff95a3d152 admin admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:41:47.749029 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72e4fec-0745-4a98-a70a-d4ff95a3d152 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:41:47.749565 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72e4fec-0745-4a98-a70a-d4ff95a3d152 admin admin] PATH_INFO: `/v3/roles` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:41:47.751373 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72e4fec-0745-4a98-a70a-d4ff95a3d152 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:41:47.754072 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72e4fec-0745-4a98-a70a-d4ff95a3d152 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:41:47.769276 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 840/1676] 10.222.0.67 () {58 vars in 1121 bytes} [Wed May 25 14:41:47 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 25 14:41:47.777168 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d344155a-9754-4245-a658-d4f23541126f admin admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:41:47.789371 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d344155a-9754-4245-a658-d4f23541126f admin admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:41:47.795143 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15772157-3902-4996-98bb-13ce7acdb312 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:41:47.796070 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15772157-3902-4996-98bb-13ce7acdb312 admin admin] REQUEST_METHOD: `PUT` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:41:47.796358 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15772157-3902-4996-98bb-13ce7acdb312 admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:41:47.796643 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15772157-3902-4996-98bb-13ce7acdb312 admin admin] PATH_INFO: `/v3/projects/656fded9a2c549c2a06c9d171e9c9621/users/31925b255109488697ee0abc4f0b462e/roles/399893e19eac4ab5a8e596f7c07be13c` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:41:47.845360 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15772157-3902-4996-98bb-13ce7acdb312 admin admin] RBAC: Authorizing `identity:create_grant(project_id=656fded9a2c549c2a06c9d171e9c9621, user_id=31925b255109488697ee0abc4f0b462e, role_id=399893e19eac4ab5a8e596f7c07be13c)` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:41:47.850032 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15772157-3902-4996-98bb-13ce7acdb312 admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:41:47.923601 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 837/1677] 10.222.0.67 () {60 vars in 1482 bytes} [Wed May 25 14:41:47 2022] PUT /identity/v3/projects/656fded9a2c549c2a06c9d171e9c9621/users/31925b255109488697ee0abc4f0b462e/roles/399893e19eac4ab5a8e596f7c07be13c => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:41:47.924216 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72e4fec-0745-4a98-a70a-d4ff95a3d152 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:41:47.947521 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72e4fec-0745-4a98-a70a-d4ff95a3d152 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:41:48.142395 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d49e1a6-62dd-4fd4-a5d8-67c2b41873a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:41:48.146523 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d49e1a6-62dd-4fd4-a5d8-67c2b41873a7 admin admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:41:48.146954 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d49e1a6-62dd-4fd4-a5d8-67c2b41873a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:41:48.148025 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d49e1a6-62dd-4fd4-a5d8-67c2b41873a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:41:48.150392 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d49e1a6-62dd-4fd4-a5d8-67c2b41873a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:41:48.153517 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d49e1a6-62dd-4fd4-a5d8-67c2b41873a7 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:41:48.167543 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:41:48.181800 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 841/1678] 10.222.0.67 () {58 vars in 1121 bytes} [Wed May 25 14:41:47 2022] GET /identity/v3/roles => generated 1420 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 25 14:41:48.186483 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15772157-3902-4996-98bb-13ce7acdb312 admin admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:41:48.204087 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15772157-3902-4996-98bb-13ce7acdb312 admin admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:41:48.224426 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3167ba9-e32c-4c72-a798-b2bbf58b33d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:41:48.225339 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3167ba9-e32c-4c72-a798-b2bbf58b33d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:41:48.225620 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3167ba9-e32c-4c72-a798-b2bbf58b33d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:41:48.225994 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3167ba9-e32c-4c72-a798-b2bbf58b33d3 admin admin] PATH_INFO: `/v3/projects/656fded9a2c549c2a06c9d171e9c9621/users/31925b255109488697ee0abc4f0b462e/roles/399893e19eac4ab5a8e596f7c07be13c` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:41:48.242306 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3167ba9-e32c-4c72-a798-b2bbf58b33d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=656fded9a2c549c2a06c9d171e9c9621, user_id=31925b255109488697ee0abc4f0b462e, role_id=399893e19eac4ab5a8e596f7c07be13c)` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:41:48.245381 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3167ba9-e32c-4c72-a798-b2bbf58b33d3 admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:41:48.292825 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 838/1679] 10.222.0.67 () {60 vars in 1482 bytes} [Wed May 25 14:41:48 2022] PUT /identity/v3/projects/656fded9a2c549c2a06c9d171e9c9621/users/31925b255109488697ee0abc4f0b462e/roles/399893e19eac4ab5a8e596f7c07be13c => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:41:48.297451 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1bb3e6-9c2f-4ae2-9257-1c761ca426ea None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:41:48.297744 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1bb3e6-9c2f-4ae2-9257-1c761ca426ea None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:41:48.298074 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1bb3e6-9c2f-4ae2-9257-1c761ca426ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:41:48.357553 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-3b1bb3e6-9c2f-4ae2-9257-1c761ca426ea None None] MFA Rules not processed for user `31925b255109488697ee0abc4f0b462e`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:41:48.358791 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-3b1bb3e6-9c2f-4ae2-9257-1c761ca426ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:41:48.385481 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc55ba6-60d4-4efe-ab30-84c882263ea0 None None] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:41:48.386301 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc55ba6-60d4-4efe-ab30-84c882263ea0 None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:41:48.386820 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc55ba6-60d4-4efe-ab30-84c882263ea0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:41:48.457429 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.auth.core [None req-1dc55ba6-60d4-4efe-ab30-84c882263ea0 None None] MFA Rules not processed for user `e03f5bb82ffb41a1b1dde935d093e6f4`. Rule list: `[]` (Enabled: `True`). {{(pid=80474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:41:48.458940 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-1dc55ba6-60d4-4efe-ab30-84c882263ea0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:41:48.591020 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 842/1680] 10.222.0.67 () {58 vars in 957 bytes} [Wed May 25 14:41:48 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 294 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:41:48.592123 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 839/1681] 10.222.0.67 () {58 vars in 1009 bytes} [Wed May 25 14:41:48 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:41:48.597118 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1bb3e6-9c2f-4ae2-9257-1c761ca426ea None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:41:48.599070 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-3b1bb3e6-9c2f-4ae2-9257-1c761ca426ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:41:48.755168 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1bb3e6-9c2f-4ae2-9257-1c761ca426ea None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:41:48.765553 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b22052-88ea-4ec6-bc25-11cae229a5c3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e462acc9da84a61bb23998dd54e1858', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfe93ee8d32a441295efc0b885de4bd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:41:48.768101 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b22052-88ea-4ec6-bc25-11cae229a5c3 service cinder] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:41:48.768446 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b22052-88ea-4ec6-bc25-11cae229a5c3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:41:48.771874 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b22052-88ea-4ec6-bc25-11cae229a5c3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:41:48.804617 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b22052-88ea-4ec6-bc25-11cae229a5c3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:41:48.815763 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b22052-88ea-4ec6-bc25-11cae229a5c3 service cinder] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:41:48.834211 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df14b083-9dda-40ec-9e2d-40e446a9f14e None None] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:41:48.834545 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df14b083-9dda-40ec-9e2d-40e446a9f14e None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:41:48.835620 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df14b083-9dda-40ec-9e2d-40e446a9f14e None None] PATH_INFO: `/` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:41:48.844565 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 840/1682] 10.222.0.67 () {54 vars in 921 bytes} [Wed May 25 14:41:48 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:41:48.865344 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f758ecf2-5342-46e4-bca2-7cdf1d89b5df None None] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:41:48.865646 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f758ecf2-5342-46e4-bca2-7cdf1d89b5df None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:41:48.865966 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f758ecf2-5342-46e4-bca2-7cdf1d89b5df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:41:48.868674 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 843/1683] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 14:41:48 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 273 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 14:41:48.928815 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.auth.core [None req-f758ecf2-5342-46e4-bca2-7cdf1d89b5df None None] MFA Rules not processed for user `ad2b99c2122a4311996364e982e1c801`. Rule list: `[]` (Enabled: `True`). {{(pid=80474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:41:48.933527 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-f758ecf2-5342-46e4-bca2-7cdf1d89b5df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:41:48.992129 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b22052-88ea-4ec6-bc25-11cae229a5c3 service cinder] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:41:48.994398 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-06b22052-88ea-4ec6-bc25-11cae229a5c3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:41:49.138096 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 841/1684] 10.222.0.67 () {58 vars in 1018 bytes} [Wed May 25 14:41:48 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:41:49.195657 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b22052-88ea-4ec6-bc25-11cae229a5c3 service cinder] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:41:49.212773 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b682d57-fb82-4913-bc29-4fe372c9d4fe service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbe9e38881834198842a476889678096', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfe93ee8d32a441295efc0b885de4bd7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:41:49.218054 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b682d57-fb82-4913-bc29-4fe372c9d4fe service swift] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:41:49.218054 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b682d57-fb82-4913-bc29-4fe372c9d4fe service swift] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:41:49.218054 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b682d57-fb82-4913-bc29-4fe372c9d4fe service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:41:49.236258 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b682d57-fb82-4913-bc29-4fe372c9d4fe service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:41:49.242685 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b682d57-fb82-4913-bc29-4fe372c9d4fe service swift] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:41:49.271348 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 844/1685] 10.222.0.67 () {60 vars in 1384 bytes} [Wed May 25 14:41:48 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 280 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 25 14:41:49.409653 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f758ecf2-5342-46e4-bca2-7cdf1d89b5df None None] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:41:49.413096 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-f758ecf2-5342-46e4-bca2-7cdf1d89b5df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:41:49.436005 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f758ecf2-5342-46e4-bca2-7cdf1d89b5df None None] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:41:49.448885 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76319454-c31b-4686-8c4f-b1348e3c16fa service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad2b99c2122a4311996364e982e1c801', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfe93ee8d32a441295efc0b885de4bd7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:41:49.449598 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76319454-c31b-4686-8c4f-b1348e3c16fa service placement] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:41:49.449891 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76319454-c31b-4686-8c4f-b1348e3c16fa service placement] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:41:49.450178 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76319454-c31b-4686-8c4f-b1348e3c16fa service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:41:49.479706 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76319454-c31b-4686-8c4f-b1348e3c16fa service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:41:49.482968 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76319454-c31b-4686-8c4f-b1348e3c16fa service placement] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:41:49.516122 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 842/1686] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 14:41:49 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:41:49.662942 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b682d57-fb82-4913-bc29-4fe372c9d4fe service swift] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:41:49.664461 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-1b682d57-fb82-4913-bc29-4fe372c9d4fe service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:41:49.744895 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:41:49.874718 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b682d57-fb82-4913-bc29-4fe372c9d4fe service swift] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:41:49.899076 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9495e16-f0d4-4ece-944e-f1deae15cbd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:41:49.899984 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9495e16-f0d4-4ece-944e-f1deae15cbd0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:41:49.900266 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9495e16-f0d4-4ece-944e-f1deae15cbd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:41:49.900547 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9495e16-f0d4-4ece-944e-f1deae15cbd0 admin admin] PATH_INFO: `/v3/users/d4364a0642ec40b691742ecedd3018cf` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:41:49.901978 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9495e16-f0d4-4ece-944e-f1deae15cbd0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d4364a0642ec40b691742ecedd3018cf)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:41:49.904846 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9495e16-f0d4-4ece-944e-f1deae15cbd0 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:41:50.035841 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-b9495e16-f0d4-4ece-944e-f1deae15cbd0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd4364a0642ec40b691742ecedd3018cf'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:41:50.054119 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-b9495e16-f0d4-4ece-944e-f1deae15cbd0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd4364a0642ec40b691742ecedd3018cf'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:41:50.055093 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-b9495e16-f0d4-4ece-944e-f1deae15cbd0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd4364a0642ec40b691742ecedd3018cf'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:41:50.076383 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-b9495e16-f0d4-4ece-944e-f1deae15cbd0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd4364a0642ec40b691742ecedd3018cf'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:41:50.126476 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-b9495e16-f0d4-4ece-944e-f1deae15cbd0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd4364a0642ec40b691742ecedd3018cf'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:41:50.141026 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 845/1687] 10.222.0.67 () {58 vars in 1223 bytes} [Wed May 25 14:41:49 2022] DELETE /identity/v3/users/d4364a0642ec40b691742ecedd3018cf => generated 0 bytes in 478 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:41:50.275702 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76319454-c31b-4686-8c4f-b1348e3c16fa service placement] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:41:50.298568 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76319454-c31b-4686-8c4f-b1348e3c16fa service placement] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:41:50.431245 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:41:50.543853 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2719f56b-c71e-43cc-8688-5c5de50d36c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:41:50.544782 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2719f56b-c71e-43cc-8688-5c5de50d36c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:41:50.545072 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2719f56b-c71e-43cc-8688-5c5de50d36c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:41:50.545353 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2719f56b-c71e-43cc-8688-5c5de50d36c0 admin admin] PATH_INFO: `/v3/users/b6af7bfc44384f32a0774304a7a14a95` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:41:50.547844 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2719f56b-c71e-43cc-8688-5c5de50d36c0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b6af7bfc44384f32a0774304a7a14a95)` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:41:50.551147 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2719f56b-c71e-43cc-8688-5c5de50d36c0 admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:41:50.707402 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-2719f56b-c71e-43cc-8688-5c5de50d36c0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b6af7bfc44384f32a0774304a7a14a95'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:41:50.712662 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-2719f56b-c71e-43cc-8688-5c5de50d36c0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b6af7bfc44384f32a0774304a7a14a95'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:41:50.713804 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-2719f56b-c71e-43cc-8688-5c5de50d36c0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b6af7bfc44384f32a0774304a7a14a95'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:41:50.738812 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-2719f56b-c71e-43cc-8688-5c5de50d36c0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b6af7bfc44384f32a0774304a7a14a95'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:41:50.760999 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-2719f56b-c71e-43cc-8688-5c5de50d36c0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b6af7bfc44384f32a0774304a7a14a95'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:41:50.788660 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 843/1688] 10.222.0.67 () {58 vars in 1223 bytes} [Wed May 25 14:41:50 2022] DELETE /identity/v3/users/b6af7bfc44384f32a0774304a7a14a95 => generated 0 bytes in 509 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:41:50.790056 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0da42d-5b97-4614-924c-2a4f5630de6b None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:41:50.790349 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0da42d-5b97-4614-924c-2a4f5630de6b None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:41:50.790628 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0da42d-5b97-4614-924c-2a4f5630de6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:41:50.842582 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-ab0da42d-5b97-4614-924c-2a4f5630de6b None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:41:50.842582 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-ab0da42d-5b97-4614-924c-2a4f5630de6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:41:50.982512 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2719f56b-c71e-43cc-8688-5c5de50d36c0 admin admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:41:50.985947 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-2719f56b-c71e-43cc-8688-5c5de50d36c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:41:51.097799 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 846/1689] 10.222.0.67 () {58 vars in 957 bytes} [Wed May 25 14:41:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 309 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 14:41:51.153677 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0da42d-5b97-4614-924c-2a4f5630de6b None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:41:51.155210 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-ab0da42d-5b97-4614-924c-2a4f5630de6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:41:51.331680 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2719f56b-c71e-43cc-8688-5c5de50d36c0 admin admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:41:51.338398 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:41:51.363472 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6610c5b-eaf3-4216-8b96-e64e25763ea5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:41:51.364386 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6610c5b-eaf3-4216-8b96-e64e25763ea5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:41:51.364674 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6610c5b-eaf3-4216-8b96-e64e25763ea5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:41:51.364956 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6610c5b-eaf3-4216-8b96-e64e25763ea5 admin admin] PATH_INFO: `/v3/projects/d6d7498b8ce64730bc7991cb01f72f1d` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:41:51.380270 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6610c5b-eaf3-4216-8b96-e64e25763ea5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d6d7498b8ce64730bc7991cb01f72f1d)` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:41:51.382509 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6610c5b-eaf3-4216-8b96-e64e25763ea5 admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:41:51.409427 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0da42d-5b97-4614-924c-2a4f5630de6b None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:41:51.426653 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00c3c65-23d7-4398-bc03-c6ce61ef30d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b68eed985c7b49839bcdd173186ad4ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfe93ee8d32a441295efc0b885de4bd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:41:51.427368 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00c3c65-23d7-4398-bc03-c6ce61ef30d3 service neutron] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:41:51.427656 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00c3c65-23d7-4398-bc03-c6ce61ef30d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:41:51.427939 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00c3c65-23d7-4398-bc03-c6ce61ef30d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:41:51.483516 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00c3c65-23d7-4398-bc03-c6ce61ef30d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:41:51.484993 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00c3c65-23d7-4398-bc03-c6ce61ef30d3 service neutron] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:41:51.527742 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 847/1690] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 14:41:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:41:51.595231 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:41:51.610041 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-e6610c5b-eaf3-4216-8b96-e64e25763ea5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd6d7498b8ce64730bc7991cb01f72f1d', 'request_id': 'req-e6610c5b-eaf3-4216-8b96-e64e25763ea5'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:41:51.636761 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-e6610c5b-eaf3-4216-8b96-e64e25763ea5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd6d7498b8ce64730bc7991cb01f72f1d', 'request_id': 'req-e6610c5b-eaf3-4216-8b96-e64e25763ea5'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:41:51.691765 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-e6610c5b-eaf3-4216-8b96-e64e25763ea5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd6d7498b8ce64730bc7991cb01f72f1d', 'request_id': 'req-e6610c5b-eaf3-4216-8b96-e64e25763ea5'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:41:51.738710 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-e6610c5b-eaf3-4216-8b96-e64e25763ea5 admin admin] The token cache is being invalidate because project d6d7498b8ce64730bc7991cb01f72f1d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80474) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 14:41:51.742681 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-e6610c5b-eaf3-4216-8b96-e64e25763ea5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:41:51.746822 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-e6610c5b-eaf3-4216-8b96-e64e25763ea5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:41:51.763428 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 844/1691] 10.222.0.67 () {58 vars in 1232 bytes} [Wed May 25 14:41:50 2022] DELETE /identity/v3/projects/d6d7498b8ce64730bc7991cb01f72f1d => generated 0 bytes in 781 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 14:41:51.768233 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593226a0-a749-4374-93c8-9975fd5c1814 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:41:51.768528 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593226a0-a749-4374-93c8-9975fd5c1814 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:41:51.768819 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593226a0-a749-4374-93c8-9975fd5c1814 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:41:51.816754 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-593226a0-a749-4374-93c8-9975fd5c1814 None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:41:51.818196 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-593226a0-a749-4374-93c8-9975fd5c1814 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:41:52.004192 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b805dc-4b15-48d4-9c30-f237d31ec508 None None] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:41:52.004783 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b805dc-4b15-48d4-9c30-f237d31ec508 None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:41:52.005090 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b805dc-4b15-48d4-9c30-f237d31ec508 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:41:52.049610 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 848/1692] 10.222.0.67 () {58 vars in 957 bytes} [Wed May 25 14:41:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:41:52.052240 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a04ef11-989f-4049-9609-6f0497b5e6c8 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:41:52.053322 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a04ef11-989f-4049-9609-6f0497b5e6c8 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:41:52.053762 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a04ef11-989f-4049-9609-6f0497b5e6c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:41:52.114538 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.auth.core [None req-16b805dc-4b15-48d4-9c30-f237d31ec508 None None] MFA Rules not processed for user `4db7e98c4244461daf725c699fb2b9a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:41:52.116389 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-16b805dc-4b15-48d4-9c30-f237d31ec508 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:41:52.153127 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-1a04ef11-989f-4049-9609-6f0497b5e6c8 None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:41:52.154959 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-1a04ef11-989f-4049-9609-6f0497b5e6c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:41:52.202013 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 849/1693] 10.222.0.67 () {58 vars in 957 bytes} [Wed May 25 14:41:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:41:52.207466 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a04ef11-989f-4049-9609-6f0497b5e6c8 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:41:52.253784 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a04ef11-989f-4049-9609-6f0497b5e6c8 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:41:52.280137 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181da4f4-0e7d-467f-b9af-0ae4ce81237d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:41:52.281147 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181da4f4-0e7d-467f-b9af-0ae4ce81237d admin admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:41:52.281589 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181da4f4-0e7d-467f-b9af-0ae4ce81237d admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:41:52.282049 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181da4f4-0e7d-467f-b9af-0ae4ce81237d admin admin] PATH_INFO: `/v3/domains` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:41:52.282958 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181da4f4-0e7d-467f-b9af-0ae4ce81237d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:41:52.291124 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181da4f4-0e7d-467f-b9af-0ae4ce81237d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:41:52.291124 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181da4f4-0e7d-467f-b9af-0ae4ce81237d admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:41:52.331199 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 850/1694] 10.222.0.67 () {58 vars in 1152 bytes} [Wed May 25 14:41:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:41:52.337763 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181da4f4-0e7d-467f-b9af-0ae4ce81237d admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:41:52.375737 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 845/1695] 10.222.0.67 () {58 vars in 957 bytes} [Wed May 25 14:41:52 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 373 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:41:52.378144 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b805dc-4b15-48d4-9c30-f237d31ec508 None None] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:41:52.383715 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-16b805dc-4b15-48d4-9c30-f237d31ec508 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:41:52.387114 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181da4f4-0e7d-467f-b9af-0ae4ce81237d admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:41:52.410409 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3d9f28-e310-4932-8316-94afeffb4278 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:41:52.426251 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3d9f28-e310-4932-8316-94afeffb4278 admin admin] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:41:52.430233 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3d9f28-e310-4932-8316-94afeffb4278 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:41:52.432655 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3d9f28-e310-4932-8316-94afeffb4278 admin admin] PATH_INFO: `/v3/projects` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:41:52.437549 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3d9f28-e310-4932-8316-94afeffb4278 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:41:52.446045 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3d9f28-e310-4932-8316-94afeffb4278 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:41:52.534806 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 851/1696] 10.222.0.67 () {60 vars in 1152 bytes} [Wed May 25 14:41:52 2022] POST /identity/v3/projects => generated 381 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:41:52.537477 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3d9f28-e310-4932-8316-94afeffb4278 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:41:52.662384 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b805dc-4b15-48d4-9c30-f237d31ec508 None None] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:41:52.823378 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3d9f28-e310-4932-8316-94afeffb4278 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:41:52.859884 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850fcc7a-90f3-4ce4-a0d9-76376a6e0558 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:41:52.868256 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850fcc7a-90f3-4ce4-a0d9-76376a6e0558 admin admin] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:41:52.868915 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850fcc7a-90f3-4ce4-a0d9-76376a6e0558 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:41:52.869782 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850fcc7a-90f3-4ce4-a0d9-76376a6e0558 admin admin] PATH_INFO: `/v3/users` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:41:52.870656 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850fcc7a-90f3-4ce4-a0d9-76376a6e0558 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:41:52.873446 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850fcc7a-90f3-4ce4-a0d9-76376a6e0558 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:41:53.006648 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 852/1697] 10.222.0.67 () {60 vars in 1143 bytes} [Wed May 25 14:41:52 2022] POST /identity/v3/users => generated 291 bytes in 470 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:41:53.007925 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850fcc7a-90f3-4ce4-a0d9-76376a6e0558 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:41:53.011368 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:41:53.030303 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-850fcc7a-90f3-4ce4-a0d9-76376a6e0558 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:41:53.046171 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b91434-9943-4393-970c-84f9e09685e8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '428ec99478284743943ed41e9d24a603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfe93ee8d32a441295efc0b885de4bd7', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:41:53.047055 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b91434-9943-4393-970c-84f9e09685e8 service nova] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:41:53.055044 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b91434-9943-4393-970c-84f9e09685e8 service nova] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:41:53.055044 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b91434-9943-4393-970c-84f9e09685e8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:41:53.099287 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850fcc7a-90f3-4ce4-a0d9-76376a6e0558 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:41:53.116062 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30108baa-eff3-42e1-b7a4-ad70bbde5a37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:41:53.116949 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30108baa-eff3-42e1-b7a4-ad70bbde5a37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:41:53.117423 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30108baa-eff3-42e1-b7a4-ad70bbde5a37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:41:53.117851 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30108baa-eff3-42e1-b7a4-ad70bbde5a37 admin admin] PATH_INFO: `/v3/projects/f103ef64a62247c08af8789e30599e47` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:41:53.129891 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30108baa-eff3-42e1-b7a4-ad70bbde5a37 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f103ef64a62247c08af8789e30599e47)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:41:53.134012 dv-cinder-787296-9-smb devstack@keystone.service[80475]: WARNING py.warnings [None req-30108baa-eff3-42e1-b7a4-ad70bbde5a37 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 25 14:41:53.134012 dv-cinder-787296-9-smb devstack@keystone.service[80475]: warnings.warn(msg) May 25 14:41:53.134012 dv-cinder-787296-9-smb devstack@keystone.service[80475]: May 25 14:41:53.138011 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30108baa-eff3-42e1-b7a4-ad70bbde5a37 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:41:53.245369 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:41:53.295018 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b91434-9943-4393-970c-84f9e09685e8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:41:53.296658 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b91434-9943-4393-970c-84f9e09685e8 service nova] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:41:53.324787 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 846/1698] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 14:41:52 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 948 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:41:53.329104 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b91434-9943-4393-970c-84f9e09685e8 service nova] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:41:53.338536 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-30108baa-eff3-42e1-b7a4-ad70bbde5a37 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f103ef64a62247c08af8789e30599e47', 'request_id': 'req-30108baa-eff3-42e1-b7a4-ad70bbde5a37'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:41:53.355114 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b91434-9943-4393-970c-84f9e09685e8 service nova] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:41:53.356767 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-30108baa-eff3-42e1-b7a4-ad70bbde5a37 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f103ef64a62247c08af8789e30599e47', 'request_id': 'req-30108baa-eff3-42e1-b7a4-ad70bbde5a37'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:41:53.401875 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-30108baa-eff3-42e1-b7a4-ad70bbde5a37 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f103ef64a62247c08af8789e30599e47', 'request_id': 'req-30108baa-eff3-42e1-b7a4-ad70bbde5a37'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:41:53.447284 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-30108baa-eff3-42e1-b7a4-ad70bbde5a37 admin admin] The token cache is being invalidate because project f103ef64a62247c08af8789e30599e47 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80475) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 14:41:53.447645 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-30108baa-eff3-42e1-b7a4-ad70bbde5a37 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:41:53.448682 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-30108baa-eff3-42e1-b7a4-ad70bbde5a37 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:41:53.458438 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 853/1699] 10.222.0.67 () {58 vars in 1232 bytes} [Wed May 25 14:41:53 2022] DELETE /identity/v3/projects/f103ef64a62247c08af8789e30599e47 => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:41:53.460348 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30108baa-eff3-42e1-b7a4-ad70bbde5a37 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:41:53.463929 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-30108baa-eff3-42e1-b7a4-ad70bbde5a37 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:41:53.537061 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6d40c5-d6ed-4e12-bafc-0d3674868642 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:41:53.537751 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6d40c5-d6ed-4e12-bafc-0d3674868642 admin admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:41:53.538036 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6d40c5-d6ed-4e12-bafc-0d3674868642 admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:41:53.538310 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6d40c5-d6ed-4e12-bafc-0d3674868642 admin admin] PATH_INFO: `/v3/roles` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:41:53.539081 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6d40c5-d6ed-4e12-bafc-0d3674868642 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:41:53.552173 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6d40c5-d6ed-4e12-bafc-0d3674868642 admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:41:53.599403 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 847/1700] 10.222.0.67 () {58 vars in 1121 bytes} [Wed May 25 14:41:53 2022] GET /identity/v3/roles => generated 1420 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:41:53.606265 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6d40c5-d6ed-4e12-bafc-0d3674868642 admin admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:41:53.609577 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-8d6d40c5-d6ed-4e12-bafc-0d3674868642 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:41:53.649621 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6d40c5-d6ed-4e12-bafc-0d3674868642 admin admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:41:53.671528 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afaab32-ad04-4aee-bb87-2dad0f462e33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:41:53.672278 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afaab32-ad04-4aee-bb87-2dad0f462e33 admin admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:41:53.672519 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afaab32-ad04-4aee-bb87-2dad0f462e33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:41:53.672801 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afaab32-ad04-4aee-bb87-2dad0f462e33 admin admin] PATH_INFO: `/v3/roles` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:41:53.673543 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afaab32-ad04-4aee-bb87-2dad0f462e33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:41:53.686148 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afaab32-ad04-4aee-bb87-2dad0f462e33 admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:41:53.702284 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30108baa-eff3-42e1-b7a4-ad70bbde5a37 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:41:53.719710 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76c025d-6a4b-4db8-9212-c587be71e22e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:41:53.721689 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76c025d-6a4b-4db8-9212-c587be71e22e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:41:53.721689 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76c025d-6a4b-4db8-9212-c587be71e22e admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:41:53.721689 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76c025d-6a4b-4db8-9212-c587be71e22e admin admin] PATH_INFO: `/v3/users/1e23a355ce6a4ebab24a9537be353477` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:41:53.728137 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 848/1701] 10.222.0.67 () {58 vars in 1121 bytes} [Wed May 25 14:41:53 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:41:53.728384 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76c025d-6a4b-4db8-9212-c587be71e22e admin admin] RBAC: Authorizing `identity:delete_user(user_id=1e23a355ce6a4ebab24a9537be353477)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:41:53.730199 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afaab32-ad04-4aee-bb87-2dad0f462e33 admin admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:41:53.739738 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76c025d-6a4b-4db8-9212-c587be71e22e admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:41:53.780120 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afaab32-ad04-4aee-bb87-2dad0f462e33 admin admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:41:53.795125 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e34e44a-0555-4848-bf71-202e9a2928d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:41:53.799851 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e34e44a-0555-4848-bf71-202e9a2928d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:41:53.801654 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e34e44a-0555-4848-bf71-202e9a2928d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:41:53.801956 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e34e44a-0555-4848-bf71-202e9a2928d4 admin admin] PATH_INFO: `/v3/projects/531d12498064492a847c147e0cdce532/users/eef733e11dc04d83ba2e9b2c1d64f26a/roles/48808901834b4d5eab2c7e6b5b03791e` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:41:53.849228 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e34e44a-0555-4848-bf71-202e9a2928d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=531d12498064492a847c147e0cdce532, user_id=eef733e11dc04d83ba2e9b2c1d64f26a, role_id=48808901834b4d5eab2c7e6b5b03791e)` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:41:53.852100 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e34e44a-0555-4848-bf71-202e9a2928d4 admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:41:53.900948 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 849/1702] 10.222.0.67 () {60 vars in 1482 bytes} [Wed May 25 14:41:53 2022] PUT /identity/v3/projects/531d12498064492a847c147e0cdce532/users/eef733e11dc04d83ba2e9b2c1d64f26a/roles/48808901834b4d5eab2c7e6b5b03791e => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:41:53.900948 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e34e44a-0555-4848-bf71-202e9a2928d4 admin admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:41:53.938458 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-6e34e44a-0555-4848-bf71-202e9a2928d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:41:54.030150 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-b76c025d-6a4b-4db8-9212-c587be71e22e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1e23a355ce6a4ebab24a9537be353477'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:41:54.051373 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-b76c025d-6a4b-4db8-9212-c587be71e22e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1e23a355ce6a4ebab24a9537be353477'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:41:54.052353 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-b76c025d-6a4b-4db8-9212-c587be71e22e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1e23a355ce6a4ebab24a9537be353477'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:41:54.077881 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-b76c025d-6a4b-4db8-9212-c587be71e22e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1e23a355ce6a4ebab24a9537be353477'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:41:54.127840 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-b76c025d-6a4b-4db8-9212-c587be71e22e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1e23a355ce6a4ebab24a9537be353477'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:41:54.145459 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 854/1703] 10.222.0.67 () {58 vars in 1223 bytes} [Wed May 25 14:41:53 2022] DELETE /identity/v3/users/1e23a355ce6a4ebab24a9537be353477 => generated 0 bytes in 686 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:41:54.155751 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3047ec6-9655-4cc7-824e-9d5cbba418a0 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:41:54.156153 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3047ec6-9655-4cc7-824e-9d5cbba418a0 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:41:54.156153 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3047ec6-9655-4cc7-824e-9d5cbba418a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:41:54.220485 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e34e44a-0555-4848-bf71-202e9a2928d4 admin admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:41:54.223319 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-a3047ec6-9655-4cc7-824e-9d5cbba418a0 None None] MFA Rules not processed for user `eef733e11dc04d83ba2e9b2c1d64f26a`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:41:54.225965 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-a3047ec6-9655-4cc7-824e-9d5cbba418a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:41:54.232676 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:41:54.285099 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:41:54.388072 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8731f0a4-0e60-4ad8-8120-26628e3e66f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:41:54.389079 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8731f0a4-0e60-4ad8-8120-26628e3e66f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:41:54.389373 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8731f0a4-0e60-4ad8-8120-26628e3e66f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:41:54.389650 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8731f0a4-0e60-4ad8-8120-26628e3e66f7 admin admin] PATH_INFO: `/v3/projects/bbaf9bf5b9da433f9898ea81f50e6c8b` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:41:54.393227 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8731f0a4-0e60-4ad8-8120-26628e3e66f7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bbaf9bf5b9da433f9898ea81f50e6c8b)` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:41:54.395218 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8731f0a4-0e60-4ad8-8120-26628e3e66f7 admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:41:54.405787 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 855/1704] 10.222.0.67 () {58 vars in 957 bytes} [Wed May 25 14:41:54 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:41:54.406716 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3047ec6-9655-4cc7-824e-9d5cbba418a0 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:41:54.411548 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-a3047ec6-9655-4cc7-824e-9d5cbba418a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:41:54.441881 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3047ec6-9655-4cc7-824e-9d5cbba418a0 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:41:54.453633 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cba16a-9472-4b93-b4e3-76aa7535b33a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:41:54.454336 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cba16a-9472-4b93-b4e3-76aa7535b33a admin admin] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:41:54.454623 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cba16a-9472-4b93-b4e3-76aa7535b33a admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:41:54.454936 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cba16a-9472-4b93-b4e3-76aa7535b33a admin admin] PATH_INFO: `/v3/projects` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:41:54.455762 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cba16a-9472-4b93-b4e3-76aa7535b33a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:41:54.464291 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cba16a-9472-4b93-b4e3-76aa7535b33a admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:41:54.519634 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-8731f0a4-0e60-4ad8-8120-26628e3e66f7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bbaf9bf5b9da433f9898ea81f50e6c8b', 'request_id': 'req-8731f0a4-0e60-4ad8-8120-26628e3e66f7'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:41:54.543843 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 856/1705] 10.222.0.67 () {60 vars in 1152 bytes} [Wed May 25 14:41:54 2022] POST /identity/v3/projects => generated 381 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:41:54.548282 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-8731f0a4-0e60-4ad8-8120-26628e3e66f7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bbaf9bf5b9da433f9898ea81f50e6c8b', 'request_id': 'req-8731f0a4-0e60-4ad8-8120-26628e3e66f7'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:41:54.550507 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cba16a-9472-4b93-b4e3-76aa7535b33a admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:41:54.562798 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-8731f0a4-0e60-4ad8-8120-26628e3e66f7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bbaf9bf5b9da433f9898ea81f50e6c8b', 'request_id': 'req-8731f0a4-0e60-4ad8-8120-26628e3e66f7'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:41:54.578094 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-8731f0a4-0e60-4ad8-8120-26628e3e66f7 admin admin] The token cache is being invalidate because project bbaf9bf5b9da433f9898ea81f50e6c8b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80474) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 14:41:54.578525 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-8731f0a4-0e60-4ad8-8120-26628e3e66f7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:41:54.579574 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-8731f0a4-0e60-4ad8-8120-26628e3e66f7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:41:54.582098 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 850/1706] 10.222.0.67 () {58 vars in 1232 bytes} [Wed May 25 14:41:53 2022] DELETE /identity/v3/projects/bbaf9bf5b9da433f9898ea81f50e6c8b => generated 0 bytes in 682 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:41:54.587789 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8731f0a4-0e60-4ad8-8120-26628e3e66f7 admin admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:41:54.589775 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-8731f0a4-0e60-4ad8-8120-26628e3e66f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:41:54.717837 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8731f0a4-0e60-4ad8-8120-26628e3e66f7 admin admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:41:54.791722 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cba16a-9472-4b93-b4e3-76aa7535b33a admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:41:54.805886 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfa232e-ebf3-451f-845f-5232b1b0a394 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:41:54.807050 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfa232e-ebf3-451f-845f-5232b1b0a394 admin admin] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:41:54.807570 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfa232e-ebf3-451f-845f-5232b1b0a394 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:41:54.808055 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfa232e-ebf3-451f-845f-5232b1b0a394 admin admin] PATH_INFO: `/v3/users` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:41:54.809016 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfa232e-ebf3-451f-845f-5232b1b0a394 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:41:54.812103 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfa232e-ebf3-451f-845f-5232b1b0a394 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:41:54.866867 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 857/1707] 10.222.0.67 () {60 vars in 1143 bytes} [Wed May 25 14:41:54 2022] POST /identity/v3/users => generated 297 bytes in 320 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 14:41:54.875311 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfa232e-ebf3-451f-845f-5232b1b0a394 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:41:54.885690 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-bcfa232e-ebf3-451f-845f-5232b1b0a394 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:41:54.923138 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:41:54.938648 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfa232e-ebf3-451f-845f-5232b1b0a394 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:41:54.947174 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca70fe3-4103-42ee-8154-4ef1ddf6734a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:41:54.948404 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca70fe3-4103-42ee-8154-4ef1ddf6734a admin admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:41:54.948837 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca70fe3-4103-42ee-8154-4ef1ddf6734a admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:41:54.949167 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca70fe3-4103-42ee-8154-4ef1ddf6734a admin admin] PATH_INFO: `/v3/roles` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:41:54.950040 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca70fe3-4103-42ee-8154-4ef1ddf6734a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:41:54.952711 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca70fe3-4103-42ee-8154-4ef1ddf6734a admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:41:54.959864 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d4c8c3-5ca2-4425-94e8-1b7241eac761 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:41:54.961110 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d4c8c3-5ca2-4425-94e8-1b7241eac761 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:41:54.961548 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d4c8c3-5ca2-4425-94e8-1b7241eac761 admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:41:54.961912 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d4c8c3-5ca2-4425-94e8-1b7241eac761 admin admin] PATH_INFO: `/v3/users/31925b255109488697ee0abc4f0b462e` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:41:54.964264 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d4c8c3-5ca2-4425-94e8-1b7241eac761 admin admin] RBAC: Authorizing `identity:delete_user(user_id=31925b255109488697ee0abc4f0b462e)` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:41:54.983466 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 858/1708] 10.222.0.67 () {58 vars in 1121 bytes} [Wed May 25 14:41:54 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:41:54.983466 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3adf69f-a539-401e-b503-36ca5d9ac8a2 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:41:54.983466 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3adf69f-a539-401e-b503-36ca5d9ac8a2 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:41:54.983466 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3adf69f-a539-401e-b503-36ca5d9ac8a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:41:54.993709 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d4c8c3-5ca2-4425-94e8-1b7241eac761 admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:41:55.081753 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-c3adf69f-a539-401e-b503-36ca5d9ac8a2 None None] MFA Rules not processed for user `b68eed985c7b49839bcdd173186ad4ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:41:55.094341 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-c3adf69f-a539-401e-b503-36ca5d9ac8a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:41:55.213643 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-54d4c8c3-5ca2-4425-94e8-1b7241eac761 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '31925b255109488697ee0abc4f0b462e'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:41:55.215473 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-54d4c8c3-5ca2-4425-94e8-1b7241eac761 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '31925b255109488697ee0abc4f0b462e'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:41:55.222519 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-54d4c8c3-5ca2-4425-94e8-1b7241eac761 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '31925b255109488697ee0abc4f0b462e'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:41:55.287544 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-54d4c8c3-5ca2-4425-94e8-1b7241eac761 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '31925b255109488697ee0abc4f0b462e'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:41:55.315371 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-54d4c8c3-5ca2-4425-94e8-1b7241eac761 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '31925b255109488697ee0abc4f0b462e'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:41:55.318276 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 859/1709] 10.222.0.91 () {58 vars in 1015 bytes} [Wed May 25 14:41:54 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 337 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:41:55.321180 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3adf69f-a539-401e-b503-36ca5d9ac8a2 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:41:55.326011 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-c3adf69f-a539-401e-b503-36ca5d9ac8a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:41:55.356249 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 851/1710] 10.222.0.67 () {58 vars in 1223 bytes} [Wed May 25 14:41:54 2022] DELETE /identity/v3/users/31925b255109488697ee0abc4f0b462e => generated 0 bytes in 769 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:41:55.375441 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3adf69f-a539-401e-b503-36ca5d9ac8a2 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:41:55.439816 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:41:55.522624 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78c5c31-dc7c-4924-aec0-348bb0b50dc2 None None] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:41:55.522820 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78c5c31-dc7c-4924-aec0-348bb0b50dc2 None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:41:55.523148 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78c5c31-dc7c-4924-aec0-348bb0b50dc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:41:55.525975 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79f37dd-948d-4056-b8d5-0a1896e24746 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:41:55.526925 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79f37dd-948d-4056-b8d5-0a1896e24746 admin admin] REQUEST_METHOD: `PUT` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:41:55.527221 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79f37dd-948d-4056-b8d5-0a1896e24746 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:41:55.529343 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79f37dd-948d-4056-b8d5-0a1896e24746 admin admin] PATH_INFO: `/v3/projects/cfa1eba52ea445879a12351e5df5a385/users/6475e1d0a9d04d58b5032be7ec1baaea/roles/399893e19eac4ab5a8e596f7c07be13c` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:41:55.563539 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79f37dd-948d-4056-b8d5-0a1896e24746 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cfa1eba52ea445879a12351e5df5a385, user_id=6475e1d0a9d04d58b5032be7ec1baaea, role_id=399893e19eac4ab5a8e596f7c07be13c)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:41:55.567093 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79f37dd-948d-4056-b8d5-0a1896e24746 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:41:55.584252 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.auth.core [None req-c78c5c31-dc7c-4924-aec0-348bb0b50dc2 None None] MFA Rules not processed for user `54a9a5bdd9674c1f9700800609062675`. Rule list: `[]` (Enabled: `True`). {{(pid=80474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:41:55.588370 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-c78c5c31-dc7c-4924-aec0-348bb0b50dc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:41:55.601364 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 860/1711] 10.222.0.67 () {60 vars in 1482 bytes} [Wed May 25 14:41:55 2022] PUT /identity/v3/projects/cfa1eba52ea445879a12351e5df5a385/users/6475e1d0a9d04d58b5032be7ec1baaea/roles/399893e19eac4ab5a8e596f7c07be13c => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:41:55.602698 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79f37dd-948d-4056-b8d5-0a1896e24746 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:41:55.829661 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79f37dd-948d-4056-b8d5-0a1896e24746 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:41:55.832038 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 852/1712] 10.222.0.67 () {58 vars in 957 bytes} [Wed May 25 14:41:55 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 310 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:41:55.835037 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78c5c31-dc7c-4924-aec0-348bb0b50dc2 None None] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:41:55.842080 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-c78c5c31-dc7c-4924-aec0-348bb0b50dc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:41:55.852962 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d77be46-d29e-461d-9f42-6fbbece4f368 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:41:55.853799 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d77be46-d29e-461d-9f42-6fbbece4f368 admin admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:41:55.854200 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d77be46-d29e-461d-9f42-6fbbece4f368 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:41:55.854665 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d77be46-d29e-461d-9f42-6fbbece4f368 admin admin] PATH_INFO: `/v3/roles` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:41:55.855650 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d77be46-d29e-461d-9f42-6fbbece4f368 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:41:55.860824 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d77be46-d29e-461d-9f42-6fbbece4f368 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:41:55.908710 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 861/1713] 10.222.0.67 () {58 vars in 1121 bytes} [Wed May 25 14:41:55 2022] GET /identity/v3/roles => generated 1420 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 25 14:41:55.914551 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbae91f-9a7c-41ee-ad2c-27ab157a386d None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:41:55.920740 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbae91f-9a7c-41ee-ad2c-27ab157a386d None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:41:55.921205 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbae91f-9a7c-41ee-ad2c-27ab157a386d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:41:56.008322 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-6fbae91f-9a7c-41ee-ad2c-27ab157a386d None None] MFA Rules not processed for user `54a9a5bdd9674c1f9700800609062675`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:41:56.009607 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-6fbae91f-9a7c-41ee-ad2c-27ab157a386d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:41:56.051404 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 862/1714] 10.222.0.67 () {58 vars in 957 bytes} [Wed May 25 14:41:55 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:41:56.054879 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbae91f-9a7c-41ee-ad2c-27ab157a386d None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:41:56.098852 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbae91f-9a7c-41ee-ad2c-27ab157a386d None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:41:56.124778 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78c5c31-dc7c-4924-aec0-348bb0b50dc2 None None] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:41:56.136693 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0b7114-f2f8-4f61-8316-8b0e0404ee11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:41:56.143035 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0b7114-f2f8-4f61-8316-8b0e0404ee11 admin admin] REQUEST_METHOD: `PUT` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:41:56.143502 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0b7114-f2f8-4f61-8316-8b0e0404ee11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:41:56.143792 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0b7114-f2f8-4f61-8316-8b0e0404ee11 admin admin] PATH_INFO: `/v3/projects/cfa1eba52ea445879a12351e5df5a385/users/6475e1d0a9d04d58b5032be7ec1baaea/roles/399893e19eac4ab5a8e596f7c07be13c` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:41:56.155777 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedae3c6-2785-4c2f-ba0f-4c2b5b7381db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b68eed985c7b49839bcdd173186ad4ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfe93ee8d32a441295efc0b885de4bd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:41:56.157435 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedae3c6-2785-4c2f-ba0f-4c2b5b7381db service neutron] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:41:56.157435 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedae3c6-2785-4c2f-ba0f-4c2b5b7381db service neutron] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:41:56.157435 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedae3c6-2785-4c2f-ba0f-4c2b5b7381db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:41:56.157698 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0b7114-f2f8-4f61-8316-8b0e0404ee11 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cfa1eba52ea445879a12351e5df5a385, user_id=6475e1d0a9d04d58b5032be7ec1baaea, role_id=399893e19eac4ab5a8e596f7c07be13c)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:41:56.171592 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bedae3c6-2785-4c2f-ba0f-4c2b5b7381db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:41:56.173064 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bedae3c6-2785-4c2f-ba0f-4c2b5b7381db service neutron] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:41:56.176686 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0b7114-f2f8-4f61-8316-8b0e0404ee11 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:41:56.195505 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:41:56.207839 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 853/1715] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 14:41:55 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:41:56.209463 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9361cdb4-9842-48ef-9d2c-d2c5edafdaa9 None None] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:41:56.209769 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9361cdb4-9842-48ef-9d2c-d2c5edafdaa9 None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:41:56.210048 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9361cdb4-9842-48ef-9d2c-d2c5edafdaa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:41:56.245518 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 863/1716] 10.222.0.67 () {60 vars in 1482 bytes} [Wed May 25 14:41:56 2022] PUT /identity/v3/projects/cfa1eba52ea445879a12351e5df5a385/users/6475e1d0a9d04d58b5032be7ec1baaea/roles/399893e19eac4ab5a8e596f7c07be13c => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:41:56.248559 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0b7114-f2f8-4f61-8316-8b0e0404ee11 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:41:56.258582 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-5f0b7114-f2f8-4f61-8316-8b0e0404ee11 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:41:56.312945 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.auth.core [None req-9361cdb4-9842-48ef-9d2c-d2c5edafdaa9 None None] MFA Rules not processed for user `ff5a1f15e8d54a68946c8ccfdd4a3587`. Rule list: `[]` (Enabled: `True`). {{(pid=80474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:41:56.314183 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-9361cdb4-9842-48ef-9d2c-d2c5edafdaa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:41:56.486646 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0b7114-f2f8-4f61-8316-8b0e0404ee11 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:41:56.503738 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dff7fa-4fef-40bd-a1ea-84dac92131eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:41:56.505398 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dff7fa-4fef-40bd-a1ea-84dac92131eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:41:56.506124 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dff7fa-4fef-40bd-a1ea-84dac92131eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:41:56.506517 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dff7fa-4fef-40bd-a1ea-84dac92131eb admin admin] PATH_INFO: `/v3/projects/e037fb880ce34967985080820c719582` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:41:56.511347 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69dff7fa-4fef-40bd-a1ea-84dac92131eb admin admin] RBAC: Authorizing `identity:delete_project(project_id=e037fb880ce34967985080820c719582)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:41:56.513707 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69dff7fa-4fef-40bd-a1ea-84dac92131eb admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:41:56.604178 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=96,keystone:INSERT=2,keystone:DELETE=2 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:41:56.629964 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 854/1717] 10.222.0.67 () {58 vars in 957 bytes} [Wed May 25 14:41:56 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 421 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:41:56.632270 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9361cdb4-9842-48ef-9d2c-d2c5edafdaa9 None None] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:41:56.640795 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-9361cdb4-9842-48ef-9d2c-d2c5edafdaa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:41:56.643444 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-69dff7fa-4fef-40bd-a1ea-84dac92131eb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e037fb880ce34967985080820c719582', 'request_id': 'req-69dff7fa-4fef-40bd-a1ea-84dac92131eb'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:41:56.659753 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-69dff7fa-4fef-40bd-a1ea-84dac92131eb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e037fb880ce34967985080820c719582', 'request_id': 'req-69dff7fa-4fef-40bd-a1ea-84dac92131eb'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:41:56.677852 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-69dff7fa-4fef-40bd-a1ea-84dac92131eb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e037fb880ce34967985080820c719582', 'request_id': 'req-69dff7fa-4fef-40bd-a1ea-84dac92131eb'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:41:56.727227 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-69dff7fa-4fef-40bd-a1ea-84dac92131eb admin admin] The token cache is being invalidate because project e037fb880ce34967985080820c719582 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80475) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 14:41:56.727786 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-69dff7fa-4fef-40bd-a1ea-84dac92131eb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:41:56.730128 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-69dff7fa-4fef-40bd-a1ea-84dac92131eb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:41:56.739093 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 864/1718] 10.222.0.67 () {58 vars in 1232 bytes} [Wed May 25 14:41:56 2022] DELETE /identity/v3/projects/e037fb880ce34967985080820c719582 => generated 0 bytes in 489 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:41:56.740833 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd4edd8-77c7-460f-8eb4-6c79709d0c39 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:41:56.742635 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd4edd8-77c7-460f-8eb4-6c79709d0c39 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:41:56.743622 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd4edd8-77c7-460f-8eb4-6c79709d0c39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:41:56.849136 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-ebd4edd8-77c7-460f-8eb4-6c79709d0c39 None None] MFA Rules not processed for user `6475e1d0a9d04d58b5032be7ec1baaea`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:41:56.850556 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-ebd4edd8-77c7-460f-8eb4-6c79709d0c39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:41:56.971197 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9361cdb4-9842-48ef-9d2c-d2c5edafdaa9 None None] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:41:57.083895 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 865/1719] 10.222.0.67 () {58 vars in 957 bytes} [Wed May 25 14:41:56 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 344 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:41:57.091071 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f756806-b073-4c7d-a2e4-aee57cc4dfed None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:41:57.091509 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f756806-b073-4c7d-a2e4-aee57cc4dfed None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:41:57.091959 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f756806-b073-4c7d-a2e4-aee57cc4dfed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:41:57.159587 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-5f756806-b073-4c7d-a2e4-aee57cc4dfed None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:41:57.161295 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-5f756806-b073-4c7d-a2e4-aee57cc4dfed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:41:57.185528 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751e8446-3b21-4a7e-9001-887b5c74bd6c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '428ec99478284743943ed41e9d24a603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfe93ee8d32a441295efc0b885de4bd7', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:41:57.187369 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751e8446-3b21-4a7e-9001-887b5c74bd6c service nova] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:41:57.188898 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751e8446-3b21-4a7e-9001-887b5c74bd6c service nova] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:41:57.191461 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751e8446-3b21-4a7e-9001-887b5c74bd6c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:41:57.198372 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-751e8446-3b21-4a7e-9001-887b5c74bd6c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:41:57.262336 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:41:57.412694 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751e8446-3b21-4a7e-9001-887b5c74bd6c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:41:57.415007 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751e8446-3b21-4a7e-9001-887b5c74bd6c service nova] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:41:57.447434 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 855/1720] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 14:41:56 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 815 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:41:57.448515 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751e8446-3b21-4a7e-9001-887b5c74bd6c service nova] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:41:57.463281 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 866/1721] 10.222.0.67 () {58 vars in 957 bytes} [Wed May 25 14:41:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 367 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:41:57.463607 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-751e8446-3b21-4a7e-9001-887b5c74bd6c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:41:57.463682 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f756806-b073-4c7d-a2e4-aee57cc4dfed None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:41:57.468780 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-5f756806-b073-4c7d-a2e4-aee57cc4dfed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:41:57.502737 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f756806-b073-4c7d-a2e4-aee57cc4dfed None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:41:57.546772 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f208953-90b3-4a0f-9b06-f0c4a333a82e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:41:57.549762 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f208953-90b3-4a0f-9b06-f0c4a333a82e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:41:57.550127 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f208953-90b3-4a0f-9b06-f0c4a333a82e admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:41:57.552747 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f208953-90b3-4a0f-9b06-f0c4a333a82e admin admin] PATH_INFO: `/v3/projects/656fded9a2c549c2a06c9d171e9c9621` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:41:57.558484 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f208953-90b3-4a0f-9b06-f0c4a333a82e admin admin] RBAC: Authorizing `identity:delete_project(project_id=656fded9a2c549c2a06c9d171e9c9621)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:41:57.562153 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751e8446-3b21-4a7e-9001-887b5c74bd6c service nova] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:41:57.566229 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f208953-90b3-4a0f-9b06-f0c4a333a82e admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:41:57.619849 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec9d6af-4cfb-43c1-91c4-788bc9af3da7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '428ec99478284743943ed41e9d24a603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfe93ee8d32a441295efc0b885de4bd7', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:41:57.629063 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec9d6af-4cfb-43c1-91c4-788bc9af3da7 service nova] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:41:57.631502 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec9d6af-4cfb-43c1-91c4-788bc9af3da7 service nova] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:41:57.635481 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec9d6af-4cfb-43c1-91c4-788bc9af3da7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:41:57.651597 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-0ec9d6af-4cfb-43c1-91c4-788bc9af3da7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:41:57.686892 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:41:57.731501 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-6f208953-90b3-4a0f-9b06-f0c4a333a82e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '656fded9a2c549c2a06c9d171e9c9621', 'request_id': 'req-6f208953-90b3-4a0f-9b06-f0c4a333a82e'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:41:57.758706 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-6f208953-90b3-4a0f-9b06-f0c4a333a82e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '656fded9a2c549c2a06c9d171e9c9621', 'request_id': 'req-6f208953-90b3-4a0f-9b06-f0c4a333a82e'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:41:57.779045 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-6f208953-90b3-4a0f-9b06-f0c4a333a82e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '656fded9a2c549c2a06c9d171e9c9621', 'request_id': 'req-6f208953-90b3-4a0f-9b06-f0c4a333a82e'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:41:57.810251 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-6f208953-90b3-4a0f-9b06-f0c4a333a82e admin admin] The token cache is being invalidate because project 656fded9a2c549c2a06c9d171e9c9621 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80475) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 14:41:57.810847 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-6f208953-90b3-4a0f-9b06-f0c4a333a82e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:41:57.811841 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-6f208953-90b3-4a0f-9b06-f0c4a333a82e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:41:57.816698 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 867/1722] 10.222.0.67 () {58 vars in 1232 bytes} [Wed May 25 14:41:57 2022] DELETE /identity/v3/projects/656fded9a2c549c2a06c9d171e9c9621 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:41:57.818270 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f208953-90b3-4a0f-9b06-f0c4a333a82e admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:41:57.821901 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-6f208953-90b3-4a0f-9b06-f0c4a333a82e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:41:57.947897 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f208953-90b3-4a0f-9b06-f0c4a333a82e admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:41:57.971587 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6a1079-4896-4490-8bee-771effacd28b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e462acc9da84a61bb23998dd54e1858', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfe93ee8d32a441295efc0b885de4bd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:41:57.976249 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6a1079-4896-4490-8bee-771effacd28b service cinder] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:41:57.976567 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6a1079-4896-4490-8bee-771effacd28b service cinder] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:41:57.977078 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6a1079-4896-4490-8bee-771effacd28b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:41:57.985031 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-4d6a1079-4896-4490-8bee-771effacd28b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:41:58.002552 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec9d6af-4cfb-43c1-91c4-788bc9af3da7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:41:58.004220 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec9d6af-4cfb-43c1-91c4-788bc9af3da7 service nova] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:41:58.036993 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 856/1723] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 14:41:57 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 589 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:41:58.038338 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a281bbea-3144-4932-8a62-2bef919fb643 None None] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:41:58.038630 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a281bbea-3144-4932-8a62-2bef919fb643 None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:41:58.048254 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a281bbea-3144-4932-8a62-2bef919fb643 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:41:58.108856 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.auth.core [None req-a281bbea-3144-4932-8a62-2bef919fb643 None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:41:58.110089 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-a281bbea-3144-4932-8a62-2bef919fb643 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:41:58.326960 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6a1079-4896-4490-8bee-771effacd28b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:41:58.328502 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6a1079-4896-4490-8bee-771effacd28b service cinder] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:41:58.376151 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 857/1724] 10.222.0.67 () {58 vars in 957 bytes} [Wed May 25 14:41:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 339 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:41:58.378041 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e94fa4-3dc5-4f99-88b5-db24f64c5a25 None None] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:41:58.378330 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e94fa4-3dc5-4f99-88b5-db24f64c5a25 None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:41:58.378609 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e94fa4-3dc5-4f99-88b5-db24f64c5a25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:41:58.428272 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 868/1725] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 14:41:57 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 608 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:41:58.435257 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6a1079-4896-4490-8bee-771effacd28b service cinder] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:41:58.472994 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.auth.core [None req-e2e94fa4-3dc5-4f99-88b5-db24f64c5a25 None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:41:58.479750 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-e2e94fa4-3dc5-4f99-88b5-db24f64c5a25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:41:58.485054 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6a1079-4896-4490-8bee-771effacd28b service cinder] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:41:58.506287 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98216a9-aa2f-44f7-8003-ee6c3f742c2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:41:58.508037 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98216a9-aa2f-44f7-8003-ee6c3f742c2e admin admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:41:58.508608 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98216a9-aa2f-44f7-8003-ee6c3f742c2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:41:58.509103 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98216a9-aa2f-44f7-8003-ee6c3f742c2e admin admin] PATH_INFO: `/v3/domains` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:41:58.510137 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98216a9-aa2f-44f7-8003-ee6c3f742c2e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:41:58.510765 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98216a9-aa2f-44f7-8003-ee6c3f742c2e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:41:58.513041 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98216a9-aa2f-44f7-8003-ee6c3f742c2e admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:41:58.533726 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 858/1726] 10.222.0.67 () {58 vars in 957 bytes} [Wed May 25 14:41:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:41:58.541053 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9aba2c-6fd0-4592-8e2f-4d5cfba17568 None None] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:41:58.543528 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9aba2c-6fd0-4592-8e2f-4d5cfba17568 None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:41:58.543845 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9aba2c-6fd0-4592-8e2f-4d5cfba17568 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:41:58.546938 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 869/1727] 10.222.0.67 () {58 vars in 1152 bytes} [Wed May 25 14:41:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:41:58.554655 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98216a9-aa2f-44f7-8003-ee6c3f742c2e admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:41:58.600633 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98216a9-aa2f-44f7-8003-ee6c3f742c2e admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:41:58.620617 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a55433-5cd9-41df-9472-7146d45cd8d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:41:58.623756 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a55433-5cd9-41df-9472-7146d45cd8d2 admin admin] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:41:58.629067 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a55433-5cd9-41df-9472-7146d45cd8d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:41:58.629504 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a55433-5cd9-41df-9472-7146d45cd8d2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:41:58.631216 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a55433-5cd9-41df-9472-7146d45cd8d2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:41:58.635242 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a55433-5cd9-41df-9472-7146d45cd8d2 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:41:58.645698 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.auth.core [None req-2b9aba2c-6fd0-4592-8e2f-4d5cfba17568 None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:41:58.648739 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-2b9aba2c-6fd0-4592-8e2f-4d5cfba17568 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:41:58.702721 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 859/1728] 10.222.0.67 () {58 vars in 957 bytes} [Wed May 25 14:41:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:41:58.723633 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9aba2c-6fd0-4592-8e2f-4d5cfba17568 None None] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:41:58.771195 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 870/1729] 10.222.0.67 () {60 vars in 1152 bytes} [Wed May 25 14:41:58 2022] POST /identity/v3/projects => generated 357 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:41:58.772461 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9aba2c-6fd0-4592-8e2f-4d5cfba17568 None None] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:41:58.773177 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a55433-5cd9-41df-9472-7146d45cd8d2 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:41:59.008825 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:41:59.036166 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:41:59.101967 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a55433-5cd9-41df-9472-7146d45cd8d2 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:41:59.109549 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc52df3-2248-43bc-a23e-f5feedb6aebb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:41:59.110251 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc52df3-2248-43bc-a23e-f5feedb6aebb admin admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:41:59.110545 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc52df3-2248-43bc-a23e-f5feedb6aebb admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:41:59.110830 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc52df3-2248-43bc-a23e-f5feedb6aebb admin admin] PATH_INFO: `/v3/domains` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:41:59.112274 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc52df3-2248-43bc-a23e-f5feedb6aebb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:41:59.112694 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc52df3-2248-43bc-a23e-f5feedb6aebb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:41:59.127539 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc52df3-2248-43bc-a23e-f5feedb6aebb admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:41:59.129470 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581d7bac-d738-454d-b1f0-65c34e6fbd88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:41:59.130302 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581d7bac-d738-454d-b1f0-65c34e6fbd88 admin admin] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:41:59.131021 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581d7bac-d738-454d-b1f0-65c34e6fbd88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:41:59.131379 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581d7bac-d738-454d-b1f0-65c34e6fbd88 admin admin] PATH_INFO: `/v3/users` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:41:59.132269 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581d7bac-d738-454d-b1f0-65c34e6fbd88 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:41:59.137547 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581d7bac-d738-454d-b1f0-65c34e6fbd88 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:41:59.195894 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 860/1730] 10.222.0.67 () {58 vars in 1152 bytes} [Wed May 25 14:41:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 470 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:41:59.197657 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc52df3-2248-43bc-a23e-f5feedb6aebb admin admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:41:59.203914 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 871/1731] 10.222.0.67 () {60 vars in 1143 bytes} [Wed May 25 14:41:58 2022] POST /identity/v3/users => generated 279 bytes in 432 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:41:59.205204 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581d7bac-d738-454d-b1f0-65c34e6fbd88 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:41:59.225002 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc52df3-2248-43bc-a23e-f5feedb6aebb admin admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:41:59.259185 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581d7bac-d738-454d-b1f0-65c34e6fbd88 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:41:59.259912 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b489ac-27fa-465e-98b4-5ed81815cff9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:41:59.260302 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b489ac-27fa-465e-98b4-5ed81815cff9 admin admin] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:41:59.260592 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b489ac-27fa-465e-98b4-5ed81815cff9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:41:59.260873 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b489ac-27fa-465e-98b4-5ed81815cff9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:41:59.261612 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b489ac-27fa-465e-98b4-5ed81815cff9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:41:59.264067 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b489ac-27fa-465e-98b4-5ed81815cff9 admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:41:59.284557 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4767db-3027-4f1f-b3c8-64d81f4f15ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:41:59.288772 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4767db-3027-4f1f-b3c8-64d81f4f15ff admin admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:41:59.290540 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4767db-3027-4f1f-b3c8-64d81f4f15ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:41:59.290540 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4767db-3027-4f1f-b3c8-64d81f4f15ff admin admin] PATH_INFO: `/v3/roles` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:41:59.295351 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4767db-3027-4f1f-b3c8-64d81f4f15ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:41:59.297949 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4767db-3027-4f1f-b3c8-64d81f4f15ff admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:41:59.343574 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 872/1732] 10.222.0.67 () {58 vars in 1121 bytes} [Wed May 25 14:41:59 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:41:59.345759 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4767db-3027-4f1f-b3c8-64d81f4f15ff admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:41:59.364343 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 861/1733] 10.222.0.67 () {60 vars in 1152 bytes} [Wed May 25 14:41:59 2022] POST /identity/v3/projects => generated 369 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 14:41:59.370303 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b489ac-27fa-465e-98b4-5ed81815cff9 admin admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:41:59.380882 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4767db-3027-4f1f-b3c8-64d81f4f15ff admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:41:59.571739 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b489ac-27fa-465e-98b4-5ed81815cff9 admin admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:41:59.597057 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae6bd08-2152-4b79-863d-8d7a0d9f8039 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:41:59.597760 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae6bd08-2152-4b79-863d-8d7a0d9f8039 admin admin] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:41:59.598045 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae6bd08-2152-4b79-863d-8d7a0d9f8039 admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:41:59.598341 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae6bd08-2152-4b79-863d-8d7a0d9f8039 admin admin] PATH_INFO: `/v3/users` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:41:59.599067 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae6bd08-2152-4b79-863d-8d7a0d9f8039 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:41:59.601091 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae6bd08-2152-4b79-863d-8d7a0d9f8039 admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:41:59.605613 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b41ebe9-db55-4358-8015-ec9c2351bda2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:41:59.614177 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b41ebe9-db55-4358-8015-ec9c2351bda2 admin admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:41:59.614768 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b41ebe9-db55-4358-8015-ec9c2351bda2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:41:59.615221 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b41ebe9-db55-4358-8015-ec9c2351bda2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:41:59.616273 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b41ebe9-db55-4358-8015-ec9c2351bda2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:41:59.621452 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b41ebe9-db55-4358-8015-ec9c2351bda2 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:41:59.646854 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 873/1734] 10.222.0.67 () {58 vars in 1121 bytes} [Wed May 25 14:41:59 2022] GET /identity/v3/roles => generated 1420 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:41:59.652319 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b41ebe9-db55-4358-8015-ec9c2351bda2 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:41:59.694982 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 862/1735] 10.222.0.67 () {60 vars in 1143 bytes} [Wed May 25 14:41:59 2022] POST /identity/v3/users => generated 285 bytes in 326 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:41:59.696374 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556f393e-1310-4dfd-a254-5a2620753a9c None None] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:41:59.696671 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556f393e-1310-4dfd-a254-5a2620753a9c None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:41:59.696950 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556f393e-1310-4dfd-a254-5a2620753a9c None None] PATH_INFO: `/` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:41:59.698338 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 863/1736] 10.222.0.67 () {54 vars in 912 bytes} [Wed May 25 14:41:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:41:59.699279 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79790fa-ea9c-4f63-b05d-561e20622106 None None] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:41:59.699565 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79790fa-ea9c-4f63-b05d-561e20622106 None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:41:59.699842 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79790fa-ea9c-4f63-b05d-561e20622106 None None] PATH_INFO: `/` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:41:59.701053 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 864/1737] 10.222.0.67 () {54 vars in 921 bytes} [Wed May 25 14:41:59 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:41:59.701731 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79790fa-ea9c-4f63-b05d-561e20622106 None None] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:41:59.758175 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79790fa-ea9c-4f63-b05d-561e20622106 None None] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:41:59.774559 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd01337a-259a-4c21-b70c-d48fd773e532 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:41:59.775495 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd01337a-259a-4c21-b70c-d48fd773e532 admin admin] REQUEST_METHOD: `PUT` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:41:59.775836 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd01337a-259a-4c21-b70c-d48fd773e532 admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:41:59.776045 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd01337a-259a-4c21-b70c-d48fd773e532 admin admin] PATH_INFO: `/v3/projects/71d0095a97aa4e60ab22cdb3b8aafea2/users/59e6d46dc0ea4252bd48165b5b5bd67f/roles/48808901834b4d5eab2c7e6b5b03791e` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:41:59.811935 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd01337a-259a-4c21-b70c-d48fd773e532 admin admin] RBAC: Authorizing `identity:create_grant(project_id=71d0095a97aa4e60ab22cdb3b8aafea2, user_id=59e6d46dc0ea4252bd48165b5b5bd67f, role_id=48808901834b4d5eab2c7e6b5b03791e)` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:41:59.820712 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd01337a-259a-4c21-b70c-d48fd773e532 admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:41:59.852169 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b41ebe9-db55-4358-8015-ec9c2351bda2 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:41:59.872846 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 865/1738] 10.222.0.67 () {60 vars in 1482 bytes} [Wed May 25 14:41:59 2022] PUT /identity/v3/projects/71d0095a97aa4e60ab22cdb3b8aafea2/users/59e6d46dc0ea4252bd48165b5b5bd67f/roles/48808901834b4d5eab2c7e6b5b03791e => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:41:59.873697 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd01337a-259a-4c21-b70c-d48fd773e532 admin admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:00.084400 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec92fbe-ceb0-4c2a-bf4e-e79fbd11897e tempest-VolumeQuotaClassesTest-1732777512 tempest-VolumeQuotaClassesTest-1732777512-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6475e1d0a9d04d58b5032be7ec1baaea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa1eba52ea445879a12351e5df5a385', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:00.085176 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec92fbe-ceb0-4c2a-bf4e-e79fbd11897e tempest-VolumeQuotaClassesTest-1732777512 tempest-VolumeQuotaClassesTest-1732777512-project-admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:00.085575 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec92fbe-ceb0-4c2a-bf4e-e79fbd11897e tempest-VolumeQuotaClassesTest-1732777512 tempest-VolumeQuotaClassesTest-1732777512-project-admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:00.085963 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec92fbe-ceb0-4c2a-bf4e-e79fbd11897e tempest-VolumeQuotaClassesTest-1732777512 tempest-VolumeQuotaClassesTest-1732777512-project-admin] PATH_INFO: `/v3/domains` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:00.086816 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec92fbe-ceb0-4c2a-bf4e-e79fbd11897e tempest-VolumeQuotaClassesTest-1732777512 tempest-VolumeQuotaClassesTest-1732777512-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:42:00.087265 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec92fbe-ceb0-4c2a-bf4e-e79fbd11897e tempest-VolumeQuotaClassesTest-1732777512 tempest-VolumeQuotaClassesTest-1732777512-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:00.089092 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec92fbe-ceb0-4c2a-bf4e-e79fbd11897e tempest-VolumeQuotaClassesTest-1732777512 tempest-VolumeQuotaClassesTest-1732777512-project-admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:00.094094 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:00.123915 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 874/1739] 10.222.0.67 () {58 vars in 1152 bytes} [Wed May 25 14:41:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 472 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:42:00.125560 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb89984-ae0e-4dc2-85a3-84e2160b9561 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:00.125960 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb89984-ae0e-4dc2-85a3-84e2160b9561 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:00.126338 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb89984-ae0e-4dc2-85a3-84e2160b9561 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:00.183931 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd01337a-259a-4c21-b70c-d48fd773e532 admin admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:00.188717 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-4eb89984-ae0e-4dc2-85a3-84e2160b9561 None None] MFA Rules not processed for user `b68eed985c7b49839bcdd173186ad4ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:42:00.190267 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-4eb89984-ae0e-4dc2-85a3-84e2160b9561 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:42:00.213468 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e335ef0-d9ab-4df1-973f-67ab00bdc38a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:00.218354 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e335ef0-d9ab-4df1-973f-67ab00bdc38a admin admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:00.218653 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e335ef0-d9ab-4df1-973f-67ab00bdc38a admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:00.218940 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e335ef0-d9ab-4df1-973f-67ab00bdc38a admin admin] PATH_INFO: `/v3/roles` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:00.219747 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e335ef0-d9ab-4df1-973f-67ab00bdc38a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:00.227605 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e335ef0-d9ab-4df1-973f-67ab00bdc38a admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:00.250022 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 866/1740] 10.222.0.67 () {58 vars in 1121 bytes} [Wed May 25 14:41:59 2022] GET /identity/v3/roles => generated 1420 bytes in 377 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:42:00.253230 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee73f0e3-2c0a-43aa-a737-c059618839fe None None] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:00.253670 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee73f0e3-2c0a-43aa-a737-c059618839fe None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:00.254318 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee73f0e3-2c0a-43aa-a737-c059618839fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:00.282166 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.auth.core [None req-ee73f0e3-2c0a-43aa-a737-c059618839fe None None] MFA Rules not processed for user `428ec99478284743943ed41e9d24a603`. Rule list: `[]` (Enabled: `True`). {{(pid=80474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:42:00.294853 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-ee73f0e3-2c0a-43aa-a737-c059618839fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:42:00.320734 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:00.395861 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 875/1741] 10.222.0.67 () {58 vars in 1009 bytes} [Wed May 25 14:42:00 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:42:00.397246 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6209df12-c0b7-4da5-9268-fc610e7e8e20 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:00.397541 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6209df12-c0b7-4da5-9268-fc610e7e8e20 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:00.397832 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6209df12-c0b7-4da5-9268-fc610e7e8e20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:00.461232 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 867/1742] 10.222.0.67 () {58 vars in 1018 bytes} [Wed May 25 14:42:00 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:42:00.471508 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee73f0e3-2c0a-43aa-a737-c059618839fe None None] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:00.495748 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-6209df12-c0b7-4da5-9268-fc610e7e8e20 None None] MFA Rules not processed for user `59e6d46dc0ea4252bd48165b5b5bd67f`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:42:00.505024 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee73f0e3-2c0a-43aa-a737-c059618839fe None None] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:00.509819 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-6209df12-c0b7-4da5-9268-fc610e7e8e20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:42:00.520130 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36948d93-d153-466f-9e02-8f623f9b9db4 tempest-VolumeQuotaClassesTest-1732777512 tempest-VolumeQuotaClassesTest-1732777512-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6475e1d0a9d04d58b5032be7ec1baaea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa1eba52ea445879a12351e5df5a385', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:00.522922 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36948d93-d153-466f-9e02-8f623f9b9db4 tempest-VolumeQuotaClassesTest-1732777512 tempest-VolumeQuotaClassesTest-1732777512-project-admin] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:00.523270 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36948d93-d153-466f-9e02-8f623f9b9db4 tempest-VolumeQuotaClassesTest-1732777512 tempest-VolumeQuotaClassesTest-1732777512-project-admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:00.523651 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36948d93-d153-466f-9e02-8f623f9b9db4 tempest-VolumeQuotaClassesTest-1732777512 tempest-VolumeQuotaClassesTest-1732777512-project-admin] PATH_INFO: `/v3/projects` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:00.526035 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36948d93-d153-466f-9e02-8f623f9b9db4 tempest-VolumeQuotaClassesTest-1732777512 tempest-VolumeQuotaClassesTest-1732777512-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:00.535231 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36948d93-d153-466f-9e02-8f623f9b9db4 tempest-VolumeQuotaClassesTest-1732777512 tempest-VolumeQuotaClassesTest-1732777512-project-admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:00.601384 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 868/1743] 10.222.0.67 () {60 vars in 1152 bytes} [Wed May 25 14:42:00 2022] POST /identity/v3/projects => generated 353 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:42:00.601384 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36948d93-d153-466f-9e02-8f623f9b9db4 tempest-VolumeQuotaClassesTest-1732777512 tempest-VolumeQuotaClassesTest-1732777512-project-admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:00.732732 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 876/1744] 10.222.0.67 () {58 vars in 957 bytes} [Wed May 25 14:42:00 2022] POST /identity/v3/auth/tokens => generated 3224 bytes in 336 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:42:00.744961 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6209df12-c0b7-4da5-9268-fc610e7e8e20 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:00.754154 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-6209df12-c0b7-4da5-9268-fc610e7e8e20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:42:00.771386 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6209df12-c0b7-4da5-9268-fc610e7e8e20 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:00.797345 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36948d93-d153-466f-9e02-8f623f9b9db4 tempest-VolumeQuotaClassesTest-1732777512 tempest-VolumeQuotaClassesTest-1732777512-project-admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:00.810375 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd579fc0-1949-4dd2-b741-fd39f70a0d4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:00.811105 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd579fc0-1949-4dd2-b741-fd39f70a0d4c admin admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:00.811475 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd579fc0-1949-4dd2-b741-fd39f70a0d4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:00.811677 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd579fc0-1949-4dd2-b741-fd39f70a0d4c admin admin] PATH_INFO: `/v3/roles` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:00.812448 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd579fc0-1949-4dd2-b741-fd39f70a0d4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:00.814054 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd579fc0-1949-4dd2-b741-fd39f70a0d4c admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:00.850906 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 869/1745] 10.222.0.67 () {58 vars in 1121 bytes} [Wed May 25 14:42:00 2022] GET /identity/v3/roles => generated 1420 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:42:00.851900 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd579fc0-1949-4dd2-b741-fd39f70a0d4c admin admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:00.884663 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a19a0b4-6863-4eea-a56e-0db5b3fe8710 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b68eed985c7b49839bcdd173186ad4ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfe93ee8d32a441295efc0b885de4bd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:00.885575 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a19a0b4-6863-4eea-a56e-0db5b3fe8710 service neutron] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:00.885941 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a19a0b4-6863-4eea-a56e-0db5b3fe8710 service neutron] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:00.886574 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a19a0b4-6863-4eea-a56e-0db5b3fe8710 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:00.897975 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a19a0b4-6863-4eea-a56e-0db5b3fe8710 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:00.899594 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a19a0b4-6863-4eea-a56e-0db5b3fe8710 service neutron] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:00.912712 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 877/1746] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 14:42:00 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:42:00.913694 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a19a0b4-6863-4eea-a56e-0db5b3fe8710 service neutron] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:00.964959 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a19a0b4-6863-4eea-a56e-0db5b3fe8710 service neutron] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:00.977350 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9c34b8-b642-4194-b954-1ef1e903f99d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:00.985238 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9c34b8-b642-4194-b954-1ef1e903f99d admin admin] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:00.986962 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9c34b8-b642-4194-b954-1ef1e903f99d admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:00.988656 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9c34b8-b642-4194-b954-1ef1e903f99d admin admin] PATH_INFO: `/v3/projects` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:00.990002 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9c34b8-b642-4194-b954-1ef1e903f99d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:00.995353 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9c34b8-b642-4194-b954-1ef1e903f99d admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:01.079465 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 878/1747] 10.222.0.67 () {60 vars in 1152 bytes} [Wed May 25 14:42:00 2022] POST /identity/v3/projects => generated 355 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:42:01.081482 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9c34b8-b642-4194-b954-1ef1e903f99d admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:01.130479 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd579fc0-1949-4dd2-b741-fd39f70a0d4c admin admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:01.144333 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:01.275073 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:01.317717 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9c34b8-b642-4194-b954-1ef1e903f99d admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:01.329442 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab495717-3496-4b9e-8f5f-13fb13ec482e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:01.331150 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab495717-3496-4b9e-8f5f-13fb13ec482e admin admin] REQUEST_METHOD: `PUT` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:01.331519 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab495717-3496-4b9e-8f5f-13fb13ec482e admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:01.331691 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab495717-3496-4b9e-8f5f-13fb13ec482e admin admin] PATH_INFO: `/v3/projects/390d458d9bf645f5bd727c1ec9d7ff62/users/b246c7326caf4a368fa6fda35e4a97cd/roles/48808901834b4d5eab2c7e6b5b03791e` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:01.356562 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee22fa1-0662-449f-bd16-f88f05335de3 tempest-VolumeQuotaClassesTest-1732777512 tempest-VolumeQuotaClassesTest-1732777512-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6475e1d0a9d04d58b5032be7ec1baaea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa1eba52ea445879a12351e5df5a385', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:01.357253 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee22fa1-0662-449f-bd16-f88f05335de3 tempest-VolumeQuotaClassesTest-1732777512 tempest-VolumeQuotaClassesTest-1732777512-project-admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:01.358064 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee22fa1-0662-449f-bd16-f88f05335de3 tempest-VolumeQuotaClassesTest-1732777512 tempest-VolumeQuotaClassesTest-1732777512-project-admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:01.358318 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee22fa1-0662-449f-bd16-f88f05335de3 tempest-VolumeQuotaClassesTest-1732777512 tempest-VolumeQuotaClassesTest-1732777512-project-admin] PATH_INFO: `/v3/domains` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:01.359777 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee22fa1-0662-449f-bd16-f88f05335de3 tempest-VolumeQuotaClassesTest-1732777512 tempest-VolumeQuotaClassesTest-1732777512-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:42:01.360901 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee22fa1-0662-449f-bd16-f88f05335de3 tempest-VolumeQuotaClassesTest-1732777512 tempest-VolumeQuotaClassesTest-1732777512-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:01.364796 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee22fa1-0662-449f-bd16-f88f05335de3 tempest-VolumeQuotaClassesTest-1732777512 tempest-VolumeQuotaClassesTest-1732777512-project-admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:01.380132 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab495717-3496-4b9e-8f5f-13fb13ec482e admin admin] RBAC: Authorizing `identity:create_grant(project_id=390d458d9bf645f5bd727c1ec9d7ff62, user_id=b246c7326caf4a368fa6fda35e4a97cd, role_id=48808901834b4d5eab2c7e6b5b03791e)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:01.390291 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab495717-3496-4b9e-8f5f-13fb13ec482e admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:01.414503 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 870/1748] 10.222.0.67 () {58 vars in 1152 bytes} [Wed May 25 14:42:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 563 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:42:01.415582 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee22fa1-0662-449f-bd16-f88f05335de3 tempest-VolumeQuotaClassesTest-1732777512 tempest-VolumeQuotaClassesTest-1732777512-project-admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:01.423172 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-aee22fa1-0662-449f-bd16-f88f05335de3 tempest-VolumeQuotaClassesTest-1732777512 tempest-VolumeQuotaClassesTest-1732777512-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:42:01.438479 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 879/1749] 10.222.0.67 () {60 vars in 1482 bytes} [Wed May 25 14:42:01 2022] PUT /identity/v3/projects/390d458d9bf645f5bd727c1ec9d7ff62/users/b246c7326caf4a368fa6fda35e4a97cd/roles/48808901834b4d5eab2c7e6b5b03791e => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:42:01.447923 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab495717-3496-4b9e-8f5f-13fb13ec482e admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:01.714734 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab495717-3496-4b9e-8f5f-13fb13ec482e admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:01.728399 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fd4e38-5fa0-4bc6-8a4b-0574b0395be1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:01.729109 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fd4e38-5fa0-4bc6-8a4b-0574b0395be1 admin admin] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:01.729400 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fd4e38-5fa0-4bc6-8a4b-0574b0395be1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:01.729705 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fd4e38-5fa0-4bc6-8a4b-0574b0395be1 admin admin] PATH_INFO: `/v3/users` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:01.730729 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fd4e38-5fa0-4bc6-8a4b-0574b0395be1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:01.743293 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fd4e38-5fa0-4bc6-8a4b-0574b0395be1 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:01.772404 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee22fa1-0662-449f-bd16-f88f05335de3 tempest-VolumeQuotaClassesTest-1732777512 tempest-VolumeQuotaClassesTest-1732777512-project-admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:01.803729 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 880/1750] 10.222.0.67 () {60 vars in 1143 bytes} [Wed May 25 14:42:01 2022] POST /identity/v3/users => generated 284 bytes in 365 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:42:01.807117 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e68be2a-d396-4894-a6df-2f723745b5d8 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:01.810432 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e68be2a-d396-4894-a6df-2f723745b5d8 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:01.812532 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e68be2a-d396-4894-a6df-2f723745b5d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:01.901599 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-2e68be2a-d396-4894-a6df-2f723745b5d8 None None] MFA Rules not processed for user `b246c7326caf4a368fa6fda35e4a97cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:42:01.904701 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-2e68be2a-d396-4894-a6df-2f723745b5d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:42:01.979027 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4601c35d-7762-41b3-a8c2-4137759227bb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '428ec99478284743943ed41e9d24a603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfe93ee8d32a441295efc0b885de4bd7', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:01.980117 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4601c35d-7762-41b3-a8c2-4137759227bb service nova] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:01.981963 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4601c35d-7762-41b3-a8c2-4137759227bb service nova] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:01.982353 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4601c35d-7762-41b3-a8c2-4137759227bb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:02.019895 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4601c35d-7762-41b3-a8c2-4137759227bb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:02.026070 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4601c35d-7762-41b3-a8c2-4137759227bb service nova] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:02.047948 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 871/1751] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 14:42:01 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 633 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:42:02.049918 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4601c35d-7762-41b3-a8c2-4137759227bb service nova] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:02.074610 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 881/1752] 10.222.0.67 () {58 vars in 957 bytes} [Wed May 25 14:42:01 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:42:02.092054 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e68be2a-d396-4894-a6df-2f723745b5d8 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:02.128175 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e68be2a-d396-4894-a6df-2f723745b5d8 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:02.137220 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd87ab2-ef6b-455b-b408-9e4dc46583b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:02.137926 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd87ab2-ef6b-455b-b408-9e4dc46583b5 admin admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:02.138201 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd87ab2-ef6b-455b-b408-9e4dc46583b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:02.138487 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd87ab2-ef6b-455b-b408-9e4dc46583b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:02.140036 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd87ab2-ef6b-455b-b408-9e4dc46583b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:02.144600 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd87ab2-ef6b-455b-b408-9e4dc46583b5 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:02.172171 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 882/1753] 10.222.0.67 () {58 vars in 1121 bytes} [Wed May 25 14:42:02 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:42:02.175902 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd87ab2-ef6b-455b-b408-9e4dc46583b5 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:02.195212 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:02.210184 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd87ab2-ef6b-455b-b408-9e4dc46583b5 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:02.232193 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4601c35d-7762-41b3-a8c2-4137759227bb service nova] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:02.235946 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db110a8-d7ec-4f6a-845f-eb61d384d76f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:02.238627 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db110a8-d7ec-4f6a-845f-eb61d384d76f admin admin] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:02.240041 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db110a8-d7ec-4f6a-845f-eb61d384d76f admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:02.241437 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db110a8-d7ec-4f6a-845f-eb61d384d76f admin admin] PATH_INFO: `/v3/projects` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:02.243555 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db110a8-d7ec-4f6a-845f-eb61d384d76f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:02.253402 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db110a8-d7ec-4f6a-845f-eb61d384d76f admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:02.256456 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f304ae-d73e-493e-af6c-670f6f01175b tempest-VolumeQuotaClassesTest-1732777512 tempest-VolumeQuotaClassesTest-1732777512-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6475e1d0a9d04d58b5032be7ec1baaea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfa1eba52ea445879a12351e5df5a385', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:02.257354 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f304ae-d73e-493e-af6c-670f6f01175b tempest-VolumeQuotaClassesTest-1732777512 tempest-VolumeQuotaClassesTest-1732777512-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:02.257646 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f304ae-d73e-493e-af6c-670f6f01175b tempest-VolumeQuotaClassesTest-1732777512 tempest-VolumeQuotaClassesTest-1732777512-project-admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:02.257927 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f304ae-d73e-493e-af6c-670f6f01175b tempest-VolumeQuotaClassesTest-1732777512 tempest-VolumeQuotaClassesTest-1732777512-project-admin] PATH_INFO: `/v3/projects/817b5f75d2ef4964bbfbf041c4639f85` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:02.266975 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f304ae-d73e-493e-af6c-670f6f01175b tempest-VolumeQuotaClassesTest-1732777512 tempest-VolumeQuotaClassesTest-1732777512-project-admin] RBAC: Authorizing `identity:delete_project(project_id=817b5f75d2ef4964bbfbf041c4639f85)` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:02.267810 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:02.275556 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f304ae-d73e-493e-af6c-670f6f01175b tempest-VolumeQuotaClassesTest-1732777512 tempest-VolumeQuotaClassesTest-1732777512-project-admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:02.323421 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 883/1754] 10.222.0.67 () {60 vars in 1152 bytes} [Wed May 25 14:42:02 2022] POST /identity/v3/projects => generated 369 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:42:02.327563 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db110a8-d7ec-4f6a-845f-eb61d384d76f admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:02.556705 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-77f304ae-d73e-493e-af6c-670f6f01175b tempest-VolumeQuotaClassesTest-1732777512 tempest-VolumeQuotaClassesTest-1732777512-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '817b5f75d2ef4964bbfbf041c4639f85', 'request_id': 'req-77f304ae-d73e-493e-af6c-670f6f01175b'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:42:02.569867 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-77f304ae-d73e-493e-af6c-670f6f01175b tempest-VolumeQuotaClassesTest-1732777512 tempest-VolumeQuotaClassesTest-1732777512-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '817b5f75d2ef4964bbfbf041c4639f85', 'request_id': 'req-77f304ae-d73e-493e-af6c-670f6f01175b'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:42:02.593269 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db110a8-d7ec-4f6a-845f-eb61d384d76f admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:02.606377 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-77f304ae-d73e-493e-af6c-670f6f01175b tempest-VolumeQuotaClassesTest-1732777512 tempest-VolumeQuotaClassesTest-1732777512-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '817b5f75d2ef4964bbfbf041c4639f85', 'request_id': 'req-77f304ae-d73e-493e-af6c-670f6f01175b'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:42:02.659477 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-77f304ae-d73e-493e-af6c-670f6f01175b tempest-VolumeQuotaClassesTest-1732777512 tempest-VolumeQuotaClassesTest-1732777512-project-admin] The token cache is being invalidate because project 817b5f75d2ef4964bbfbf041c4639f85 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80474) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 14:42:02.661870 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-77f304ae-d73e-493e-af6c-670f6f01175b tempest-VolumeQuotaClassesTest-1732777512 tempest-VolumeQuotaClassesTest-1732777512-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:42:02.663323 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-77f304ae-d73e-493e-af6c-670f6f01175b tempest-VolumeQuotaClassesTest-1732777512 tempest-VolumeQuotaClassesTest-1732777512-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:42:02.670043 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 872/1755] 10.222.0.67 () {58 vars in 1232 bytes} [Wed May 25 14:42:02 2022] DELETE /identity/v3/projects/817b5f75d2ef4964bbfbf041c4639f85 => generated 0 bytes in 621 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:42:02.672709 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f304ae-d73e-493e-af6c-670f6f01175b tempest-VolumeQuotaClassesTest-1732777512 tempest-VolumeQuotaClassesTest-1732777512-project-admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:02.676736 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-77f304ae-d73e-493e-af6c-670f6f01175b tempest-VolumeQuotaClassesTest-1732777512 tempest-VolumeQuotaClassesTest-1732777512-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:42:02.803824 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6f9874-1b3e-406c-b94d-bb2d13d81329 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:02.804739 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6f9874-1b3e-406c-b94d-bb2d13d81329 admin admin] REQUEST_METHOD: `PUT` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:02.805028 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6f9874-1b3e-406c-b94d-bb2d13d81329 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:02.805362 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6f9874-1b3e-406c-b94d-bb2d13d81329 admin admin] PATH_INFO: `/v3/projects/6a7290c3c32f44d780a893b05a212581/users/d97678a2822e40e880a0856df832b4b9/roles/399893e19eac4ab5a8e596f7c07be13c` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:02.856285 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6f9874-1b3e-406c-b94d-bb2d13d81329 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a7290c3c32f44d780a893b05a212581, user_id=d97678a2822e40e880a0856df832b4b9, role_id=399893e19eac4ab5a8e596f7c07be13c)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:02.859117 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6f9874-1b3e-406c-b94d-bb2d13d81329 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:02.892199 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 884/1756] 10.222.0.67 () {60 vars in 1482 bytes} [Wed May 25 14:42:02 2022] PUT /identity/v3/projects/6a7290c3c32f44d780a893b05a212581/users/d97678a2822e40e880a0856df832b4b9/roles/399893e19eac4ab5a8e596f7c07be13c => generated 0 bytes in 568 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:42:02.897469 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6f9874-1b3e-406c-b94d-bb2d13d81329 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:02.900724 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-6f6f9874-1b3e-406c-b94d-bb2d13d81329 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:42:02.956559 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f304ae-d73e-493e-af6c-670f6f01175b tempest-VolumeQuotaClassesTest-1732777512 tempest-VolumeQuotaClassesTest-1732777512-project-admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:03.173184 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6f9874-1b3e-406c-b94d-bb2d13d81329 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:03.186744 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e6ff46-0b76-4f59-9790-69c972d677e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:03.187738 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e6ff46-0b76-4f59-9790-69c972d677e2 admin admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:03.187738 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e6ff46-0b76-4f59-9790-69c972d677e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:03.188099 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e6ff46-0b76-4f59-9790-69c972d677e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:03.188543 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e6ff46-0b76-4f59-9790-69c972d677e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:03.191416 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e6ff46-0b76-4f59-9790-69c972d677e2 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:03.246129 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 885/1757] 10.222.0.67 () {58 vars in 1121 bytes} [Wed May 25 14:42:02 2022] GET /identity/v3/roles => generated 1420 bytes in 350 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:42:03.246908 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e6ff46-0b76-4f59-9790-69c972d677e2 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:03.253120 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b800fd-be08-41bf-b779-ad4bbc498df0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:03.270385 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b800fd-be08-41bf-b779-ad4bbc498df0 admin admin] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:03.271803 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b800fd-be08-41bf-b779-ad4bbc498df0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:03.272423 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b800fd-be08-41bf-b779-ad4bbc498df0 admin admin] PATH_INFO: `/v3/users` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:03.273304 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b800fd-be08-41bf-b779-ad4bbc498df0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:03.275459 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b800fd-be08-41bf-b779-ad4bbc498df0 admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:03.284798 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e6ff46-0b76-4f59-9790-69c972d677e2 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:03.301659 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38809d9f-05e8-4a55-807c-aef049eb0d30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:03.302591 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38809d9f-05e8-4a55-807c-aef049eb0d30 admin admin] REQUEST_METHOD: `PUT` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:03.303042 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38809d9f-05e8-4a55-807c-aef049eb0d30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:03.303401 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38809d9f-05e8-4a55-807c-aef049eb0d30 admin admin] PATH_INFO: `/v3/projects/6a7290c3c32f44d780a893b05a212581/users/d97678a2822e40e880a0856df832b4b9/roles/399893e19eac4ab5a8e596f7c07be13c` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:03.308574 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38809d9f-05e8-4a55-807c-aef049eb0d30 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a7290c3c32f44d780a893b05a212581, user_id=d97678a2822e40e880a0856df832b4b9, role_id=399893e19eac4ab5a8e596f7c07be13c)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:03.313872 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38809d9f-05e8-4a55-807c-aef049eb0d30 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:03.323516 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:03.334906 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 886/1758] 10.222.0.67 () {60 vars in 1482 bytes} [Wed May 25 14:42:03 2022] PUT /identity/v3/projects/6a7290c3c32f44d780a893b05a212581/users/d97678a2822e40e880a0856df832b4b9/roles/399893e19eac4ab5a8e596f7c07be13c => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:42:03.348404 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7852139-32d5-4d20-968d-cf22b6604807 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:03.348874 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7852139-32d5-4d20-968d-cf22b6604807 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:03.349469 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7852139-32d5-4d20-968d-cf22b6604807 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:03.366559 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 873/1759] 10.222.0.67 () {60 vars in 1143 bytes} [Wed May 25 14:42:02 2022] POST /identity/v3/users => generated 291 bytes in 693 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:42:03.366559 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b800fd-be08-41bf-b779-ad4bbc498df0 admin admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:03.370357 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-c0b800fd-be08-41bf-b779-ad4bbc498df0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:42:03.412511 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b800fd-be08-41bf-b779-ad4bbc498df0 admin admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:03.451409 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-c7852139-32d5-4d20-968d-cf22b6604807 None None] MFA Rules not processed for user `d97678a2822e40e880a0856df832b4b9`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:42:03.452991 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-c7852139-32d5-4d20-968d-cf22b6604807 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:42:03.476013 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:03.610124 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9654643-4b5a-4638-8e03-c9b79e4f1d47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:03.611805 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9654643-4b5a-4638-8e03-c9b79e4f1d47 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:03.613692 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9654643-4b5a-4638-8e03-c9b79e4f1d47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:03.614637 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9654643-4b5a-4638-8e03-c9b79e4f1d47 admin admin] PATH_INFO: `/v3/users/eef733e11dc04d83ba2e9b2c1d64f26a` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:03.628393 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9654643-4b5a-4638-8e03-c9b79e4f1d47 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eef733e11dc04d83ba2e9b2c1d64f26a)` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:03.636740 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9654643-4b5a-4638-8e03-c9b79e4f1d47 admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:03.667034 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 887/1760] 10.222.0.67 () {58 vars in 957 bytes} [Wed May 25 14:42:03 2022] POST /identity/v3/auth/tokens => generated 3289 bytes in 320 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:42:03.668439 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7852139-32d5-4d20-968d-cf22b6604807 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:03.703060 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7852139-32d5-4d20-968d-cf22b6604807 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:03.718875 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f777933d-1596-45bf-801e-fbb1abea0f6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:03.719445 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f777933d-1596-45bf-801e-fbb1abea0f6b admin admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:03.719739 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f777933d-1596-45bf-801e-fbb1abea0f6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:03.733863 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f777933d-1596-45bf-801e-fbb1abea0f6b admin admin] PATH_INFO: `/v3/roles` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:03.734805 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f777933d-1596-45bf-801e-fbb1abea0f6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:03.747281 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f777933d-1596-45bf-801e-fbb1abea0f6b admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:03.800883 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 888/1761] 10.222.0.67 () {58 vars in 1121 bytes} [Wed May 25 14:42:03 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:42:03.805381 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f777933d-1596-45bf-801e-fbb1abea0f6b admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:03.809795 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-d9654643-4b5a-4638-8e03-c9b79e4f1d47 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eef733e11dc04d83ba2e9b2c1d64f26a'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:42:03.811507 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-d9654643-4b5a-4638-8e03-c9b79e4f1d47 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eef733e11dc04d83ba2e9b2c1d64f26a'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:42:03.812661 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-f777933d-1596-45bf-801e-fbb1abea0f6b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:42:03.813259 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-d9654643-4b5a-4638-8e03-c9b79e4f1d47 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eef733e11dc04d83ba2e9b2c1d64f26a'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:42:03.870526 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-d9654643-4b5a-4638-8e03-c9b79e4f1d47 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eef733e11dc04d83ba2e9b2c1d64f26a'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:42:03.896696 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-d9654643-4b5a-4638-8e03-c9b79e4f1d47 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eef733e11dc04d83ba2e9b2c1d64f26a'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:42:03.938498 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 874/1762] 10.222.0.67 () {58 vars in 1223 bytes} [Wed May 25 14:42:03 2022] DELETE /identity/v3/users/eef733e11dc04d83ba2e9b2c1d64f26a => generated 0 bytes in 574 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:42:03.939361 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9654643-4b5a-4638-8e03-c9b79e4f1d47 admin admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:03.946874 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-d9654643-4b5a-4638-8e03-c9b79e4f1d47 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:42:04.105506 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f777933d-1596-45bf-801e-fbb1abea0f6b admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:04.194273 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9654643-4b5a-4638-8e03-c9b79e4f1d47 admin admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:04.200765 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a8d6f7-0205-487c-a028-f25838752b04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:04.201271 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a8d6f7-0205-487c-a028-f25838752b04 admin admin] REQUEST_METHOD: `PUT` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:04.201388 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a8d6f7-0205-487c-a028-f25838752b04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:04.201654 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a8d6f7-0205-487c-a028-f25838752b04 admin admin] PATH_INFO: `/v3/projects/8ee6511fc80840c68b1d6ab69be7a234/users/bcf1a2361bea4f6d9a65da8a6629819d/roles/399893e19eac4ab5a8e596f7c07be13c` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:04.253119 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a8d6f7-0205-487c-a028-f25838752b04 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ee6511fc80840c68b1d6ab69be7a234, user_id=bcf1a2361bea4f6d9a65da8a6629819d, role_id=399893e19eac4ab5a8e596f7c07be13c)` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:04.256629 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a8d6f7-0205-487c-a028-f25838752b04 admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:04.295189 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 875/1763] 10.222.0.67 () {60 vars in 1482 bytes} [Wed May 25 14:42:03 2022] PUT /identity/v3/projects/8ee6511fc80840c68b1d6ab69be7a234/users/bcf1a2361bea4f6d9a65da8a6629819d/roles/399893e19eac4ab5a8e596f7c07be13c => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:42:04.297361 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc78a3ff-3166-4bb8-afd1-087154cba375 None None] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:04.297608 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc78a3ff-3166-4bb8-afd1-087154cba375 None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:04.297901 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc78a3ff-3166-4bb8-afd1-087154cba375 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:04.328423 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e63346-1bed-4630-8bff-1b672e26acea service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e462acc9da84a61bb23998dd54e1858', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfe93ee8d32a441295efc0b885de4bd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:04.333195 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e63346-1bed-4630-8bff-1b672e26acea service cinder] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:04.333665 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e63346-1bed-4630-8bff-1b672e26acea service cinder] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:04.334080 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e63346-1bed-4630-8bff-1b672e26acea service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:04.337569 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-a3e63346-1bed-4630-8bff-1b672e26acea service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:42:04.360481 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.auth.core [None req-fc78a3ff-3166-4bb8-afd1-087154cba375 None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:42:04.365087 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-fc78a3ff-3166-4bb8-afd1-087154cba375 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:42:04.452987 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:04.498118 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:04.575826 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e63346-1bed-4630-8bff-1b672e26acea service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:04.577966 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e63346-1bed-4630-8bff-1b672e26acea service cinder] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:04.608562 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 889/1764] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 14:42:03 2022] GET /identity/v3/auth/tokens => generated 3289 bytes in 807 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:42:04.616486 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e63346-1bed-4630-8bff-1b672e26acea service cinder] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:04.659880 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e63346-1bed-4630-8bff-1b672e26acea service cinder] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:04.660885 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 876/1765] 10.222.0.67 () {58 vars in 957 bytes} [Wed May 25 14:42:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 365 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:42:04.664597 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1461ec97-4fe1-49a4-8247-21712e2e21b5 None None] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:04.674072 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41f3644-c0e8-44e4-8362-25920878a4cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:04.676445 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41f3644-c0e8-44e4-8362-25920878a4cd admin admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:04.677755 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1461ec97-4fe1-49a4-8247-21712e2e21b5 None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:04.678114 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1461ec97-4fe1-49a4-8247-21712e2e21b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:04.684186 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41f3644-c0e8-44e4-8362-25920878a4cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:04.687264 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41f3644-c0e8-44e4-8362-25920878a4cd admin admin] PATH_INFO: `/v3/roles` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:04.699538 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41f3644-c0e8-44e4-8362-25920878a4cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:04.704455 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41f3644-c0e8-44e4-8362-25920878a4cd admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:04.745123 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 890/1766] 10.222.0.67 () {58 vars in 1121 bytes} [Wed May 25 14:42:04 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:42:04.746211 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41f3644-c0e8-44e4-8362-25920878a4cd admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:04.754460 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-b41f3644-c0e8-44e4-8362-25920878a4cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:42:04.759213 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.auth.core [None req-1461ec97-4fe1-49a4-8247-21712e2e21b5 None None] MFA Rules not processed for user `54a9a5bdd9674c1f9700800609062675`. Rule list: `[]` (Enabled: `True`). {{(pid=80474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:42:04.763519 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-1461ec97-4fe1-49a4-8247-21712e2e21b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:42:04.926649 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41f3644-c0e8-44e4-8362-25920878a4cd admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:04.933132 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97d55a6-e90a-4f01-b574-70f8e673d0c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b68eed985c7b49839bcdd173186ad4ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfe93ee8d32a441295efc0b885de4bd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:04.933460 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97d55a6-e90a-4f01-b574-70f8e673d0c4 service neutron] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:04.933665 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97d55a6-e90a-4f01-b574-70f8e673d0c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:04.933876 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97d55a6-e90a-4f01-b574-70f8e673d0c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:04.960939 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97d55a6-e90a-4f01-b574-70f8e673d0c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:04.962242 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97d55a6-e90a-4f01-b574-70f8e673d0c4 service neutron] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:04.994794 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 891/1767] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 14:42:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:42:04.995808 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97d55a6-e90a-4f01-b574-70f8e673d0c4 service neutron] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:05.016612 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 877/1768] 10.222.0.67 () {58 vars in 957 bytes} [Wed May 25 14:42:04 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 354 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:42:05.019148 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1461ec97-4fe1-49a4-8247-21712e2e21b5 None None] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:05.022773 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-1461ec97-4fe1-49a4-8247-21712e2e21b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:42:05.023227 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97d55a6-e90a-4f01-b574-70f8e673d0c4 service neutron] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:05.031632 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3f7cf3-948a-4e71-99f2-2a5c0f2d5aa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:05.033549 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3f7cf3-948a-4e71-99f2-2a5c0f2d5aa3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:05.034376 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3f7cf3-948a-4e71-99f2-2a5c0f2d5aa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:05.034929 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3f7cf3-948a-4e71-99f2-2a5c0f2d5aa3 admin admin] PATH_INFO: `/v3/projects/8ee6511fc80840c68b1d6ab69be7a234/users/bcf1a2361bea4f6d9a65da8a6629819d/roles/399893e19eac4ab5a8e596f7c07be13c` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:05.038827 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3f7cf3-948a-4e71-99f2-2a5c0f2d5aa3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ee6511fc80840c68b1d6ab69be7a234, user_id=bcf1a2361bea4f6d9a65da8a6629819d, role_id=399893e19eac4ab5a8e596f7c07be13c)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:05.043227 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3f7cf3-948a-4e71-99f2-2a5c0f2d5aa3 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:05.074555 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 892/1769] 10.222.0.67 () {60 vars in 1482 bytes} [Wed May 25 14:42:04 2022] PUT /identity/v3/projects/8ee6511fc80840c68b1d6ab69be7a234/users/bcf1a2361bea4f6d9a65da8a6629819d/roles/399893e19eac4ab5a8e596f7c07be13c => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:42:05.085779 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be3ed8d-77b6-471f-b2f6-b3e3b0069787 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:05.086375 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be3ed8d-77b6-471f-b2f6-b3e3b0069787 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:05.086887 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be3ed8d-77b6-471f-b2f6-b3e3b0069787 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:05.187851 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-6be3ed8d-77b6-471f-b2f6-b3e3b0069787 None None] MFA Rules not processed for user `bcf1a2361bea4f6d9a65da8a6629819d`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:42:05.193558 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-6be3ed8d-77b6-471f-b2f6-b3e3b0069787 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:42:05.233811 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1461ec97-4fe1-49a4-8247-21712e2e21b5 None None] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:05.399472 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772b54a9-a755-4040-b46d-0d8ddc6bcdf5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e462acc9da84a61bb23998dd54e1858', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfe93ee8d32a441295efc0b885de4bd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:05.399472 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772b54a9-a755-4040-b46d-0d8ddc6bcdf5 service cinder] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:05.399472 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772b54a9-a755-4040-b46d-0d8ddc6bcdf5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:05.399472 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772b54a9-a755-4040-b46d-0d8ddc6bcdf5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:05.404845 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-772b54a9-a755-4040-b46d-0d8ddc6bcdf5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:42:05.432793 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 893/1770] 10.222.0.67 () {58 vars in 957 bytes} [Wed May 25 14:42:05 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 349 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 14:42:05.446638 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be3ed8d-77b6-471f-b2f6-b3e3b0069787 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:05.449009 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-6be3ed8d-77b6-471f-b2f6-b3e3b0069787 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:42:05.484239 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be3ed8d-77b6-471f-b2f6-b3e3b0069787 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:05.495785 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21097043-b18e-4d38-abb0-ef1a512e9510 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e462acc9da84a61bb23998dd54e1858', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfe93ee8d32a441295efc0b885de4bd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:05.498616 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:05.506054 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21097043-b18e-4d38-abb0-ef1a512e9510 service cinder] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:05.506699 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21097043-b18e-4d38-abb0-ef1a512e9510 service cinder] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:05.507407 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21097043-b18e-4d38-abb0-ef1a512e9510 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:05.560131 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772b54a9-a755-4040-b46d-0d8ddc6bcdf5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:05.561452 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772b54a9-a755-4040-b46d-0d8ddc6bcdf5 service cinder] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:05.569399 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21097043-b18e-4d38-abb0-ef1a512e9510 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:05.571578 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21097043-b18e-4d38-abb0-ef1a512e9510 service cinder] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:05.588751 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 878/1771] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 14:42:05 2022] GET /identity/v3/auth/tokens => generated 3224 bytes in 573 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:42:05.606545 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 894/1772] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 14:42:05 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 14:42:05.703639 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772b54a9-a755-4040-b46d-0d8ddc6bcdf5 service cinder] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:05.727927 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772b54a9-a755-4040-b46d-0d8ddc6bcdf5 service cinder] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:05.741283 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5205819-adc8-4178-8a1b-fcf758ab6f31 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e462acc9da84a61bb23998dd54e1858', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfe93ee8d32a441295efc0b885de4bd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:05.741850 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5205819-adc8-4178-8a1b-fcf758ab6f31 service cinder] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:05.742220 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5205819-adc8-4178-8a1b-fcf758ab6f31 service cinder] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:05.742505 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5205819-adc8-4178-8a1b-fcf758ab6f31 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:05.749502 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-b5205819-adc8-4178-8a1b-fcf758ab6f31 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:42:05.773228 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a388dafa-9e18-4084-b65e-1f752b49c5ff None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:05.773817 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a388dafa-9e18-4084-b65e-1f752b49c5ff None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:05.774316 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a388dafa-9e18-4084-b65e-1f752b49c5ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:05.828603 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-a388dafa-9e18-4084-b65e-1f752b49c5ff None None] MFA Rules not processed for user `4db7e98c4244461daf725c699fb2b9a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:42:05.835186 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-a388dafa-9e18-4084-b65e-1f752b49c5ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:42:05.898952 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:05.972715 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5205819-adc8-4178-8a1b-fcf758ab6f31 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:05.974346 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5205819-adc8-4178-8a1b-fcf758ab6f31 service cinder] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:06.022191 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 879/1773] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 14:42:05 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:42:06.031727 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 895/1774] 10.222.0.67 () {58 vars in 957 bytes} [Wed May 25 14:42:05 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:42:06.730198 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5205819-adc8-4178-8a1b-fcf758ab6f31 service cinder] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:06.732252 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-b5205819-adc8-4178-8a1b-fcf758ab6f31 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:42:06.888790 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5205819-adc8-4178-8a1b-fcf758ab6f31 service cinder] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:06.902798 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7127ab4-ef2e-4992-abca-072810a73960 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:06.903809 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7127ab4-ef2e-4992-abca-072810a73960 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:06.904132 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7127ab4-ef2e-4992-abca-072810a73960 admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:06.904388 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7127ab4-ef2e-4992-abca-072810a73960 admin admin] PATH_INFO: `/v3/projects/531d12498064492a847c147e0cdce532` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:06.907321 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7127ab4-ef2e-4992-abca-072810a73960 admin admin] RBAC: Authorizing `identity:delete_project(project_id=531d12498064492a847c147e0cdce532)` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:06.910625 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7127ab4-ef2e-4992-abca-072810a73960 admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:07.048043 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-b7127ab4-ef2e-4992-abca-072810a73960 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '531d12498064492a847c147e0cdce532', 'request_id': 'req-b7127ab4-ef2e-4992-abca-072810a73960'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:42:07.069250 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-b7127ab4-ef2e-4992-abca-072810a73960 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '531d12498064492a847c147e0cdce532', 'request_id': 'req-b7127ab4-ef2e-4992-abca-072810a73960'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:42:07.079362 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-b7127ab4-ef2e-4992-abca-072810a73960 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '531d12498064492a847c147e0cdce532', 'request_id': 'req-b7127ab4-ef2e-4992-abca-072810a73960'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:42:07.104117 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-b7127ab4-ef2e-4992-abca-072810a73960 admin admin] The token cache is being invalidate because project 531d12498064492a847c147e0cdce532 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80474) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 14:42:07.104504 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-b7127ab4-ef2e-4992-abca-072810a73960 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:42:07.107030 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-b7127ab4-ef2e-4992-abca-072810a73960 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:42:07.107030 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 880/1775] 10.222.0.67 () {58 vars in 1232 bytes} [Wed May 25 14:42:06 2022] DELETE /identity/v3/projects/531d12498064492a847c147e0cdce532 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:42:07.111537 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a388dafa-9e18-4084-b65e-1f752b49c5ff None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:07.135227 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a388dafa-9e18-4084-b65e-1f752b49c5ff None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:07.224698 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b28b66-7e03-40ee-a39f-c8cd314ab7a0 None None] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:07.225006 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b28b66-7e03-40ee-a39f-c8cd314ab7a0 None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:07.225284 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b28b66-7e03-40ee-a39f-c8cd314ab7a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:07.275141 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:07.291544 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.auth.core [None req-f9b28b66-7e03-40ee-a39f-c8cd314ab7a0 None None] MFA Rules not processed for user `ff5a1f15e8d54a68946c8ccfdd4a3587`. Rule list: `[]` (Enabled: `True`). {{(pid=80474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:42:07.295197 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-f9b28b66-7e03-40ee-a39f-c8cd314ab7a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:42:07.431679 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f16e5fb-0f0e-4400-9f0a-18dc8a53b648 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:07.432961 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f16e5fb-0f0e-4400-9f0a-18dc8a53b648 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:07.434576 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f16e5fb-0f0e-4400-9f0a-18dc8a53b648 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:07.435115 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f16e5fb-0f0e-4400-9f0a-18dc8a53b648 admin admin] PATH_INFO: `/v3/users/6475e1d0a9d04d58b5032be7ec1baaea` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:07.438178 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f16e5fb-0f0e-4400-9f0a-18dc8a53b648 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6475e1d0a9d04d58b5032be7ec1baaea)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:07.445404 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f16e5fb-0f0e-4400-9f0a-18dc8a53b648 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:07.480078 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 881/1776] 10.222.0.67 () {58 vars in 957 bytes} [Wed May 25 14:42:07 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 14:42:07.601521 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-5f16e5fb-0f0e-4400-9f0a-18dc8a53b648 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6475e1d0a9d04d58b5032be7ec1baaea'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:42:07.635894 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-5f16e5fb-0f0e-4400-9f0a-18dc8a53b648 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6475e1d0a9d04d58b5032be7ec1baaea'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:42:07.636985 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-5f16e5fb-0f0e-4400-9f0a-18dc8a53b648 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6475e1d0a9d04d58b5032be7ec1baaea'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:42:07.683720 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-5f16e5fb-0f0e-4400-9f0a-18dc8a53b648 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6475e1d0a9d04d58b5032be7ec1baaea'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:42:07.719516 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-5f16e5fb-0f0e-4400-9f0a-18dc8a53b648 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6475e1d0a9d04d58b5032be7ec1baaea'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:42:07.772944 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 896/1777] 10.222.0.67 () {58 vars in 1223 bytes} [Wed May 25 14:42:07 2022] DELETE /identity/v3/users/6475e1d0a9d04d58b5032be7ec1baaea => generated 0 bytes in 648 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:42:09.284254 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b28b66-7e03-40ee-a39f-c8cd314ab7a0 None None] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:09.286362 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-f9b28b66-7e03-40ee-a39f-c8cd314ab7a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:42:09.314855 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b28b66-7e03-40ee-a39f-c8cd314ab7a0 None None] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:09.458737 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000fb668-df42-4dbf-8cba-f1b5a1a6ccdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:09.459813 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000fb668-df42-4dbf-8cba-f1b5a1a6ccdf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:09.460292 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000fb668-df42-4dbf-8cba-f1b5a1a6ccdf admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:09.460667 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000fb668-df42-4dbf-8cba-f1b5a1a6ccdf admin admin] PATH_INFO: `/v3/projects/cfa1eba52ea445879a12351e5df5a385` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:09.463680 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000fb668-df42-4dbf-8cba-f1b5a1a6ccdf admin admin] RBAC: Authorizing `identity:delete_project(project_id=cfa1eba52ea445879a12351e5df5a385)` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:09.465921 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000fb668-df42-4dbf-8cba-f1b5a1a6ccdf admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:09.552206 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-000fb668-df42-4dbf-8cba-f1b5a1a6ccdf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cfa1eba52ea445879a12351e5df5a385', 'request_id': 'req-000fb668-df42-4dbf-8cba-f1b5a1a6ccdf'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:42:09.562616 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-000fb668-df42-4dbf-8cba-f1b5a1a6ccdf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cfa1eba52ea445879a12351e5df5a385', 'request_id': 'req-000fb668-df42-4dbf-8cba-f1b5a1a6ccdf'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:42:09.577362 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-000fb668-df42-4dbf-8cba-f1b5a1a6ccdf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cfa1eba52ea445879a12351e5df5a385', 'request_id': 'req-000fb668-df42-4dbf-8cba-f1b5a1a6ccdf'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:42:09.636178 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-000fb668-df42-4dbf-8cba-f1b5a1a6ccdf admin admin] The token cache is being invalidate because project cfa1eba52ea445879a12351e5df5a385 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80474) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 14:42:09.636678 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-000fb668-df42-4dbf-8cba-f1b5a1a6ccdf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:42:09.637698 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-000fb668-df42-4dbf-8cba-f1b5a1a6ccdf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:42:09.645382 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 882/1778] 10.222.0.67 () {58 vars in 1232 bytes} [Wed May 25 14:42:09 2022] DELETE /identity/v3/projects/cfa1eba52ea445879a12351e5df5a385 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:42:09.646153 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e481da-1a29-4ab0-997e-a47f75f34ed9 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:09.647278 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e481da-1a29-4ab0-997e-a47f75f34ed9 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:09.647952 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e481da-1a29-4ab0-997e-a47f75f34ed9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:09.678588 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-28e481da-1a29-4ab0-997e-a47f75f34ed9 None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:42:09.680247 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-28e481da-1a29-4ab0-997e-a47f75f34ed9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:42:09.745606 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:09.779178 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9022e3c-a9db-408e-806b-2d454527f521 None None] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:09.779837 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9022e3c-a9db-408e-806b-2d454527f521 None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:09.780450 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9022e3c-a9db-408e-806b-2d454527f521 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:09.782636 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 897/1779] 10.222.0.67 () {58 vars in 957 bytes} [Wed May 25 14:42:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:42:09.836562 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.auth.core [None req-d9022e3c-a9db-408e-806b-2d454527f521 None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:42:09.840975 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-d9022e3c-a9db-408e-806b-2d454527f521 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:42:09.863476 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 883/1780] 10.222.0.67 () {58 vars in 957 bytes} [Wed May 25 14:42:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:42:09.868170 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e481da-1a29-4ab0-997e-a47f75f34ed9 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:09.883371 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e481da-1a29-4ab0-997e-a47f75f34ed9 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:09.890727 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64007f0-2665-4c67-b83d-5f673330bb84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:09.891467 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64007f0-2665-4c67-b83d-5f673330bb84 admin admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:09.891753 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64007f0-2665-4c67-b83d-5f673330bb84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:09.892068 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64007f0-2665-4c67-b83d-5f673330bb84 admin admin] PATH_INFO: `/v3/domains` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:09.893779 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64007f0-2665-4c67-b83d-5f673330bb84 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:42:09.894129 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64007f0-2665-4c67-b83d-5f673330bb84 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:09.896116 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64007f0-2665-4c67-b83d-5f673330bb84 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:09.917655 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9022e3c-a9db-408e-806b-2d454527f521 None None] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:09.942283 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 898/1781] 10.222.0.67 () {58 vars in 1152 bytes} [Wed May 25 14:42:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:42:09.948912 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9022e3c-a9db-408e-806b-2d454527f521 None None] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:09.957243 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3635a245-ab4d-4055-b277-d85c22b5d595 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:09.958862 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3635a245-ab4d-4055-b277-d85c22b5d595 admin admin] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:09.959244 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3635a245-ab4d-4055-b277-d85c22b5d595 admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:09.960242 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3635a245-ab4d-4055-b277-d85c22b5d595 admin admin] PATH_INFO: `/v3/projects` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:09.961012 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3635a245-ab4d-4055-b277-d85c22b5d595 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:09.964402 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3635a245-ab4d-4055-b277-d85c22b5d595 admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:10.018477 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 884/1782] 10.222.0.67 () {60 vars in 1152 bytes} [Wed May 25 14:42:09 2022] POST /identity/v3/projects => generated 393 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:42:10.023286 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64007f0-2665-4c67-b83d-5f673330bb84 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:10.042604 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64007f0-2665-4c67-b83d-5f673330bb84 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:10.131312 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7264154c-f078-4636-bb01-7c5adc2cfcb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:10.133452 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7264154c-f078-4636-bb01-7c5adc2cfcb1 admin admin] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:10.135264 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7264154c-f078-4636-bb01-7c5adc2cfcb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:10.136037 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7264154c-f078-4636-bb01-7c5adc2cfcb1 admin admin] PATH_INFO: `/v3/users` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:10.138237 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7264154c-f078-4636-bb01-7c5adc2cfcb1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:10.145119 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7264154c-f078-4636-bb01-7c5adc2cfcb1 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:10.187064 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 899/1783] 10.222.0.67 () {60 vars in 1143 bytes} [Wed May 25 14:42:10 2022] POST /identity/v3/users => generated 297 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:42:10.192906 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3635a245-ab4d-4055-b277-d85c22b5d595 admin admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:10.228498 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3635a245-ab4d-4055-b277-d85c22b5d595 admin admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:10.246796 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc21970-be3d-462b-a575-84f35fa4756f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:10.247537 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc21970-be3d-462b-a575-84f35fa4756f admin admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:10.247831 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc21970-be3d-462b-a575-84f35fa4756f admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:10.248113 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc21970-be3d-462b-a575-84f35fa4756f admin admin] PATH_INFO: `/v3/roles` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:10.254666 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc21970-be3d-462b-a575-84f35fa4756f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:10.258456 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc21970-be3d-462b-a575-84f35fa4756f admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:10.292187 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 885/1784] 10.222.0.67 () {58 vars in 1121 bytes} [Wed May 25 14:42:10 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:42:10.294343 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7264154c-f078-4636-bb01-7c5adc2cfcb1 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:10.308756 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7264154c-f078-4636-bb01-7c5adc2cfcb1 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:10.330415 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93207d79-59a5-4638-bb82-80fde5032003 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:10.331563 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93207d79-59a5-4638-bb82-80fde5032003 admin admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:10.332298 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93207d79-59a5-4638-bb82-80fde5032003 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:10.334529 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93207d79-59a5-4638-bb82-80fde5032003 admin admin] PATH_INFO: `/v3/roles` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:10.337320 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93207d79-59a5-4638-bb82-80fde5032003 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:10.344172 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93207d79-59a5-4638-bb82-80fde5032003 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:10.396889 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 900/1785] 10.222.0.67 () {58 vars in 1121 bytes} [Wed May 25 14:42:10 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:42:10.401800 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc21970-be3d-462b-a575-84f35fa4756f admin admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:10.409147 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:10.418362 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc21970-be3d-462b-a575-84f35fa4756f admin admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:10.446574 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bbd29f-a337-49ca-a787-83f2edcdfbbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:10.447929 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bbd29f-a337-49ca-a787-83f2edcdfbbb admin admin] REQUEST_METHOD: `PUT` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:10.448220 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bbd29f-a337-49ca-a787-83f2edcdfbbb admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:10.448494 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bbd29f-a337-49ca-a787-83f2edcdfbbb admin admin] PATH_INFO: `/v3/projects/224c798737384a04abd947f1ba66e17e/users/1f5e6a832b34498ab2fbd30c1d67f39e/roles/48808901834b4d5eab2c7e6b5b03791e` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:10.504579 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bbd29f-a337-49ca-a787-83f2edcdfbbb admin admin] RBAC: Authorizing `identity:create_grant(project_id=224c798737384a04abd947f1ba66e17e, user_id=1f5e6a832b34498ab2fbd30c1d67f39e, role_id=48808901834b4d5eab2c7e6b5b03791e)` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:10.510292 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bbd29f-a337-49ca-a787-83f2edcdfbbb admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:10.530883 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 886/1786] 10.222.0.67 () {60 vars in 1482 bytes} [Wed May 25 14:42:10 2022] PUT /identity/v3/projects/224c798737384a04abd947f1ba66e17e/users/1f5e6a832b34498ab2fbd30c1d67f39e/roles/48808901834b4d5eab2c7e6b5b03791e => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:42:10.545115 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4471b693-d59d-4ea5-847b-e7a9de1d9620 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:10.545416 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4471b693-d59d-4ea5-847b-e7a9de1d9620 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:10.545710 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4471b693-d59d-4ea5-847b-e7a9de1d9620 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:10.630922 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-4471b693-d59d-4ea5-847b-e7a9de1d9620 None None] MFA Rules not processed for user `1f5e6a832b34498ab2fbd30c1d67f39e`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:42:10.632300 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-4471b693-d59d-4ea5-847b-e7a9de1d9620 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:42:10.805863 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bbd29f-a337-49ca-a787-83f2edcdfbbb admin admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:10.807085 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 901/1787] 10.222.0.67 () {58 vars in 957 bytes} [Wed May 25 14:42:10 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:42:11.004458 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bbd29f-a337-49ca-a787-83f2edcdfbbb admin admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:11.020929 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b413c045-ac4b-4879-8b40-25115dfb95d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:11.021741 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b413c045-ac4b-4879-8b40-25115dfb95d8 admin admin] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:11.022126 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b413c045-ac4b-4879-8b40-25115dfb95d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:11.022501 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b413c045-ac4b-4879-8b40-25115dfb95d8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:11.023424 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b413c045-ac4b-4879-8b40-25115dfb95d8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:11.025423 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b413c045-ac4b-4879-8b40-25115dfb95d8 admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:11.087717 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 887/1788] 10.222.0.67 () {60 vars in 1152 bytes} [Wed May 25 14:42:10 2022] POST /identity/v3/projects => generated 391 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:42:11.089375 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4471b693-d59d-4ea5-847b-e7a9de1d9620 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:11.108322 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4471b693-d59d-4ea5-847b-e7a9de1d9620 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:11.203534 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:11.238876 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2e92bf-9253-4f2b-877a-77b940c919c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:11.240814 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2e92bf-9253-4f2b-877a-77b940c919c8 admin admin] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:11.241797 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2e92bf-9253-4f2b-877a-77b940c919c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:11.242560 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2e92bf-9253-4f2b-877a-77b940c919c8 admin admin] PATH_INFO: `/v3/users` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:11.247053 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2e92bf-9253-4f2b-877a-77b940c919c8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:11.249540 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2e92bf-9253-4f2b-877a-77b940c919c8 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:11.287576 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 902/1789] 10.222.0.67 () {60 vars in 1143 bytes} [Wed May 25 14:42:11 2022] POST /identity/v3/users => generated 302 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:42:11.290780 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b413c045-ac4b-4879-8b40-25115dfb95d8 admin admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:11.290864 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2e92bf-9253-4f2b-877a-77b940c919c8 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:11.293338 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-b413c045-ac4b-4879-8b40-25115dfb95d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:42:11.315185 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b413c045-ac4b-4879-8b40-25115dfb95d8 admin admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:11.332402 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5ef3d6-a217-4522-b20e-720c67785600 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:11.333571 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5ef3d6-a217-4522-b20e-720c67785600 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:11.334141 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5ef3d6-a217-4522-b20e-720c67785600 admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:11.334572 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5ef3d6-a217-4522-b20e-720c67785600 admin admin] PATH_INFO: `/v3/users/b246c7326caf4a368fa6fda35e4a97cd` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:11.336020 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5ef3d6-a217-4522-b20e-720c67785600 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b246c7326caf4a368fa6fda35e4a97cd)` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:11.338318 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5ef3d6-a217-4522-b20e-720c67785600 admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:11.338825 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2e92bf-9253-4f2b-877a-77b940c919c8 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:11.357842 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e0484f-983c-4f23-aa05-69e05afdca09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:11.358805 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e0484f-983c-4f23-aa05-69e05afdca09 admin admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:11.359305 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e0484f-983c-4f23-aa05-69e05afdca09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:11.359759 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e0484f-983c-4f23-aa05-69e05afdca09 admin admin] PATH_INFO: `/v3/roles` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:11.360723 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e0484f-983c-4f23-aa05-69e05afdca09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:11.364304 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e0484f-983c-4f23-aa05-69e05afdca09 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:11.379248 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 903/1790] 10.222.0.67 () {58 vars in 1121 bytes} [Wed May 25 14:42:11 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:42:11.384170 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e0484f-983c-4f23-aa05-69e05afdca09 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:11.398741 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e0484f-983c-4f23-aa05-69e05afdca09 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:11.409002 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac6a017-7c52-4ffb-828d-4c044b3f0b0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:11.412287 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac6a017-7c52-4ffb-828d-4c044b3f0b0e admin admin] REQUEST_METHOD: `PUT` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:11.414296 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac6a017-7c52-4ffb-828d-4c044b3f0b0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:11.415541 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac6a017-7c52-4ffb-828d-4c044b3f0b0e admin admin] PATH_INFO: `/v3/projects/6d84f7d6c0ee4e7e9a4f33dcbe0a6529/users/5ef66a30ed954d5c84dbb0575a28d9ec/roles/399893e19eac4ab5a8e596f7c07be13c` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:11.464023 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac6a017-7c52-4ffb-828d-4c044b3f0b0e admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d84f7d6c0ee4e7e9a4f33dcbe0a6529, user_id=5ef66a30ed954d5c84dbb0575a28d9ec, role_id=399893e19eac4ab5a8e596f7c07be13c)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:11.467216 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-bf5ef3d6-a217-4522-b20e-720c67785600 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b246c7326caf4a368fa6fda35e4a97cd'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:42:11.467959 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-bf5ef3d6-a217-4522-b20e-720c67785600 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b246c7326caf4a368fa6fda35e4a97cd'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:42:11.468606 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-bf5ef3d6-a217-4522-b20e-720c67785600 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b246c7326caf4a368fa6fda35e4a97cd'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:42:11.484822 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac6a017-7c52-4ffb-828d-4c044b3f0b0e admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:11.520444 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 904/1791] 10.222.0.67 () {60 vars in 1482 bytes} [Wed May 25 14:42:11 2022] PUT /identity/v3/projects/6d84f7d6c0ee4e7e9a4f33dcbe0a6529/users/5ef66a30ed954d5c84dbb0575a28d9ec/roles/399893e19eac4ab5a8e596f7c07be13c => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 14:42:11.525313 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac6a017-7c52-4ffb-828d-4c044b3f0b0e admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:11.525775 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-bf5ef3d6-a217-4522-b20e-720c67785600 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b246c7326caf4a368fa6fda35e4a97cd'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:42:11.533728 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-aac6a017-7c52-4ffb-828d-4c044b3f0b0e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:42:11.549406 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-bf5ef3d6-a217-4522-b20e-720c67785600 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b246c7326caf4a368fa6fda35e4a97cd'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:42:11.582890 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 888/1792] 10.222.0.67 () {58 vars in 1223 bytes} [Wed May 25 14:42:11 2022] DELETE /identity/v3/users/b246c7326caf4a368fa6fda35e4a97cd => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:42:11.590208 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e271ad-c056-41d6-9e67-224916353dfb None None] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:11.592602 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e271ad-c056-41d6-9e67-224916353dfb None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:11.593173 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e271ad-c056-41d6-9e67-224916353dfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:11.653000 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.auth.core [None req-69e271ad-c056-41d6-9e67-224916353dfb None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:42:11.654407 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-69e271ad-c056-41d6-9e67-224916353dfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:42:11.744905 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:11.864244 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac6a017-7c52-4ffb-828d-4c044b3f0b0e admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:11.890841 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 889/1793] 10.222.0.67 () {58 vars in 957 bytes} [Wed May 25 14:42:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 303 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:42:11.901589 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95556037-aa33-42d0-966d-66ba003d3dc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:11.907203 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95556037-aa33-42d0-966d-66ba003d3dc1 admin admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:11.908502 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95556037-aa33-42d0-966d-66ba003d3dc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:11.908502 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95556037-aa33-42d0-966d-66ba003d3dc1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:11.909239 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95556037-aa33-42d0-966d-66ba003d3dc1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:11.921360 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95556037-aa33-42d0-966d-66ba003d3dc1 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:11.927777 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e271ad-c056-41d6-9e67-224916353dfb None None] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:11.929284 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-69e271ad-c056-41d6-9e67-224916353dfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:42:11.961318 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 905/1794] 10.222.0.67 () {58 vars in 1121 bytes} [Wed May 25 14:42:11 2022] GET /identity/v3/roles => generated 1420 bytes in 431 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:42:11.962309 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95556037-aa33-42d0-966d-66ba003d3dc1 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:11.980557 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95556037-aa33-42d0-966d-66ba003d3dc1 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:11.991916 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97106fd-d353-46c0-b2a0-52e49498a0d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:11.995780 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97106fd-d353-46c0-b2a0-52e49498a0d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:11.996386 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97106fd-d353-46c0-b2a0-52e49498a0d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:11.996876 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97106fd-d353-46c0-b2a0-52e49498a0d9 admin admin] PATH_INFO: `/v3/projects/6d84f7d6c0ee4e7e9a4f33dcbe0a6529/users/5ef66a30ed954d5c84dbb0575a28d9ec/roles/399893e19eac4ab5a8e596f7c07be13c` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:12.000274 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97106fd-d353-46c0-b2a0-52e49498a0d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d84f7d6c0ee4e7e9a4f33dcbe0a6529, user_id=5ef66a30ed954d5c84dbb0575a28d9ec, role_id=399893e19eac4ab5a8e596f7c07be13c)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:12.004076 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97106fd-d353-46c0-b2a0-52e49498a0d9 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:12.026367 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 906/1795] 10.222.0.67 () {60 vars in 1482 bytes} [Wed May 25 14:42:11 2022] PUT /identity/v3/projects/6d84f7d6c0ee4e7e9a4f33dcbe0a6529/users/5ef66a30ed954d5c84dbb0575a28d9ec/roles/399893e19eac4ab5a8e596f7c07be13c => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:42:12.038370 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439a6f7c-6fa5-4310-9dfb-026691e52872 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:12.038668 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439a6f7c-6fa5-4310-9dfb-026691e52872 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:12.038975 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439a6f7c-6fa5-4310-9dfb-026691e52872 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:12.100570 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e271ad-c056-41d6-9e67-224916353dfb None None] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:12.219703 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c086de-b664-44a3-93ca-fdb3d1c9f273 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b68eed985c7b49839bcdd173186ad4ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfe93ee8d32a441295efc0b885de4bd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:12.220936 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c086de-b664-44a3-93ca-fdb3d1c9f273 service neutron] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:12.221281 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c086de-b664-44a3-93ca-fdb3d1c9f273 service neutron] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:12.221561 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c086de-b664-44a3-93ca-fdb3d1c9f273 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:12.349525 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-439a6f7c-6fa5-4310-9dfb-026691e52872 None None] MFA Rules not processed for user `5ef66a30ed954d5c84dbb0575a28d9ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:42:12.350842 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-439a6f7c-6fa5-4310-9dfb-026691e52872 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:42:12.371634 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c086de-b664-44a3-93ca-fdb3d1c9f273 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:12.375979 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c086de-b664-44a3-93ca-fdb3d1c9f273 service neutron] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:12.418193 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 890/1796] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 14:42:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 491 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 14:42:12.488483 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 907/1797] 10.222.0.67 () {58 vars in 957 bytes} [Wed May 25 14:42:12 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 451 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:42:12.503374 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c086de-b664-44a3-93ca-fdb3d1c9f273 service neutron] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:12.504937 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-a1c086de-b664-44a3-93ca-fdb3d1c9f273 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:42:12.581226 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:12.604472 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c086de-b664-44a3-93ca-fdb3d1c9f273 service neutron] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:12.609267 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e05be8-7876-4f38-8855-40e5a6bb72d3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e462acc9da84a61bb23998dd54e1858', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfe93ee8d32a441295efc0b885de4bd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:12.610190 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e05be8-7876-4f38-8855-40e5a6bb72d3 service cinder] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:12.610952 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e05be8-7876-4f38-8855-40e5a6bb72d3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:12.612034 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e05be8-7876-4f38-8855-40e5a6bb72d3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:12.632447 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e05be8-7876-4f38-8855-40e5a6bb72d3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:12.634338 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e05be8-7876-4f38-8855-40e5a6bb72d3 service cinder] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:12.646239 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfb129b-a227-4ac3-860f-4c55c16d9780 None None] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:12.647621 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfb129b-a227-4ac3-860f-4c55c16d9780 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:12.648266 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfb129b-a227-4ac3-860f-4c55c16d9780 None None] PATH_INFO: `/` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:12.650401 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 908/1798] 10.222.0.67 () {54 vars in 921 bytes} [Wed May 25 14:42:12 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:42:12.650877 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 891/1799] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 14:42:12 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:42:12.666188 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e510025-7734-406c-89e4-d415c0a2f5ee None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:12.666704 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e510025-7734-406c-89e4-d415c0a2f5ee None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:12.667237 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e510025-7734-406c-89e4-d415c0a2f5ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:12.742762 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-2e510025-7734-406c-89e4-d415c0a2f5ee None None] MFA Rules not processed for user `428ec99478284743943ed41e9d24a603`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:42:12.753241 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-2e510025-7734-406c-89e4-d415c0a2f5ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:42:12.777800 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:12.874558 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e05be8-7876-4f38-8855-40e5a6bb72d3 service cinder] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:12.884635 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e05be8-7876-4f38-8855-40e5a6bb72d3 service cinder] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:12.890865 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f61f6f-1ecb-4102-aa68-8607987504ca service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e462acc9da84a61bb23998dd54e1858', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfe93ee8d32a441295efc0b885de4bd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:12.893076 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f61f6f-1ecb-4102-aa68-8607987504ca service cinder] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:12.893390 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f61f6f-1ecb-4102-aa68-8607987504ca service cinder] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:12.893919 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f61f6f-1ecb-4102-aa68-8607987504ca service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:12.896807 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-e6f61f6f-1ecb-4102-aa68-8607987504ca service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:42:12.907992 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 909/1800] 10.222.0.67 () {58 vars in 1018 bytes} [Wed May 25 14:42:12 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:42:12.924611 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e510025-7734-406c-89e4-d415c0a2f5ee None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:12.926743 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-2e510025-7734-406c-89e4-d415c0a2f5ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:42:12.945604 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e510025-7734-406c-89e4-d415c0a2f5ee None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:12.956527 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f817c74c-8dcb-4c8a-bde6-684d7694795d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '428ec99478284743943ed41e9d24a603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfe93ee8d32a441295efc0b885de4bd7', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:12.957786 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f817c74c-8dcb-4c8a-bde6-684d7694795d service nova] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:12.958833 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f817c74c-8dcb-4c8a-bde6-684d7694795d service nova] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:12.959357 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f817c74c-8dcb-4c8a-bde6-684d7694795d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:12.972868 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f817c74c-8dcb-4c8a-bde6-684d7694795d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:12.975068 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f817c74c-8dcb-4c8a-bde6-684d7694795d service nova] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:12.993925 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 910/1801] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 14:42:12 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:42:13.086396 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f61f6f-1ecb-4102-aa68-8607987504ca service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:13.088139 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f61f6f-1ecb-4102-aa68-8607987504ca service cinder] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:13.126179 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 892/1802] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 14:42:12 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 14:42:14.369746 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f817c74c-8dcb-4c8a-bde6-684d7694795d service nova] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:14.371349 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-f817c74c-8dcb-4c8a-bde6-684d7694795d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:42:14.397109 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f817c74c-8dcb-4c8a-bde6-684d7694795d service nova] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:14.410585 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7090a2bf-94ad-4e3c-a644-f5ae0f3061b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:14.411511 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7090a2bf-94ad-4e3c-a644-f5ae0f3061b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:14.411803 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7090a2bf-94ad-4e3c-a644-f5ae0f3061b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:14.412092 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7090a2bf-94ad-4e3c-a644-f5ae0f3061b2 admin admin] PATH_INFO: `/v3/projects/390d458d9bf645f5bd727c1ec9d7ff62` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:14.413338 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7090a2bf-94ad-4e3c-a644-f5ae0f3061b2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=390d458d9bf645f5bd727c1ec9d7ff62)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:14.415304 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7090a2bf-94ad-4e3c-a644-f5ae0f3061b2 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:14.541520 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-7090a2bf-94ad-4e3c-a644-f5ae0f3061b2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '390d458d9bf645f5bd727c1ec9d7ff62', 'request_id': 'req-7090a2bf-94ad-4e3c-a644-f5ae0f3061b2'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:42:14.554040 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-7090a2bf-94ad-4e3c-a644-f5ae0f3061b2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '390d458d9bf645f5bd727c1ec9d7ff62', 'request_id': 'req-7090a2bf-94ad-4e3c-a644-f5ae0f3061b2'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:42:14.573253 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-7090a2bf-94ad-4e3c-a644-f5ae0f3061b2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '390d458d9bf645f5bd727c1ec9d7ff62', 'request_id': 'req-7090a2bf-94ad-4e3c-a644-f5ae0f3061b2'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:42:14.651375 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-7090a2bf-94ad-4e3c-a644-f5ae0f3061b2 admin admin] The token cache is being invalidate because project 390d458d9bf645f5bd727c1ec9d7ff62 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80475) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 14:42:14.651675 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-7090a2bf-94ad-4e3c-a644-f5ae0f3061b2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:42:14.654624 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-7090a2bf-94ad-4e3c-a644-f5ae0f3061b2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:42:14.661873 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f61f6f-1ecb-4102-aa68-8607987504ca service cinder] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:14.663093 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 911/1803] 10.222.0.67 () {58 vars in 1232 bytes} [Wed May 25 14:42:14 2022] DELETE /identity/v3/projects/390d458d9bf645f5bd727c1ec9d7ff62 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:42:14.679315 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f61f6f-1ecb-4102-aa68-8607987504ca service cinder] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:14.820985 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b6e584-9099-4ac7-b2e7-23b9d84cdbca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:14.821908 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b6e584-9099-4ac7-b2e7-23b9d84cdbca admin admin] REQUEST_METHOD: `DELETE` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:14.822199 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b6e584-9099-4ac7-b2e7-23b9d84cdbca admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:14.822483 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b6e584-9099-4ac7-b2e7-23b9d84cdbca admin admin] PATH_INFO: `/v3/users/bcf1a2361bea4f6d9a65da8a6629819d` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:14.832307 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b6e584-9099-4ac7-b2e7-23b9d84cdbca admin admin] RBAC: Authorizing `identity:delete_user(user_id=bcf1a2361bea4f6d9a65da8a6629819d)` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:14.834574 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b6e584-9099-4ac7-b2e7-23b9d84cdbca admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:14.953633 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-a1b6e584-9099-4ac7-b2e7-23b9d84cdbca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bcf1a2361bea4f6d9a65da8a6629819d'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:42:14.954378 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-a1b6e584-9099-4ac7-b2e7-23b9d84cdbca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bcf1a2361bea4f6d9a65da8a6629819d'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:42:14.959434 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-a1b6e584-9099-4ac7-b2e7-23b9d84cdbca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bcf1a2361bea4f6d9a65da8a6629819d'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:42:14.990544 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-a1b6e584-9099-4ac7-b2e7-23b9d84cdbca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bcf1a2361bea4f6d9a65da8a6629819d'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:42:15.002080 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-a1b6e584-9099-4ac7-b2e7-23b9d84cdbca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bcf1a2361bea4f6d9a65da8a6629819d'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:42:15.042781 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 893/1804] 10.222.0.67 () {58 vars in 1223 bytes} [Wed May 25 14:42:14 2022] DELETE /identity/v3/users/bcf1a2361bea4f6d9a65da8a6629819d => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:42:16.024663 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0494a4fa-d1d8-4586-ab02-d21894697919 None None] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:16.025433 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0494a4fa-d1d8-4586-ab02-d21894697919 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:16.025433 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0494a4fa-d1d8-4586-ab02-d21894697919 None None] PATH_INFO: `/` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:16.027186 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 912/1805] 10.222.0.67 () {54 vars in 921 bytes} [Wed May 25 14:42:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:42:16.460363 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d0a7f9-0b41-4068-b381-fd4f9bb51fc9 None None] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:16.461288 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d0a7f9-0b41-4068-b381-fd4f9bb51fc9 None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:16.461806 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d0a7f9-0b41-4068-b381-fd4f9bb51fc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:16.469627 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:16.501255 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.auth.core [None req-93d0a7f9-0b41-4068-b381-fd4f9bb51fc9 None None] MFA Rules not processed for user `428ec99478284743943ed41e9d24a603`. Rule list: `[]` (Enabled: `True`). {{(pid=80474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:42:16.503551 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-93d0a7f9-0b41-4068-b381-fd4f9bb51fc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:42:16.597060 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 894/1806] 10.222.0.67 () {58 vars in 1018 bytes} [Wed May 25 14:42:16 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:42:16.626135 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0494a4fa-d1d8-4586-ab02-d21894697919 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:16.628810 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-0494a4fa-d1d8-4586-ab02-d21894697919 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:42:16.660035 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0494a4fa-d1d8-4586-ab02-d21894697919 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:16.668696 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b5e672-424d-473a-99eb-fbf0355652a6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '428ec99478284743943ed41e9d24a603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfe93ee8d32a441295efc0b885de4bd7', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:16.669715 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b5e672-424d-473a-99eb-fbf0355652a6 service nova] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:16.669988 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b5e672-424d-473a-99eb-fbf0355652a6 service nova] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:16.670508 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b5e672-424d-473a-99eb-fbf0355652a6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:16.686407 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b5e672-424d-473a-99eb-fbf0355652a6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:16.688303 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b5e672-424d-473a-99eb-fbf0355652a6 service nova] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:16.701037 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 913/1807] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 14:42:16 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:42:17.128329 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d0a7f9-0b41-4068-b381-fd4f9bb51fc9 None None] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:17.132198 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-93d0a7f9-0b41-4068-b381-fd4f9bb51fc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:42:17.307290 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d0a7f9-0b41-4068-b381-fd4f9bb51fc9 None None] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:17.320139 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7082a9f6-b71e-4966-8983-90ca97b49572 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:17.321523 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7082a9f6-b71e-4966-8983-90ca97b49572 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:17.322054 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7082a9f6-b71e-4966-8983-90ca97b49572 admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:17.322553 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7082a9f6-b71e-4966-8983-90ca97b49572 admin admin] PATH_INFO: `/v3/projects/8ee6511fc80840c68b1d6ab69be7a234` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:17.324666 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7082a9f6-b71e-4966-8983-90ca97b49572 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8ee6511fc80840c68b1d6ab69be7a234)` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:17.327364 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7082a9f6-b71e-4966-8983-90ca97b49572 admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:17.490491 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-7082a9f6-b71e-4966-8983-90ca97b49572 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8ee6511fc80840c68b1d6ab69be7a234', 'request_id': 'req-7082a9f6-b71e-4966-8983-90ca97b49572'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:42:17.511747 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-7082a9f6-b71e-4966-8983-90ca97b49572 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8ee6511fc80840c68b1d6ab69be7a234', 'request_id': 'req-7082a9f6-b71e-4966-8983-90ca97b49572'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:42:17.526841 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-7082a9f6-b71e-4966-8983-90ca97b49572 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8ee6511fc80840c68b1d6ab69be7a234', 'request_id': 'req-7082a9f6-b71e-4966-8983-90ca97b49572'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:42:17.541993 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-7082a9f6-b71e-4966-8983-90ca97b49572 admin admin] The token cache is being invalidate because project 8ee6511fc80840c68b1d6ab69be7a234 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80474) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 14:42:17.542638 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-7082a9f6-b71e-4966-8983-90ca97b49572 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:42:17.543941 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-7082a9f6-b71e-4966-8983-90ca97b49572 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:42:17.550792 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 895/1808] 10.222.0.67 () {58 vars in 1232 bytes} [Wed May 25 14:42:17 2022] DELETE /identity/v3/projects/8ee6511fc80840c68b1d6ab69be7a234 => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:42:17.554950 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2399babe-2dee-4f64-b1a3-4992f5b99799 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:17.556007 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2399babe-2dee-4f64-b1a3-4992f5b99799 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:17.556599 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2399babe-2dee-4f64-b1a3-4992f5b99799 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:17.602220 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-2399babe-2dee-4f64-b1a3-4992f5b99799 None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:42:17.605087 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-2399babe-2dee-4f64-b1a3-4992f5b99799 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:42:17.770586 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:17.816734 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 914/1809] 10.222.0.67 () {58 vars in 957 bytes} [Wed May 25 14:42:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:42:17.828398 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce27028-1a0e-4ea0-9ce7-2fc1b951c213 None None] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:17.829111 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce27028-1a0e-4ea0-9ce7-2fc1b951c213 None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:17.829606 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce27028-1a0e-4ea0-9ce7-2fc1b951c213 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:17.872071 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.auth.core [None req-bce27028-1a0e-4ea0-9ce7-2fc1b951c213 None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:42:17.872071 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-bce27028-1a0e-4ea0-9ce7-2fc1b951c213 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:42:17.881567 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 896/1810] 10.222.0.67 () {58 vars in 957 bytes} [Wed May 25 14:42:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:42:17.886094 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2399babe-2dee-4f64-b1a3-4992f5b99799 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:17.904107 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2399babe-2dee-4f64-b1a3-4992f5b99799 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:17.921020 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946f99ba-06b8-46e6-832c-ca0aa9d8981b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:17.922512 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946f99ba-06b8-46e6-832c-ca0aa9d8981b admin admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:17.923249 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946f99ba-06b8-46e6-832c-ca0aa9d8981b admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:17.924248 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946f99ba-06b8-46e6-832c-ca0aa9d8981b admin admin] PATH_INFO: `/v3/domains` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:17.927932 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946f99ba-06b8-46e6-832c-ca0aa9d8981b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:42:17.928477 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946f99ba-06b8-46e6-832c-ca0aa9d8981b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:17.930314 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946f99ba-06b8-46e6-832c-ca0aa9d8981b admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:17.985266 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 915/1811] 10.222.0.67 () {58 vars in 1152 bytes} [Wed May 25 14:42:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:42:17.990559 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce27028-1a0e-4ea0-9ce7-2fc1b951c213 None None] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:18.014316 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce27028-1a0e-4ea0-9ce7-2fc1b951c213 None None] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:18.038519 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e955ef04-2be9-40ab-957b-ea8768d9e351 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:18.039570 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e955ef04-2be9-40ab-957b-ea8768d9e351 admin admin] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:18.039963 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e955ef04-2be9-40ab-957b-ea8768d9e351 admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:18.040370 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e955ef04-2be9-40ab-957b-ea8768d9e351 admin admin] PATH_INFO: `/v3/projects` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:18.041412 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e955ef04-2be9-40ab-957b-ea8768d9e351 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:18.044398 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e955ef04-2be9-40ab-957b-ea8768d9e351 admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:18.076416 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:18.106819 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 897/1812] 10.222.0.67 () {60 vars in 1152 bytes} [Wed May 25 14:42:17 2022] POST /identity/v3/projects => generated 367 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:42:18.107667 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946f99ba-06b8-46e6-832c-ca0aa9d8981b admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:18.120334 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946f99ba-06b8-46e6-832c-ca0aa9d8981b admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:18.125715 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e955ef04-2be9-40ab-957b-ea8768d9e351 admin admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:18.128588 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-e955ef04-2be9-40ab-957b-ea8768d9e351 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:42:18.225291 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e955ef04-2be9-40ab-957b-ea8768d9e351 admin admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:18.233995 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fa29f9-c3bf-46a9-a0c2-f69f2360a6e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:18.235358 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516edc80-fca3-46ad-bbed-e8be11f23373 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:18.236414 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fa29f9-c3bf-46a9-a0c2-f69f2360a6e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:18.237924 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fa29f9-c3bf-46a9-a0c2-f69f2360a6e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:18.238220 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fa29f9-c3bf-46a9-a0c2-f69f2360a6e5 admin admin] PATH_INFO: `/v3/users/1f5e6a832b34498ab2fbd30c1d67f39e` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:18.239912 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fa29f9-c3bf-46a9-a0c2-f69f2360a6e5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1f5e6a832b34498ab2fbd30c1d67f39e)` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:18.240243 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516edc80-fca3-46ad-bbed-e8be11f23373 admin admin] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:18.240772 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516edc80-fca3-46ad-bbed-e8be11f23373 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:18.241252 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516edc80-fca3-46ad-bbed-e8be11f23373 admin admin] PATH_INFO: `/v3/users` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:18.241967 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fa29f9-c3bf-46a9-a0c2-f69f2360a6e5 admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:18.242176 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516edc80-fca3-46ad-bbed-e8be11f23373 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:18.244188 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516edc80-fca3-46ad-bbed-e8be11f23373 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:18.275630 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 916/1813] 10.222.0.67 () {60 vars in 1143 bytes} [Wed May 25 14:42:18 2022] POST /identity/v3/users => generated 284 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:42:18.280130 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516edc80-fca3-46ad-bbed-e8be11f23373 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:18.296711 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516edc80-fca3-46ad-bbed-e8be11f23373 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:18.307333 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74abd0cc-9a5d-4ca1-b005-d9c5d1d45665 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:18.308019 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74abd0cc-9a5d-4ca1-b005-d9c5d1d45665 admin admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:18.308303 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74abd0cc-9a5d-4ca1-b005-d9c5d1d45665 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:18.308581 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74abd0cc-9a5d-4ca1-b005-d9c5d1d45665 admin admin] PATH_INFO: `/v3/roles` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:18.309311 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74abd0cc-9a5d-4ca1-b005-d9c5d1d45665 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:18.313699 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74abd0cc-9a5d-4ca1-b005-d9c5d1d45665 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:18.327447 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 917/1814] 10.222.0.67 () {58 vars in 1121 bytes} [Wed May 25 14:42:18 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:42:18.332075 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74abd0cc-9a5d-4ca1-b005-d9c5d1d45665 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:18.343967 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-e7fa29f9-c3bf-46a9-a0c2-f69f2360a6e5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1f5e6a832b34498ab2fbd30c1d67f39e'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:42:18.344860 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-e7fa29f9-c3bf-46a9-a0c2-f69f2360a6e5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1f5e6a832b34498ab2fbd30c1d67f39e'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:42:18.345531 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-e7fa29f9-c3bf-46a9-a0c2-f69f2360a6e5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1f5e6a832b34498ab2fbd30c1d67f39e'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:42:18.346006 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74abd0cc-9a5d-4ca1-b005-d9c5d1d45665 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:18.357137 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a232c430-4cb3-4269-a67c-39276964d396 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:18.357960 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a232c430-4cb3-4269-a67c-39276964d396 admin admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:18.358310 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a232c430-4cb3-4269-a67c-39276964d396 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:18.358834 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a232c430-4cb3-4269-a67c-39276964d396 admin admin] PATH_INFO: `/v3/roles` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:18.359722 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a232c430-4cb3-4269-a67c-39276964d396 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:18.362653 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a232c430-4cb3-4269-a67c-39276964d396 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:18.363862 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-e7fa29f9-c3bf-46a9-a0c2-f69f2360a6e5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1f5e6a832b34498ab2fbd30c1d67f39e'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:42:18.373404 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 918/1815] 10.222.0.67 () {58 vars in 1121 bytes} [Wed May 25 14:42:18 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:42:18.378884 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a232c430-4cb3-4269-a67c-39276964d396 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:18.381070 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-a232c430-4cb3-4269-a67c-39276964d396 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:42:18.385046 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-e7fa29f9-c3bf-46a9-a0c2-f69f2360a6e5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1f5e6a832b34498ab2fbd30c1d67f39e'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:42:18.395391 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a232c430-4cb3-4269-a67c-39276964d396 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:18.400948 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b452f1c-6206-4a37-ba97-40d6fc5b2ef0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:18.401857 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b452f1c-6206-4a37-ba97-40d6fc5b2ef0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:18.402266 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b452f1c-6206-4a37-ba97-40d6fc5b2ef0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:18.402618 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b452f1c-6206-4a37-ba97-40d6fc5b2ef0 admin admin] PATH_INFO: `/v3/projects/3f1e57776a834295bf5bea465145b3b0/users/9e912c577abb45bc91987d7214e6d7d7/roles/48808901834b4d5eab2c7e6b5b03791e` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:18.403700 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 898/1816] 10.222.0.67 () {58 vars in 1223 bytes} [Wed May 25 14:42:18 2022] DELETE /identity/v3/users/1f5e6a832b34498ab2fbd30c1d67f39e => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:42:18.409056 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1abd951-7267-4e20-a8bf-1988161b89e5 None None] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:18.409356 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1abd951-7267-4e20-a8bf-1988161b89e5 None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:18.409644 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1abd951-7267-4e20-a8bf-1988161b89e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:18.419741 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b452f1c-6206-4a37-ba97-40d6fc5b2ef0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f1e57776a834295bf5bea465145b3b0, user_id=9e912c577abb45bc91987d7214e6d7d7, role_id=48808901834b4d5eab2c7e6b5b03791e)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:18.422421 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b452f1c-6206-4a37-ba97-40d6fc5b2ef0 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:18.432295 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.auth.core [None req-f1abd951-7267-4e20-a8bf-1988161b89e5 None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:42:18.433546 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-f1abd951-7267-4e20-a8bf-1988161b89e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:42:18.438744 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 919/1817] 10.222.0.67 () {60 vars in 1482 bytes} [Wed May 25 14:42:18 2022] PUT /identity/v3/projects/3f1e57776a834295bf5bea465145b3b0/users/9e912c577abb45bc91987d7214e6d7d7/roles/48808901834b4d5eab2c7e6b5b03791e => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 14:42:18.450331 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ff8e7e-e2cd-4bd7-992c-b14f61498267 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:18.450622 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ff8e7e-e2cd-4bd7-992c-b14f61498267 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:18.450902 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ff8e7e-e2cd-4bd7-992c-b14f61498267 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:18.490979 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-59ff8e7e-e2cd-4bd7-992c-b14f61498267 None None] MFA Rules not processed for user `9e912c577abb45bc91987d7214e6d7d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:42:18.492461 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-59ff8e7e-e2cd-4bd7-992c-b14f61498267 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:42:18.522276 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 899/1818] 10.222.0.67 () {58 vars in 957 bytes} [Wed May 25 14:42:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:42:18.529166 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1abd951-7267-4e20-a8bf-1988161b89e5 None None] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:18.531165 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-f1abd951-7267-4e20-a8bf-1988161b89e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:42:18.555695 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:18.611431 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 920/1819] 10.222.0.67 () {58 vars in 957 bytes} [Wed May 25 14:42:18 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 14:42:18.616285 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1abd951-7267-4e20-a8bf-1988161b89e5 None None] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:18.618129 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ff8e7e-e2cd-4bd7-992c-b14f61498267 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:18.622037 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91232e1d-febe-4495-bd9f-03833e3a29ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b68eed985c7b49839bcdd173186ad4ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfe93ee8d32a441295efc0b885de4bd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:18.622700 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91232e1d-febe-4495-bd9f-03833e3a29ed service neutron] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:18.623058 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91232e1d-febe-4495-bd9f-03833e3a29ed service neutron] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:18.623487 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91232e1d-febe-4495-bd9f-03833e3a29ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:18.638617 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ff8e7e-e2cd-4bd7-992c-b14f61498267 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:18.644524 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91232e1d-febe-4495-bd9f-03833e3a29ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:18.646224 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91232e1d-febe-4495-bd9f-03833e3a29ed service neutron] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:18.648211 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443394a3-4ef1-4fcd-b074-57078bc5fba1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:18.651341 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443394a3-4ef1-4fcd-b074-57078bc5fba1 admin admin] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:18.651636 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443394a3-4ef1-4fcd-b074-57078bc5fba1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:18.653294 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443394a3-4ef1-4fcd-b074-57078bc5fba1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:18.654034 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443394a3-4ef1-4fcd-b074-57078bc5fba1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:18.659119 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 900/1820] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 14:42:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:42:18.662486 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443394a3-4ef1-4fcd-b074-57078bc5fba1 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:18.694211 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:18.700759 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 921/1821] 10.222.0.67 () {60 vars in 1152 bytes} [Wed May 25 14:42:18 2022] POST /identity/v3/projects => generated 365 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:42:18.701094 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91232e1d-febe-4495-bd9f-03833e3a29ed service neutron] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:18.716740 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91232e1d-febe-4495-bd9f-03833e3a29ed service neutron] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:18.809798 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f32a85-c8fa-4e01-be78-e39f9cbedf65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:18.810816 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f32a85-c8fa-4e01-be78-e39f9cbedf65 admin admin] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:18.811336 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f32a85-c8fa-4e01-be78-e39f9cbedf65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:18.811764 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f32a85-c8fa-4e01-be78-e39f9cbedf65 admin admin] PATH_INFO: `/v3/users` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:18.812699 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f32a85-c8fa-4e01-be78-e39f9cbedf65 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:18.815472 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f32a85-c8fa-4e01-be78-e39f9cbedf65 admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:18.843083 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 901/1822] 10.222.0.67 () {60 vars in 1143 bytes} [Wed May 25 14:42:18 2022] POST /identity/v3/users => generated 289 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 14:42:18.847840 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443394a3-4ef1-4fcd-b074-57078bc5fba1 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:18.897826 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443394a3-4ef1-4fcd-b074-57078bc5fba1 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:18.919856 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01655f3f-9fb4-4a24-8160-2105df6de5ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:18.920685 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01655f3f-9fb4-4a24-8160-2105df6de5ab admin admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:18.921042 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01655f3f-9fb4-4a24-8160-2105df6de5ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:18.921384 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01655f3f-9fb4-4a24-8160-2105df6de5ab admin admin] PATH_INFO: `/v3/roles` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:18.922202 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01655f3f-9fb4-4a24-8160-2105df6de5ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:18.927878 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01655f3f-9fb4-4a24-8160-2105df6de5ab admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:18.952650 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 922/1823] 10.222.0.67 () {58 vars in 1121 bytes} [Wed May 25 14:42:18 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 25 14:42:18.971831 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f32a85-c8fa-4e01-be78-e39f9cbedf65 admin admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:19.004815 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f32a85-c8fa-4e01-be78-e39f9cbedf65 admin admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:19.022898 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b931b6-b1b6-4013-a7ae-86e031c73c61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:19.033136 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b931b6-b1b6-4013-a7ae-86e031c73c61 admin admin] REQUEST_METHOD: `PUT` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:19.033808 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b931b6-b1b6-4013-a7ae-86e031c73c61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:19.034248 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b931b6-b1b6-4013-a7ae-86e031c73c61 admin admin] PATH_INFO: `/v3/projects/c5a92c9986fa4a37993ad91bb4344cb0/users/7953b8664b334b5aaf100484ccdba23d/roles/399893e19eac4ab5a8e596f7c07be13c` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:19.075275 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b931b6-b1b6-4013-a7ae-86e031c73c61 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c5a92c9986fa4a37993ad91bb4344cb0, user_id=7953b8664b334b5aaf100484ccdba23d, role_id=399893e19eac4ab5a8e596f7c07be13c)` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:19.079308 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b931b6-b1b6-4013-a7ae-86e031c73c61 admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:19.113269 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 902/1824] 10.222.0.67 () {60 vars in 1482 bytes} [Wed May 25 14:42:18 2022] PUT /identity/v3/projects/c5a92c9986fa4a37993ad91bb4344cb0/users/7953b8664b334b5aaf100484ccdba23d/roles/399893e19eac4ab5a8e596f7c07be13c => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:42:19.117153 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01655f3f-9fb4-4a24-8160-2105df6de5ab admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:19.134452 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01655f3f-9fb4-4a24-8160-2105df6de5ab admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:19.291659 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec470b49-7552-445e-8d25-270425f8de3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:19.292366 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec470b49-7552-445e-8d25-270425f8de3d admin admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:19.292656 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec470b49-7552-445e-8d25-270425f8de3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:19.292941 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec470b49-7552-445e-8d25-270425f8de3d admin admin] PATH_INFO: `/v3/roles` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:19.294129 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec470b49-7552-445e-8d25-270425f8de3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:19.296083 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec470b49-7552-445e-8d25-270425f8de3d admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:19.308303 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 923/1825] 10.222.0.67 () {58 vars in 1121 bytes} [Wed May 25 14:42:19 2022] GET /identity/v3/roles => generated 1420 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:42:19.314945 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b931b6-b1b6-4013-a7ae-86e031c73c61 admin admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:19.330483 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b931b6-b1b6-4013-a7ae-86e031c73c61 admin admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:19.338920 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63982f7e-61f5-43c8-b4d4-99d9ec003fa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:19.339981 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63982f7e-61f5-43c8-b4d4-99d9ec003fa5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:19.340271 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63982f7e-61f5-43c8-b4d4-99d9ec003fa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:19.340550 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63982f7e-61f5-43c8-b4d4-99d9ec003fa5 admin admin] PATH_INFO: `/v3/projects/c5a92c9986fa4a37993ad91bb4344cb0/users/7953b8664b334b5aaf100484ccdba23d/roles/399893e19eac4ab5a8e596f7c07be13c` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:19.343425 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63982f7e-61f5-43c8-b4d4-99d9ec003fa5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c5a92c9986fa4a37993ad91bb4344cb0, user_id=7953b8664b334b5aaf100484ccdba23d, role_id=399893e19eac4ab5a8e596f7c07be13c)` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:19.348300 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63982f7e-61f5-43c8-b4d4-99d9ec003fa5 admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:19.365422 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 903/1826] 10.222.0.67 () {60 vars in 1482 bytes} [Wed May 25 14:42:19 2022] PUT /identity/v3/projects/c5a92c9986fa4a37993ad91bb4344cb0/users/7953b8664b334b5aaf100484ccdba23d/roles/399893e19eac4ab5a8e596f7c07be13c => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:42:19.377733 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a600c00-115f-45f8-9a01-5e4066768873 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:19.378311 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a600c00-115f-45f8-9a01-5e4066768873 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:19.379240 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a600c00-115f-45f8-9a01-5e4066768873 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:19.417529 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-8a600c00-115f-45f8-9a01-5e4066768873 None None] MFA Rules not processed for user `7953b8664b334b5aaf100484ccdba23d`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:42:19.419024 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-8a600c00-115f-45f8-9a01-5e4066768873 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:42:19.537287 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 924/1827] 10.222.0.67 () {58 vars in 957 bytes} [Wed May 25 14:42:19 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:42:19.545715 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63982f7e-61f5-43c8-b4d4-99d9ec003fa5 admin admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:19.548796 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-63982f7e-61f5-43c8-b4d4-99d9ec003fa5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:42:19.629309 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a600c00-115f-45f8-9a01-5e4066768873 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:19.631602 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-8a600c00-115f-45f8-9a01-5e4066768873 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:42:19.703268 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63982f7e-61f5-43c8-b4d4-99d9ec003fa5 admin admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:19.711423 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7963fa-9303-4d42-8efa-7dd679813552 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e462acc9da84a61bb23998dd54e1858', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfe93ee8d32a441295efc0b885de4bd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:19.713561 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7963fa-9303-4d42-8efa-7dd679813552 service cinder] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:19.713978 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7963fa-9303-4d42-8efa-7dd679813552 service cinder] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:19.714452 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7963fa-9303-4d42-8efa-7dd679813552 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:19.761899 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7963fa-9303-4d42-8efa-7dd679813552 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:19.763855 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7963fa-9303-4d42-8efa-7dd679813552 service cinder] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:19.782384 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 904/1828] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 14:42:19 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:42:19.891959 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a600c00-115f-45f8-9a01-5e4066768873 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:19.897700 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6c1bb3-84b3-4eaf-9a13-48992a9010bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:19.898629 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6c1bb3-84b3-4eaf-9a13-48992a9010bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:19.898920 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6c1bb3-84b3-4eaf-9a13-48992a9010bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:19.899237 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6c1bb3-84b3-4eaf-9a13-48992a9010bd admin admin] PATH_INFO: `/v3/projects/224c798737384a04abd947f1ba66e17e` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:19.900971 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6c1bb3-84b3-4eaf-9a13-48992a9010bd admin admin] RBAC: Authorizing `identity:delete_project(project_id=224c798737384a04abd947f1ba66e17e)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:19.903619 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6c1bb3-84b3-4eaf-9a13-48992a9010bd admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:19.946875 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:20.025562 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7963fa-9303-4d42-8efa-7dd679813552 service cinder] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:20.039269 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7963fa-9303-4d42-8efa-7dd679813552 service cinder] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:20.052328 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:20.053716 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-cb6c1bb3-84b3-4eaf-9a13-48992a9010bd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '224c798737384a04abd947f1ba66e17e', 'request_id': 'req-cb6c1bb3-84b3-4eaf-9a13-48992a9010bd'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:42:20.068577 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-cb6c1bb3-84b3-4eaf-9a13-48992a9010bd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '224c798737384a04abd947f1ba66e17e', 'request_id': 'req-cb6c1bb3-84b3-4eaf-9a13-48992a9010bd'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:42:20.083019 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-cb6c1bb3-84b3-4eaf-9a13-48992a9010bd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '224c798737384a04abd947f1ba66e17e', 'request_id': 'req-cb6c1bb3-84b3-4eaf-9a13-48992a9010bd'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:42:20.112550 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-cb6c1bb3-84b3-4eaf-9a13-48992a9010bd admin admin] The token cache is being invalidate because project 224c798737384a04abd947f1ba66e17e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80475) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 14:42:20.112755 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-cb6c1bb3-84b3-4eaf-9a13-48992a9010bd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:42:20.113575 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-cb6c1bb3-84b3-4eaf-9a13-48992a9010bd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:42:20.115649 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 925/1829] 10.222.0.67 () {58 vars in 1232 bytes} [Wed May 25 14:42:19 2022] DELETE /identity/v3/projects/224c798737384a04abd947f1ba66e17e => generated 0 bytes in 489 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 14:42:20.119792 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6c1bb3-84b3-4eaf-9a13-48992a9010bd admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:20.121927 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-cb6c1bb3-84b3-4eaf-9a13-48992a9010bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:42:20.128615 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4568b7f-2c11-4e3f-aa61-d0a85d5bdbca service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e462acc9da84a61bb23998dd54e1858', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfe93ee8d32a441295efc0b885de4bd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:20.129290 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4568b7f-2c11-4e3f-aa61-d0a85d5bdbca service cinder] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:20.129581 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4568b7f-2c11-4e3f-aa61-d0a85d5bdbca service cinder] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:20.129865 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4568b7f-2c11-4e3f-aa61-d0a85d5bdbca service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:20.132629 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-f4568b7f-2c11-4e3f-aa61-d0a85d5bdbca service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:42:20.221455 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6c1bb3-84b3-4eaf-9a13-48992a9010bd admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:20.227918 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01b7538-77f2-4b58-af30-fb9d52e2c93c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:20.228951 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01b7538-77f2-4b58-af30-fb9d52e2c93c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:20.229241 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01b7538-77f2-4b58-af30-fb9d52e2c93c admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:20.229528 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01b7538-77f2-4b58-af30-fb9d52e2c93c admin admin] PATH_INFO: `/v3/users/5ef66a30ed954d5c84dbb0575a28d9ec` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:20.233261 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01b7538-77f2-4b58-af30-fb9d52e2c93c admin admin] RBAC: Authorizing `identity:delete_user(user_id=5ef66a30ed954d5c84dbb0575a28d9ec)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:20.235563 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01b7538-77f2-4b58-af30-fb9d52e2c93c admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:20.277500 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4568b7f-2c11-4e3f-aa61-d0a85d5bdbca service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:20.279848 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4568b7f-2c11-4e3f-aa61-d0a85d5bdbca service cinder] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:20.293124 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 905/1830] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 14:42:20 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 269 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 14:42:20.307086 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-a01b7538-77f2-4b58-af30-fb9d52e2c93c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5ef66a30ed954d5c84dbb0575a28d9ec'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:42:20.316938 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-a01b7538-77f2-4b58-af30-fb9d52e2c93c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5ef66a30ed954d5c84dbb0575a28d9ec'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:42:20.317751 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-a01b7538-77f2-4b58-af30-fb9d52e2c93c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5ef66a30ed954d5c84dbb0575a28d9ec'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:42:20.326494 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-a01b7538-77f2-4b58-af30-fb9d52e2c93c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5ef66a30ed954d5c84dbb0575a28d9ec'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:42:20.355896 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-a01b7538-77f2-4b58-af30-fb9d52e2c93c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5ef66a30ed954d5c84dbb0575a28d9ec'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:42:20.373095 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 926/1831] 10.222.0.67 () {58 vars in 1223 bytes} [Wed May 25 14:42:20 2022] DELETE /identity/v3/users/5ef66a30ed954d5c84dbb0575a28d9ec => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:42:20.703320 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4568b7f-2c11-4e3f-aa61-d0a85d5bdbca service cinder] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:20.706348 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-f4568b7f-2c11-4e3f-aa61-d0a85d5bdbca service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:42:20.729427 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4568b7f-2c11-4e3f-aa61-d0a85d5bdbca service cinder] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:20.771822 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01b7538-77f2-4b58-af30-fb9d52e2c93c admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:20.773588 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-a01b7538-77f2-4b58-af30-fb9d52e2c93c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:42:20.825572 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:20.868152 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d0fdaf-2779-47ef-b13a-4e0d2ca4c261 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:20.869458 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d0fdaf-2779-47ef-b13a-4e0d2ca4c261 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:20.870216 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d0fdaf-2779-47ef-b13a-4e0d2ca4c261 admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:20.870932 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d0fdaf-2779-47ef-b13a-4e0d2ca4c261 admin admin] PATH_INFO: `/v3/users/d950f4fb5962489ab534f1a4e4393225` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:20.874240 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d0fdaf-2779-47ef-b13a-4e0d2ca4c261 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d950f4fb5962489ab534f1a4e4393225)` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:20.876915 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d0fdaf-2779-47ef-b13a-4e0d2ca4c261 admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:20.927383 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01b7538-77f2-4b58-af30-fb9d52e2c93c admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:20.948880 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-d8d0fdaf-2779-47ef-b13a-4e0d2ca4c261 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd950f4fb5962489ab534f1a4e4393225'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:42:20.949768 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-d8d0fdaf-2779-47ef-b13a-4e0d2ca4c261 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd950f4fb5962489ab534f1a4e4393225'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:42:20.950220 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f58ca2-276f-44e4-bc66-f45df26f556f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:20.950593 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-d8d0fdaf-2779-47ef-b13a-4e0d2ca4c261 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd950f4fb5962489ab534f1a4e4393225'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:42:20.951853 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f58ca2-276f-44e4-bc66-f45df26f556f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:20.952321 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f58ca2-276f-44e4-bc66-f45df26f556f admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:20.952609 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f58ca2-276f-44e4-bc66-f45df26f556f admin admin] PATH_INFO: `/v3/projects/6d84f7d6c0ee4e7e9a4f33dcbe0a6529` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:20.953976 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f58ca2-276f-44e4-bc66-f45df26f556f admin admin] RBAC: Authorizing `identity:delete_project(project_id=6d84f7d6c0ee4e7e9a4f33dcbe0a6529)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:20.956158 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f58ca2-276f-44e4-bc66-f45df26f556f admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:20.968021 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-d8d0fdaf-2779-47ef-b13a-4e0d2ca4c261 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd950f4fb5962489ab534f1a4e4393225'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:42:20.974136 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:20.977197 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-d8d0fdaf-2779-47ef-b13a-4e0d2ca4c261 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd950f4fb5962489ab534f1a4e4393225'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:42:20.996959 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 906/1832] 10.222.0.67 () {58 vars in 1223 bytes} [Wed May 25 14:42:20 2022] DELETE /identity/v3/users/d950f4fb5962489ab534f1a4e4393225 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:42:21.001751 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73f4974-21e6-4b91-bc05-e4ac39821c3b None None] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:21.002039 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73f4974-21e6-4b91-bc05-e4ac39821c3b None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:21.002313 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73f4974-21e6-4b91-bc05-e4ac39821c3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:21.017089 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-37f58ca2-276f-44e4-bc66-f45df26f556f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6d84f7d6c0ee4e7e9a4f33dcbe0a6529', 'request_id': 'req-37f58ca2-276f-44e4-bc66-f45df26f556f'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:42:21.020057 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.auth.core [None req-e73f4974-21e6-4b91-bc05-e4ac39821c3b None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:42:21.021302 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-e73f4974-21e6-4b91-bc05-e4ac39821c3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:42:21.023966 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-37f58ca2-276f-44e4-bc66-f45df26f556f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6d84f7d6c0ee4e7e9a4f33dcbe0a6529', 'request_id': 'req-37f58ca2-276f-44e4-bc66-f45df26f556f'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:42:21.030906 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-37f58ca2-276f-44e4-bc66-f45df26f556f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6d84f7d6c0ee4e7e9a4f33dcbe0a6529', 'request_id': 'req-37f58ca2-276f-44e4-bc66-f45df26f556f'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:42:21.045969 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-37f58ca2-276f-44e4-bc66-f45df26f556f admin admin] The token cache is being invalidate because project 6d84f7d6c0ee4e7e9a4f33dcbe0a6529 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80475) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 14:42:21.046427 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-37f58ca2-276f-44e4-bc66-f45df26f556f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:42:21.047083 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-37f58ca2-276f-44e4-bc66-f45df26f556f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:42:21.049315 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 927/1833] 10.222.0.67 () {58 vars in 1232 bytes} [Wed May 25 14:42:20 2022] DELETE /identity/v3/projects/6d84f7d6c0ee4e7e9a4f33dcbe0a6529 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 14:42:21.056597 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0afb1c7-7230-452b-b3d4-aa3b61bacbfb None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:21.057028 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0afb1c7-7230-452b-b3d4-aa3b61bacbfb None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:21.057847 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0afb1c7-7230-452b-b3d4-aa3b61bacbfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:21.079032 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-e0afb1c7-7230-452b-b3d4-aa3b61bacbfb None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:42:21.080851 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-e0afb1c7-7230-452b-b3d4-aa3b61bacbfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:42:21.102781 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 907/1834] 10.222.0.67 () {58 vars in 957 bytes} [Wed May 25 14:42:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:42:21.135890 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73f4974-21e6-4b91-bc05-e4ac39821c3b None None] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:21.139580 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-e73f4974-21e6-4b91-bc05-e4ac39821c3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:42:21.156129 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 928/1835] 10.222.0.67 () {58 vars in 957 bytes} [Wed May 25 14:42:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 14:42:21.166646 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e93481-9a6f-4038-8c31-f5d3cf294391 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:21.167962 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e93481-9a6f-4038-8c31-f5d3cf294391 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:21.168349 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e93481-9a6f-4038-8c31-f5d3cf294391 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:21.221931 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-57e93481-9a6f-4038-8c31-f5d3cf294391 None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:42:21.226158 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-57e93481-9a6f-4038-8c31-f5d3cf294391 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:42:21.254237 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 929/1836] 10.222.0.67 () {58 vars in 957 bytes} [Wed May 25 14:42:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:42:21.258886 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e93481-9a6f-4038-8c31-f5d3cf294391 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:21.279084 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e93481-9a6f-4038-8c31-f5d3cf294391 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:21.289038 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a992e95-f82f-4159-bb8b-0bbd6f9e5001 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:21.291141 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a992e95-f82f-4159-bb8b-0bbd6f9e5001 admin admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:21.291141 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a992e95-f82f-4159-bb8b-0bbd6f9e5001 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:21.291141 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a992e95-f82f-4159-bb8b-0bbd6f9e5001 admin admin] PATH_INFO: `/v3/domains` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:21.291397 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a992e95-f82f-4159-bb8b-0bbd6f9e5001 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:42:21.292924 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a992e95-f82f-4159-bb8b-0bbd6f9e5001 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:21.293070 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73f4974-21e6-4b91-bc05-e4ac39821c3b None None] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:21.294290 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a992e95-f82f-4159-bb8b-0bbd6f9e5001 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:21.302462 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2a7246-7d99-4c72-872e-4165c89081b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b68eed985c7b49839bcdd173186ad4ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfe93ee8d32a441295efc0b885de4bd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:21.304583 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2a7246-7d99-4c72-872e-4165c89081b2 service neutron] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:21.305132 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2a7246-7d99-4c72-872e-4165c89081b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:21.305525 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2a7246-7d99-4c72-872e-4165c89081b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:21.322890 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 930/1837] 10.222.0.67 () {58 vars in 1152 bytes} [Wed May 25 14:42:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:42:21.323116 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2a7246-7d99-4c72-872e-4165c89081b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:21.323116 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2a7246-7d99-4c72-872e-4165c89081b2 service neutron] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:21.324147 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a992e95-f82f-4159-bb8b-0bbd6f9e5001 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:21.341284 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 908/1838] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 14:42:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:42:21.352377 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a992e95-f82f-4159-bb8b-0bbd6f9e5001 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:21.358534 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5e4cf4-20e7-498e-b8dd-9ea69203a0bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:21.359417 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5e4cf4-20e7-498e-b8dd-9ea69203a0bd admin admin] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:21.359695 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5e4cf4-20e7-498e-b8dd-9ea69203a0bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:21.359982 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5e4cf4-20e7-498e-b8dd-9ea69203a0bd admin admin] PATH_INFO: `/v3/projects` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:21.361190 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5e4cf4-20e7-498e-b8dd-9ea69203a0bd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:21.365405 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5e4cf4-20e7-498e-b8dd-9ea69203a0bd admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:21.421319 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 931/1839] 10.222.0.67 () {60 vars in 1152 bytes} [Wed May 25 14:42:21 2022] POST /identity/v3/projects => generated 383 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:42:21.424627 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2a7246-7d99-4c72-872e-4165c89081b2 service neutron] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:21.437521 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2a7246-7d99-4c72-872e-4165c89081b2 service neutron] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:21.531076 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11e574c-9d89-4b23-ba04-b8ce47d47973 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:21.531865 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11e574c-9d89-4b23-ba04-b8ce47d47973 admin admin] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:21.532004 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11e574c-9d89-4b23-ba04-b8ce47d47973 admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:21.532200 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11e574c-9d89-4b23-ba04-b8ce47d47973 admin admin] PATH_INFO: `/v3/users` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:21.532961 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11e574c-9d89-4b23-ba04-b8ce47d47973 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:21.535045 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11e574c-9d89-4b23-ba04-b8ce47d47973 admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:21.560195 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 909/1840] 10.222.0.67 () {60 vars in 1143 bytes} [Wed May 25 14:42:21 2022] POST /identity/v3/users => generated 292 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:42:21.565353 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5e4cf4-20e7-498e-b8dd-9ea69203a0bd admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:21.590898 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5e4cf4-20e7-498e-b8dd-9ea69203a0bd admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:21.600372 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd2dfe9-b95b-48c1-92c1-111d8fa2b1c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:21.601020 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd2dfe9-b95b-48c1-92c1-111d8fa2b1c3 admin admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:21.602631 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd2dfe9-b95b-48c1-92c1-111d8fa2b1c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:21.603424 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd2dfe9-b95b-48c1-92c1-111d8fa2b1c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:21.604886 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd2dfe9-b95b-48c1-92c1-111d8fa2b1c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:21.607738 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd2dfe9-b95b-48c1-92c1-111d8fa2b1c3 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:21.609830 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:21.675024 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 932/1841] 10.222.0.67 () {58 vars in 1121 bytes} [Wed May 25 14:42:21 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 25 14:42:21.679104 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11e574c-9d89-4b23-ba04-b8ce47d47973 admin admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:21.691923 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11e574c-9d89-4b23-ba04-b8ce47d47973 admin admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:21.698899 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0693feaf-fe49-494a-afff-f77854900661 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:21.700215 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0693feaf-fe49-494a-afff-f77854900661 admin admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:21.700711 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0693feaf-fe49-494a-afff-f77854900661 admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:21.701218 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0693feaf-fe49-494a-afff-f77854900661 admin admin] PATH_INFO: `/v3/roles` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:21.702158 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0693feaf-fe49-494a-afff-f77854900661 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:21.705366 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0693feaf-fe49-494a-afff-f77854900661 admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:21.726155 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 910/1842] 10.222.0.67 () {58 vars in 1121 bytes} [Wed May 25 14:42:21 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:42:21.726933 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd2dfe9-b95b-48c1-92c1-111d8fa2b1c3 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:21.744910 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd2dfe9-b95b-48c1-92c1-111d8fa2b1c3 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:21.753250 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3858b3-a666-4031-8cbe-9ebbc6e5674e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:21.754456 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3858b3-a666-4031-8cbe-9ebbc6e5674e admin admin] REQUEST_METHOD: `PUT` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:21.754870 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3858b3-a666-4031-8cbe-9ebbc6e5674e admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:21.755296 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3858b3-a666-4031-8cbe-9ebbc6e5674e admin admin] PATH_INFO: `/v3/projects/79476bd54f0d41089f2d6595c47c415d/users/303c33e1726d49b489199d67c01c20a7/roles/48808901834b4d5eab2c7e6b5b03791e` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:21.780355 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3858b3-a666-4031-8cbe-9ebbc6e5674e admin admin] RBAC: Authorizing `identity:create_grant(project_id=79476bd54f0d41089f2d6595c47c415d, user_id=303c33e1726d49b489199d67c01c20a7, role_id=48808901834b4d5eab2c7e6b5b03791e)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:21.786394 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3858b3-a666-4031-8cbe-9ebbc6e5674e admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:21.823853 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 933/1843] 10.222.0.67 () {60 vars in 1482 bytes} [Wed May 25 14:42:21 2022] PUT /identity/v3/projects/79476bd54f0d41089f2d6595c47c415d/users/303c33e1726d49b489199d67c01c20a7/roles/48808901834b4d5eab2c7e6b5b03791e => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:42:21.837913 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1515e47a-6973-4e39-a4dc-de94cee5485d None None] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:21.838303 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1515e47a-6973-4e39-a4dc-de94cee5485d None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:21.838594 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1515e47a-6973-4e39-a4dc-de94cee5485d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:21.868390 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3858b3-a666-4031-8cbe-9ebbc6e5674e admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:21.870295 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-ad3858b3-a666-4031-8cbe-9ebbc6e5674e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:42:21.870816 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:21.884000 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.auth.core [None req-1515e47a-6973-4e39-a4dc-de94cee5485d None None] MFA Rules not processed for user `303c33e1726d49b489199d67c01c20a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:42:21.885936 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-1515e47a-6973-4e39-a4dc-de94cee5485d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:42:21.988037 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 911/1844] 10.222.0.67 () {58 vars in 957 bytes} [Wed May 25 14:42:21 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:42:21.993433 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1515e47a-6973-4e39-a4dc-de94cee5485d None None] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:22.049802 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3858b3-a666-4031-8cbe-9ebbc6e5674e admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:22.056309 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8f6744-bdbc-46d5-b910-2675fb2b7998 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:22.057327 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8f6744-bdbc-46d5-b910-2675fb2b7998 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:22.057731 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8f6744-bdbc-46d5-b910-2675fb2b7998 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:22.058216 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8f6744-bdbc-46d5-b910-2675fb2b7998 admin admin] PATH_INFO: `/v3/projects/2bb3b5d269c34d45a2134a921c591027` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:22.059653 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8f6744-bdbc-46d5-b910-2675fb2b7998 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2bb3b5d269c34d45a2134a921c591027)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:22.062352 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8f6744-bdbc-46d5-b910-2675fb2b7998 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:22.152463 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1515e47a-6973-4e39-a4dc-de94cee5485d None None] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:22.160665 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-2a8f6744-bdbc-46d5-b910-2675fb2b7998 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2bb3b5d269c34d45a2134a921c591027', 'request_id': 'req-2a8f6744-bdbc-46d5-b910-2675fb2b7998'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:42:22.187527 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-2a8f6744-bdbc-46d5-b910-2675fb2b7998 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2bb3b5d269c34d45a2134a921c591027', 'request_id': 'req-2a8f6744-bdbc-46d5-b910-2675fb2b7998'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:42:22.199772 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-2a8f6744-bdbc-46d5-b910-2675fb2b7998 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2bb3b5d269c34d45a2134a921c591027', 'request_id': 'req-2a8f6744-bdbc-46d5-b910-2675fb2b7998'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:42:22.228471 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-2a8f6744-bdbc-46d5-b910-2675fb2b7998 admin admin] The token cache is being invalidate because project 2bb3b5d269c34d45a2134a921c591027 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80475) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 14:42:22.228585 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-2a8f6744-bdbc-46d5-b910-2675fb2b7998 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:42:22.231076 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-2a8f6744-bdbc-46d5-b910-2675fb2b7998 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:42:22.235966 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 934/1845] 10.222.0.67 () {58 vars in 1232 bytes} [Wed May 25 14:42:21 2022] DELETE /identity/v3/projects/2bb3b5d269c34d45a2134a921c591027 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:42:22.237411 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8f6744-bdbc-46d5-b910-2675fb2b7998 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:22.238356 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-2a8f6744-bdbc-46d5-b910-2675fb2b7998 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:42:22.326377 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1156a06-35ef-42c2-9bb6-48e494a16a7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:22.327352 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1156a06-35ef-42c2-9bb6-48e494a16a7b admin admin] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:22.327764 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1156a06-35ef-42c2-9bb6-48e494a16a7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:22.328159 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1156a06-35ef-42c2-9bb6-48e494a16a7b admin admin] PATH_INFO: `/v3/projects` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:22.329099 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1156a06-35ef-42c2-9bb6-48e494a16a7b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:22.332030 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1156a06-35ef-42c2-9bb6-48e494a16a7b admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:22.367947 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8f6744-bdbc-46d5-b910-2675fb2b7998 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:22.374928 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3803cc09-d38c-4417-92e6-0c5db9013b40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:22.376583 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3803cc09-d38c-4417-92e6-0c5db9013b40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:22.377096 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3803cc09-d38c-4417-92e6-0c5db9013b40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:22.377645 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3803cc09-d38c-4417-92e6-0c5db9013b40 admin admin] PATH_INFO: `/v3/users/94faa130ecc74b19aa023d726b0d61a6` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:22.382880 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 912/1846] 10.222.0.67 () {60 vars in 1152 bytes} [Wed May 25 14:42:21 2022] POST /identity/v3/projects => generated 383 bytes in 387 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 14:42:22.385293 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3803cc09-d38c-4417-92e6-0c5db9013b40 admin admin] RBAC: Authorizing `identity:delete_user(user_id=94faa130ecc74b19aa023d726b0d61a6)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:22.387520 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1156a06-35ef-42c2-9bb6-48e494a16a7b admin admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:22.389729 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3803cc09-d38c-4417-92e6-0c5db9013b40 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:22.390227 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-c1156a06-35ef-42c2-9bb6-48e494a16a7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:42:22.395431 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:22.447196 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:22.480656 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-3803cc09-d38c-4417-92e6-0c5db9013b40 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '94faa130ecc74b19aa023d726b0d61a6'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:42:22.492248 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-3803cc09-d38c-4417-92e6-0c5db9013b40 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '94faa130ecc74b19aa023d726b0d61a6'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:42:22.493208 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-3803cc09-d38c-4417-92e6-0c5db9013b40 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '94faa130ecc74b19aa023d726b0d61a6'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:42:22.501625 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1156a06-35ef-42c2-9bb6-48e494a16a7b admin admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:22.504415 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-3803cc09-d38c-4417-92e6-0c5db9013b40 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '94faa130ecc74b19aa023d726b0d61a6'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:42:22.521085 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-3803cc09-d38c-4417-92e6-0c5db9013b40 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '94faa130ecc74b19aa023d726b0d61a6'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:42:22.529473 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 935/1847] 10.222.0.67 () {58 vars in 1223 bytes} [Wed May 25 14:42:22 2022] DELETE /identity/v3/users/94faa130ecc74b19aa023d726b0d61a6 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 14:42:22.533789 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdb7752-0b4b-42cd-adcd-190a03f7d69f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:22.534719 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdb7752-0b4b-42cd-adcd-190a03f7d69f admin admin] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:22.535039 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdb7752-0b4b-42cd-adcd-190a03f7d69f admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:22.535329 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdb7752-0b4b-42cd-adcd-190a03f7d69f admin admin] PATH_INFO: `/v3/users` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:22.536040 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdb7752-0b4b-42cd-adcd-190a03f7d69f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:22.539422 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdb7752-0b4b-42cd-adcd-190a03f7d69f admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:22.587167 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3803cc09-d38c-4417-92e6-0c5db9013b40 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:22.588826 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-3803cc09-d38c-4417-92e6-0c5db9013b40 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:42:22.590655 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 913/1848] 10.222.0.67 () {60 vars in 1143 bytes} [Wed May 25 14:42:22 2022] POST /identity/v3/users => generated 298 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:42:22.697213 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3803cc09-d38c-4417-92e6-0c5db9013b40 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:22.706024 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086a5af8-64cf-4404-9585-af9921a567b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:22.706260 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086a5af8-64cf-4404-9585-af9921a567b6 admin admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:22.706360 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086a5af8-64cf-4404-9585-af9921a567b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:22.706624 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086a5af8-64cf-4404-9585-af9921a567b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:22.707427 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086a5af8-64cf-4404-9585-af9921a567b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:22.709875 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086a5af8-64cf-4404-9585-af9921a567b6 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:22.725196 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 936/1849] 10.222.0.67 () {58 vars in 1121 bytes} [Wed May 25 14:42:22 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 25 14:42:22.729905 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdb7752-0b4b-42cd-adcd-190a03f7d69f admin admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:22.743210 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdb7752-0b4b-42cd-adcd-190a03f7d69f admin admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:22.760409 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3ab6b4-ca5f-4bb7-a63c-b49e0258c60a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:22.763683 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3ab6b4-ca5f-4bb7-a63c-b49e0258c60a admin admin] REQUEST_METHOD: `PUT` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:22.764433 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3ab6b4-ca5f-4bb7-a63c-b49e0258c60a admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:22.765621 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3ab6b4-ca5f-4bb7-a63c-b49e0258c60a admin admin] PATH_INFO: `/v3/projects/ae8a5ac8dcdd4051b5d2a2e81807871d/users/0c9b37113a43498686f6ba3b93f564df/roles/399893e19eac4ab5a8e596f7c07be13c` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:22.805284 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3ab6b4-ca5f-4bb7-a63c-b49e0258c60a admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae8a5ac8dcdd4051b5d2a2e81807871d, user_id=0c9b37113a43498686f6ba3b93f564df, role_id=399893e19eac4ab5a8e596f7c07be13c)` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:22.808041 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3ab6b4-ca5f-4bb7-a63c-b49e0258c60a admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:22.836519 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 914/1850] 10.222.0.67 () {60 vars in 1482 bytes} [Wed May 25 14:42:22 2022] PUT /identity/v3/projects/ae8a5ac8dcdd4051b5d2a2e81807871d/users/0c9b37113a43498686f6ba3b93f564df/roles/399893e19eac4ab5a8e596f7c07be13c => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:42:22.840398 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086a5af8-64cf-4404-9585-af9921a567b6 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:22.866790 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086a5af8-64cf-4404-9585-af9921a567b6 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:23.068842 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418488c8-1d28-4e49-807e-840315edf3c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:23.069904 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418488c8-1d28-4e49-807e-840315edf3c0 admin admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:23.070905 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418488c8-1d28-4e49-807e-840315edf3c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:23.070905 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418488c8-1d28-4e49-807e-840315edf3c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:23.071519 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418488c8-1d28-4e49-807e-840315edf3c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:23.074077 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418488c8-1d28-4e49-807e-840315edf3c0 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:23.091931 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 937/1851] 10.222.0.67 () {58 vars in 1121 bytes} [Wed May 25 14:42:22 2022] GET /identity/v3/roles => generated 1420 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 25 14:42:23.096819 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3ab6b4-ca5f-4bb7-a63c-b49e0258c60a admin admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:23.114847 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3ab6b4-ca5f-4bb7-a63c-b49e0258c60a admin admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:23.123191 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac7716e-b371-4893-8d81-24c743a8285b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:23.124122 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac7716e-b371-4893-8d81-24c743a8285b admin admin] REQUEST_METHOD: `PUT` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:23.124412 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac7716e-b371-4893-8d81-24c743a8285b admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:23.124693 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac7716e-b371-4893-8d81-24c743a8285b admin admin] PATH_INFO: `/v3/projects/ae8a5ac8dcdd4051b5d2a2e81807871d/users/0c9b37113a43498686f6ba3b93f564df/roles/399893e19eac4ab5a8e596f7c07be13c` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:23.129204 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac7716e-b371-4893-8d81-24c743a8285b admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae8a5ac8dcdd4051b5d2a2e81807871d, user_id=0c9b37113a43498686f6ba3b93f564df, role_id=399893e19eac4ab5a8e596f7c07be13c)` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:23.136063 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac7716e-b371-4893-8d81-24c743a8285b admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:23.153475 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 915/1852] 10.222.0.67 () {60 vars in 1482 bytes} [Wed May 25 14:42:23 2022] PUT /identity/v3/projects/ae8a5ac8dcdd4051b5d2a2e81807871d/users/0c9b37113a43498686f6ba3b93f564df/roles/399893e19eac4ab5a8e596f7c07be13c => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 14:42:23.167847 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d21f0e6-fa42-4312-8fca-2792d07d512a None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:23.168242 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d21f0e6-fa42-4312-8fca-2792d07d512a None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:23.168619 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d21f0e6-fa42-4312-8fca-2792d07d512a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:23.232866 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:23.239380 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-6d21f0e6-fa42-4312-8fca-2792d07d512a None None] MFA Rules not processed for user `0c9b37113a43498686f6ba3b93f564df`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:42:23.241623 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-6d21f0e6-fa42-4312-8fca-2792d07d512a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:42:23.368744 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 938/1853] 10.222.0.67 () {58 vars in 957 bytes} [Wed May 25 14:42:23 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 14:42:23.376985 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac7716e-b371-4893-8d81-24c743a8285b admin admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:23.379672 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-2ac7716e-b371-4893-8d81-24c743a8285b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:42:23.484716 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac7716e-b371-4893-8d81-24c743a8285b admin admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:23.492521 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b7a6c8-9d26-43ac-94bc-c59402997794 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e462acc9da84a61bb23998dd54e1858', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfe93ee8d32a441295efc0b885de4bd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:23.493690 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b7a6c8-9d26-43ac-94bc-c59402997794 service cinder] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:23.494679 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b7a6c8-9d26-43ac-94bc-c59402997794 service cinder] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:23.494901 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b7a6c8-9d26-43ac-94bc-c59402997794 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:23.521391 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b7a6c8-9d26-43ac-94bc-c59402997794 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:23.525472 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b7a6c8-9d26-43ac-94bc-c59402997794 service cinder] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:23.552969 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 916/1854] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 14:42:23 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:42:23.602577 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d21f0e6-fa42-4312-8fca-2792d07d512a None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:23.605435 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-6d21f0e6-fa42-4312-8fca-2792d07d512a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:42:23.789060 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b7a6c8-9d26-43ac-94bc-c59402997794 service cinder] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:23.792535 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-c2b7a6c8-9d26-43ac-94bc-c59402997794 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:42:23.835639 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d21f0e6-fa42-4312-8fca-2792d07d512a None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:23.848220 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b7a6c8-9d26-43ac-94bc-c59402997794 service cinder] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:23.853646 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3de8c4f-97b4-4a24-aa50-6a3fd962d337 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e462acc9da84a61bb23998dd54e1858', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfe93ee8d32a441295efc0b885de4bd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:23.854515 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1f07c1-c90c-46ee-b8f8-b345aaa1816b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:23.855265 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3de8c4f-97b4-4a24-aa50-6a3fd962d337 service cinder] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:23.855734 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3de8c4f-97b4-4a24-aa50-6a3fd962d337 service cinder] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:23.856181 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3de8c4f-97b4-4a24-aa50-6a3fd962d337 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:23.856308 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1f07c1-c90c-46ee-b8f8-b345aaa1816b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:23.856608 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1f07c1-c90c-46ee-b8f8-b345aaa1816b admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:23.859144 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-e3de8c4f-97b4-4a24-aa50-6a3fd962d337 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:42:23.859800 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1f07c1-c90c-46ee-b8f8-b345aaa1816b admin admin] PATH_INFO: `/v3/projects/e1d963b67c604407bcafd15c88396b8f` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:23.863329 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1f07c1-c90c-46ee-b8f8-b345aaa1816b admin admin] RBAC: Authorizing `identity:delete_project(project_id=e1d963b67c604407bcafd15c88396b8f)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:23.867091 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1f07c1-c90c-46ee-b8f8-b345aaa1816b admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:23.992803 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3de8c4f-97b4-4a24-aa50-6a3fd962d337 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:23.996145 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3de8c4f-97b4-4a24-aa50-6a3fd962d337 service cinder] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:23.998579 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-7b1f07c1-c90c-46ee-b8f8-b345aaa1816b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e1d963b67c604407bcafd15c88396b8f', 'request_id': 'req-7b1f07c1-c90c-46ee-b8f8-b345aaa1816b'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:42:24.010178 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 917/1855] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 14:42:23 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:42:24.011558 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-7b1f07c1-c90c-46ee-b8f8-b345aaa1816b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e1d963b67c604407bcafd15c88396b8f', 'request_id': 'req-7b1f07c1-c90c-46ee-b8f8-b345aaa1816b'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:42:24.019898 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-7b1f07c1-c90c-46ee-b8f8-b345aaa1816b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e1d963b67c604407bcafd15c88396b8f', 'request_id': 'req-7b1f07c1-c90c-46ee-b8f8-b345aaa1816b'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:42:24.050525 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-7b1f07c1-c90c-46ee-b8f8-b345aaa1816b admin admin] The token cache is being invalidate because project e1d963b67c604407bcafd15c88396b8f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80475) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 14:42:24.050959 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-7b1f07c1-c90c-46ee-b8f8-b345aaa1816b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:42:24.053840 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-7b1f07c1-c90c-46ee-b8f8-b345aaa1816b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:42:24.058216 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 939/1856] 10.222.0.67 () {58 vars in 1232 bytes} [Wed May 25 14:42:23 2022] DELETE /identity/v3/projects/e1d963b67c604407bcafd15c88396b8f => generated 0 bytes in 458 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:42:24.063900 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418744e5-1707-48f1-8c5a-20eed8061c2f None None] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:24.064308 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418744e5-1707-48f1-8c5a-20eed8061c2f None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:24.064828 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418744e5-1707-48f1-8c5a-20eed8061c2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:24.099971 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.auth.core [None req-418744e5-1707-48f1-8c5a-20eed8061c2f None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:42:24.101234 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-418744e5-1707-48f1-8c5a-20eed8061c2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:42:24.179257 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:24.253803 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 918/1857] 10.222.0.67 () {58 vars in 957 bytes} [Wed May 25 14:42:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:42:24.262035 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1482a9f-2349-45db-bfcc-f17699db297b None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:24.262583 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1482a9f-2349-45db-bfcc-f17699db297b None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:24.263650 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1482a9f-2349-45db-bfcc-f17699db297b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:24.315342 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-f1482a9f-2349-45db-bfcc-f17699db297b None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:42:24.316739 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-f1482a9f-2349-45db-bfcc-f17699db297b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:42:24.344160 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 940/1858] 10.222.0.67 () {58 vars in 957 bytes} [Wed May 25 14:42:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 14:42:24.346967 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418744e5-1707-48f1-8c5a-20eed8061c2f None None] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:24.364118 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418744e5-1707-48f1-8c5a-20eed8061c2f None None] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:24.380582 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a131f520-4c29-4169-9386-e7072b1a44df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:24.381626 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a131f520-4c29-4169-9386-e7072b1a44df admin admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:24.381893 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a131f520-4c29-4169-9386-e7072b1a44df admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:24.382179 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a131f520-4c29-4169-9386-e7072b1a44df admin admin] PATH_INFO: `/v3/domains` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:24.383528 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a131f520-4c29-4169-9386-e7072b1a44df admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:42:24.383851 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a131f520-4c29-4169-9386-e7072b1a44df admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:24.385590 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a131f520-4c29-4169-9386-e7072b1a44df admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:24.411636 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1482a9f-2349-45db-bfcc-f17699db297b None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:24.412761 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 919/1859] 10.222.0.67 () {58 vars in 1152 bytes} [Wed May 25 14:42:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:42:24.433876 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1482a9f-2349-45db-bfcc-f17699db297b None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:24.441864 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d29ff2-8896-4547-b939-8c2407491c09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:24.442557 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d29ff2-8896-4547-b939-8c2407491c09 admin admin] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:24.442842 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d29ff2-8896-4547-b939-8c2407491c09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:24.443154 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d29ff2-8896-4547-b939-8c2407491c09 admin admin] PATH_INFO: `/v3/projects` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:24.443866 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d29ff2-8896-4547-b939-8c2407491c09 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:24.445815 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d29ff2-8896-4547-b939-8c2407491c09 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:24.481798 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:24.496166 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a131f520-4c29-4169-9386-e7072b1a44df admin admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:24.497204 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 941/1860] 10.222.0.67 () {60 vars in 1152 bytes} [Wed May 25 14:42:24 2022] POST /identity/v3/projects => generated 363 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:42:24.513958 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a131f520-4c29-4169-9386-e7072b1a44df admin admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:24.717258 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e304d163-62a4-42ae-9315-7d12025c911d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:24.720042 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e304d163-62a4-42ae-9315-7d12025c911d admin admin] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:24.725071 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e304d163-62a4-42ae-9315-7d12025c911d admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:24.727352 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e304d163-62a4-42ae-9315-7d12025c911d admin admin] PATH_INFO: `/v3/users` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:24.733043 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e304d163-62a4-42ae-9315-7d12025c911d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:24.740141 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e304d163-62a4-42ae-9315-7d12025c911d admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:24.888669 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 920/1861] 10.222.0.67 () {60 vars in 1143 bytes} [Wed May 25 14:42:24 2022] POST /identity/v3/users => generated 282 bytes in 393 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:42:24.889535 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d29ff2-8896-4547-b939-8c2407491c09 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:24.918548 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d29ff2-8896-4547-b939-8c2407491c09 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:24.930903 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390e2d8c-88bc-4f01-b56f-e3ed177a4010 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:24.932613 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390e2d8c-88bc-4f01-b56f-e3ed177a4010 admin admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:24.933018 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390e2d8c-88bc-4f01-b56f-e3ed177a4010 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:24.933484 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390e2d8c-88bc-4f01-b56f-e3ed177a4010 admin admin] PATH_INFO: `/v3/roles` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:24.935132 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390e2d8c-88bc-4f01-b56f-e3ed177a4010 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:24.940754 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390e2d8c-88bc-4f01-b56f-e3ed177a4010 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:24.967116 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 942/1862] 10.222.0.67 () {58 vars in 1121 bytes} [Wed May 25 14:42:24 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:42:24.972420 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e304d163-62a4-42ae-9315-7d12025c911d admin admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:25.002786 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e304d163-62a4-42ae-9315-7d12025c911d admin admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:25.030428 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92304965-c220-4b61-939b-352665d607fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:25.038309 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92304965-c220-4b61-939b-352665d607fd admin admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:25.040868 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92304965-c220-4b61-939b-352665d607fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:25.041502 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92304965-c220-4b61-939b-352665d607fd admin admin] PATH_INFO: `/v3/roles` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:25.043041 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92304965-c220-4b61-939b-352665d607fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:25.046745 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92304965-c220-4b61-939b-352665d607fd admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:25.101392 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 921/1863] 10.222.0.67 () {58 vars in 1121 bytes} [Wed May 25 14:42:24 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:42:25.103391 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390e2d8c-88bc-4f01-b56f-e3ed177a4010 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:25.132724 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390e2d8c-88bc-4f01-b56f-e3ed177a4010 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:25.164345 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4aad5e-28bc-4316-a9d8-76b1f3718698 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:25.165299 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4aad5e-28bc-4316-a9d8-76b1f3718698 admin admin] REQUEST_METHOD: `PUT` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:25.165785 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4aad5e-28bc-4316-a9d8-76b1f3718698 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:25.166250 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4aad5e-28bc-4316-a9d8-76b1f3718698 admin admin] PATH_INFO: `/v3/projects/130c6e363248479e903e92c97c454c8f/users/f05ebd4c4bbc49a096cd458da7228810/roles/48808901834b4d5eab2c7e6b5b03791e` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:25.228580 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4aad5e-28bc-4316-a9d8-76b1f3718698 admin admin] RBAC: Authorizing `identity:create_grant(project_id=130c6e363248479e903e92c97c454c8f, user_id=f05ebd4c4bbc49a096cd458da7228810, role_id=48808901834b4d5eab2c7e6b5b03791e)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:25.238121 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4aad5e-28bc-4316-a9d8-76b1f3718698 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:25.286618 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 943/1864] 10.222.0.67 () {60 vars in 1482 bytes} [Wed May 25 14:42:25 2022] PUT /identity/v3/projects/130c6e363248479e903e92c97c454c8f/users/f05ebd4c4bbc49a096cd458da7228810/roles/48808901834b4d5eab2c7e6b5b03791e => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:42:25.309700 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92304965-c220-4b61-939b-352665d607fd admin admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:25.312622 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-92304965-c220-4b61-939b-352665d607fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:42:25.312810 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68688b69-3bb7-4d3f-b0e7-abdeb79c575e None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:25.316855 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68688b69-3bb7-4d3f-b0e7-abdeb79c575e None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:25.317681 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68688b69-3bb7-4d3f-b0e7-abdeb79c575e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:25.347847 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92304965-c220-4b61-939b-352665d607fd admin admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:25.403849 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-68688b69-3bb7-4d3f-b0e7-abdeb79c575e None None] MFA Rules not processed for user `f05ebd4c4bbc49a096cd458da7228810`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:42:25.405759 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-68688b69-3bb7-4d3f-b0e7-abdeb79c575e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:42:25.535829 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7124e515-e7ac-4e56-a8b2-0aab4af96f96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:25.536996 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7124e515-e7ac-4e56-a8b2-0aab4af96f96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:25.537444 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7124e515-e7ac-4e56-a8b2-0aab4af96f96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:25.537907 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7124e515-e7ac-4e56-a8b2-0aab4af96f96 admin admin] PATH_INFO: `/v3/users/59e6d46dc0ea4252bd48165b5b5bd67f` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:25.540044 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7124e515-e7ac-4e56-a8b2-0aab4af96f96 admin admin] RBAC: Authorizing `identity:delete_user(user_id=59e6d46dc0ea4252bd48165b5b5bd67f)` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:25.542889 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7124e515-e7ac-4e56-a8b2-0aab4af96f96 admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:25.655211 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:25.656292 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 944/1865] 10.222.0.67 () {58 vars in 957 bytes} [Wed May 25 14:42:25 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 347 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 14:42:25.662415 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68688b69-3bb7-4d3f-b0e7-abdeb79c575e None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:25.682932 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68688b69-3bb7-4d3f-b0e7-abdeb79c575e None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:25.696672 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-7124e515-e7ac-4e56-a8b2-0aab4af96f96 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '59e6d46dc0ea4252bd48165b5b5bd67f'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:42:25.705978 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7711ce-52b7-4e5b-b7a2-307c56b80eaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:25.707908 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-7124e515-e7ac-4e56-a8b2-0aab4af96f96 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '59e6d46dc0ea4252bd48165b5b5bd67f'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:42:25.710114 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7711ce-52b7-4e5b-b7a2-307c56b80eaf admin admin] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:25.710846 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7711ce-52b7-4e5b-b7a2-307c56b80eaf admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:25.711641 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-7124e515-e7ac-4e56-a8b2-0aab4af96f96 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '59e6d46dc0ea4252bd48165b5b5bd67f'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:42:25.712855 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7711ce-52b7-4e5b-b7a2-307c56b80eaf admin admin] PATH_INFO: `/v3/projects` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:25.713767 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7711ce-52b7-4e5b-b7a2-307c56b80eaf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:25.718630 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7711ce-52b7-4e5b-b7a2-307c56b80eaf admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:25.755037 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-7124e515-e7ac-4e56-a8b2-0aab4af96f96 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '59e6d46dc0ea4252bd48165b5b5bd67f'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:42:25.792355 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 945/1866] 10.222.0.67 () {60 vars in 1152 bytes} [Wed May 25 14:42:25 2022] POST /identity/v3/projects => generated 365 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 14:42:25.802192 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7711ce-52b7-4e5b-b7a2-307c56b80eaf admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:25.803844 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-fb7711ce-52b7-4e5b-b7a2-307c56b80eaf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:42:25.804593 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-7124e515-e7ac-4e56-a8b2-0aab4af96f96 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '59e6d46dc0ea4252bd48165b5b5bd67f'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:42:25.854881 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 922/1867] 10.222.0.67 () {58 vars in 1223 bytes} [Wed May 25 14:42:25 2022] DELETE /identity/v3/users/59e6d46dc0ea4252bd48165b5b5bd67f => generated 0 bytes in 545 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:42:25.857255 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69224c92-96be-47ab-9191-c3b5ea34a2dc None None] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:25.857789 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69224c92-96be-47ab-9191-c3b5ea34a2dc None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:25.858207 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69224c92-96be-47ab-9191-c3b5ea34a2dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:25.879247 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.auth.core [None req-69224c92-96be-47ab-9191-c3b5ea34a2dc None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:42:25.880668 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-69224c92-96be-47ab-9191-c3b5ea34a2dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:42:25.989485 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 923/1868] 10.222.0.67 () {58 vars in 957 bytes} [Wed May 25 14:42:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:42:25.998796 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69224c92-96be-47ab-9191-c3b5ea34a2dc None None] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:26.000412 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-69224c92-96be-47ab-9191-c3b5ea34a2dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:42:26.010524 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7711ce-52b7-4e5b-b7a2-307c56b80eaf admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:26.021977 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80021ee1-39ef-469e-b23a-6e6371c5404b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:26.023543 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80021ee1-39ef-469e-b23a-6e6371c5404b admin admin] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:26.024446 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80021ee1-39ef-469e-b23a-6e6371c5404b admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:26.025081 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80021ee1-39ef-469e-b23a-6e6371c5404b admin admin] PATH_INFO: `/v3/users` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:26.025857 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80021ee1-39ef-469e-b23a-6e6371c5404b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:26.028195 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80021ee1-39ef-469e-b23a-6e6371c5404b admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:26.062435 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 946/1869] 10.222.0.67 () {60 vars in 1143 bytes} [Wed May 25 14:42:25 2022] POST /identity/v3/users => generated 289 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:42:26.067957 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80021ee1-39ef-469e-b23a-6e6371c5404b admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:26.088785 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69224c92-96be-47ab-9191-c3b5ea34a2dc None None] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:26.088912 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80021ee1-39ef-469e-b23a-6e6371c5404b admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:26.088992 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ac4b22-c5ee-4f72-b382-53cc957a3513 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b68eed985c7b49839bcdd173186ad4ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfe93ee8d32a441295efc0b885de4bd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:26.088992 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ac4b22-c5ee-4f72-b382-53cc957a3513 service neutron] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:26.088992 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ac4b22-c5ee-4f72-b382-53cc957a3513 service neutron] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:26.088992 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ac4b22-c5ee-4f72-b382-53cc957a3513 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:26.089270 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e2446f-747c-4a7d-8907-6a7b1f9ef8b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:26.090642 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e2446f-747c-4a7d-8907-6a7b1f9ef8b3 admin admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:26.090642 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e2446f-747c-4a7d-8907-6a7b1f9ef8b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:26.090642 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e2446f-747c-4a7d-8907-6a7b1f9ef8b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:26.091546 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e2446f-747c-4a7d-8907-6a7b1f9ef8b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:26.093910 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e2446f-747c-4a7d-8907-6a7b1f9ef8b3 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:26.109278 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 947/1870] 10.222.0.67 () {58 vars in 1121 bytes} [Wed May 25 14:42:26 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:42:26.112670 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e2446f-747c-4a7d-8907-6a7b1f9ef8b3 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:26.118524 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ac4b22-c5ee-4f72-b382-53cc957a3513 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:26.120149 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ac4b22-c5ee-4f72-b382-53cc957a3513 service neutron] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:26.125373 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e2446f-747c-4a7d-8907-6a7b1f9ef8b3 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:26.132391 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0a7a42-5354-40bf-a1cd-b6379fc672d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:26.133394 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0a7a42-5354-40bf-a1cd-b6379fc672d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:26.133758 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0a7a42-5354-40bf-a1cd-b6379fc672d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:26.134121 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0a7a42-5354-40bf-a1cd-b6379fc672d3 admin admin] PATH_INFO: `/v3/projects/de6f8289ecb34708b91dab54c379e2fb/users/5c669dc6f9c34b3c9c60c97ce93093e2/roles/399893e19eac4ab5a8e596f7c07be13c` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:26.135819 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 924/1871] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 14:42:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 14:42:26.155167 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:26.165776 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0a7a42-5354-40bf-a1cd-b6379fc672d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=de6f8289ecb34708b91dab54c379e2fb, user_id=5c669dc6f9c34b3c9c60c97ce93093e2, role_id=399893e19eac4ab5a8e596f7c07be13c)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:26.169289 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0a7a42-5354-40bf-a1cd-b6379fc672d3 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:26.187050 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 948/1872] 10.222.0.67 () {60 vars in 1482 bytes} [Wed May 25 14:42:26 2022] PUT /identity/v3/projects/de6f8289ecb34708b91dab54c379e2fb/users/5c669dc6f9c34b3c9c60c97ce93093e2/roles/399893e19eac4ab5a8e596f7c07be13c => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:42:26.192204 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ac4b22-c5ee-4f72-b382-53cc957a3513 service neutron] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:26.205832 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ac4b22-c5ee-4f72-b382-53cc957a3513 service neutron] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:26.276352 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:26.288934 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612c9829-ce36-4ca6-985b-720d3c1ea33c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:26.290142 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612c9829-ce36-4ca6-985b-720d3c1ea33c admin admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:26.291342 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612c9829-ce36-4ca6-985b-720d3c1ea33c admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:26.292476 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612c9829-ce36-4ca6-985b-720d3c1ea33c admin admin] PATH_INFO: `/v3/roles` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:26.292912 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612c9829-ce36-4ca6-985b-720d3c1ea33c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:26.294727 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612c9829-ce36-4ca6-985b-720d3c1ea33c admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:26.311454 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 925/1873] 10.222.0.67 () {58 vars in 1121 bytes} [Wed May 25 14:42:26 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:42:26.313389 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0a7a42-5354-40bf-a1cd-b6379fc672d3 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:26.324335 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0a7a42-5354-40bf-a1cd-b6379fc672d3 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:26.329125 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62773bb-8fd3-48b8-93c1-bbe71538c199 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:26.330811 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62773bb-8fd3-48b8-93c1-bbe71538c199 admin admin] REQUEST_METHOD: `PUT` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:26.331244 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62773bb-8fd3-48b8-93c1-bbe71538c199 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:26.331592 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62773bb-8fd3-48b8-93c1-bbe71538c199 admin admin] PATH_INFO: `/v3/projects/de6f8289ecb34708b91dab54c379e2fb/users/5c669dc6f9c34b3c9c60c97ce93093e2/roles/399893e19eac4ab5a8e596f7c07be13c` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:26.333752 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62773bb-8fd3-48b8-93c1-bbe71538c199 admin admin] RBAC: Authorizing `identity:create_grant(project_id=de6f8289ecb34708b91dab54c379e2fb, user_id=5c669dc6f9c34b3c9c60c97ce93093e2, role_id=399893e19eac4ab5a8e596f7c07be13c)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:26.337789 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62773bb-8fd3-48b8-93c1-bbe71538c199 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:26.352987 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 949/1874] 10.222.0.67 () {60 vars in 1482 bytes} [Wed May 25 14:42:26 2022] PUT /identity/v3/projects/de6f8289ecb34708b91dab54c379e2fb/users/5c669dc6f9c34b3c9c60c97ce93093e2/roles/399893e19eac4ab5a8e596f7c07be13c => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:42:26.363942 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e91b8a-3598-4bb8-af8d-9caf7c740ae3 None None] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:26.365265 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e91b8a-3598-4bb8-af8d-9caf7c740ae3 None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:26.365265 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e91b8a-3598-4bb8-af8d-9caf7c740ae3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:26.395667 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.auth.core [None req-a3e91b8a-3598-4bb8-af8d-9caf7c740ae3 None None] MFA Rules not processed for user `5c669dc6f9c34b3c9c60c97ce93093e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:42:26.396811 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-a3e91b8a-3598-4bb8-af8d-9caf7c740ae3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:42:26.472370 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 926/1875] 10.222.0.67 () {58 vars in 957 bytes} [Wed May 25 14:42:26 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:42:26.484443 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62773bb-8fd3-48b8-93c1-bbe71538c199 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:26.486955 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-f62773bb-8fd3-48b8-93c1-bbe71538c199 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:42:26.556360 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e91b8a-3598-4bb8-af8d-9caf7c740ae3 None None] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:26.558492 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-a3e91b8a-3598-4bb8-af8d-9caf7c740ae3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:42:26.559299 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62773bb-8fd3-48b8-93c1-bbe71538c199 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:26.564454 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b908e031-6d57-4396-9db9-2dc8bbedebd7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e462acc9da84a61bb23998dd54e1858', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfe93ee8d32a441295efc0b885de4bd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:26.565024 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b908e031-6d57-4396-9db9-2dc8bbedebd7 service cinder] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:26.565330 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b908e031-6d57-4396-9db9-2dc8bbedebd7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:26.565667 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b908e031-6d57-4396-9db9-2dc8bbedebd7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:26.578756 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b908e031-6d57-4396-9db9-2dc8bbedebd7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:26.580772 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b908e031-6d57-4396-9db9-2dc8bbedebd7 service cinder] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:26.601118 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 950/1876] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 14:42:26 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:42:26.645089 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e91b8a-3598-4bb8-af8d-9caf7c740ae3 None None] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:26.650127 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5cf329-e1a4-460d-8acb-1269f309716d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:26.651235 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5cf329-e1a4-460d-8acb-1269f309716d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:26.651521 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5cf329-e1a4-460d-8acb-1269f309716d admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:26.651798 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5cf329-e1a4-460d-8acb-1269f309716d admin admin] PATH_INFO: `/v3/projects/71d0095a97aa4e60ab22cdb3b8aafea2` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:26.653015 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5cf329-e1a4-460d-8acb-1269f309716d admin admin] RBAC: Authorizing `identity:delete_project(project_id=71d0095a97aa4e60ab22cdb3b8aafea2)` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:26.654923 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5cf329-e1a4-460d-8acb-1269f309716d admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:26.683604 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b908e031-6d57-4396-9db9-2dc8bbedebd7 service cinder] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:26.694428 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b908e031-6d57-4396-9db9-2dc8bbedebd7 service cinder] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:26.698750 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6cf7be-e387-430e-bbd8-82fb3dc3dfa2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e462acc9da84a61bb23998dd54e1858', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfe93ee8d32a441295efc0b885de4bd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:26.699437 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6cf7be-e387-430e-bbd8-82fb3dc3dfa2 service cinder] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:26.699725 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6cf7be-e387-430e-bbd8-82fb3dc3dfa2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:26.700006 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6cf7be-e387-430e-bbd8-82fb3dc3dfa2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:26.701996 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-da6cf7be-e387-430e-bbd8-82fb3dc3dfa2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:42:26.710674 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-ff5cf329-e1a4-460d-8acb-1269f309716d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '71d0095a97aa4e60ab22cdb3b8aafea2', 'request_id': 'req-ff5cf329-e1a4-460d-8acb-1269f309716d'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:42:26.731620 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-ff5cf329-e1a4-460d-8acb-1269f309716d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '71d0095a97aa4e60ab22cdb3b8aafea2', 'request_id': 'req-ff5cf329-e1a4-460d-8acb-1269f309716d'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:42:26.739842 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-ff5cf329-e1a4-460d-8acb-1269f309716d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '71d0095a97aa4e60ab22cdb3b8aafea2', 'request_id': 'req-ff5cf329-e1a4-460d-8acb-1269f309716d'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:42:26.754066 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-ff5cf329-e1a4-460d-8acb-1269f309716d admin admin] The token cache is being invalidate because project 71d0095a97aa4e60ab22cdb3b8aafea2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80474) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 14:42:26.754433 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-ff5cf329-e1a4-460d-8acb-1269f309716d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:42:26.755423 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-ff5cf329-e1a4-460d-8acb-1269f309716d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:42:26.760649 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 927/1877] 10.222.0.67 () {58 vars in 1232 bytes} [Wed May 25 14:42:26 2022] DELETE /identity/v3/projects/71d0095a97aa4e60ab22cdb3b8aafea2 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 14:42:26.763486 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5cf329-e1a4-460d-8acb-1269f309716d admin admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:26.766148 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-ff5cf329-e1a4-460d-8acb-1269f309716d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:42:26.774082 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6cf7be-e387-430e-bbd8-82fb3dc3dfa2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:26.774474 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:26.775625 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6cf7be-e387-430e-bbd8-82fb3dc3dfa2 service cinder] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:26.789084 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 951/1878] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 14:42:26 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 14:42:26.862082 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5cf329-e1a4-460d-8acb-1269f309716d admin admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:26.867726 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296ed2b9-c97b-4635-8114-8b93b5bddb1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:26.868776 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296ed2b9-c97b-4635-8114-8b93b5bddb1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:26.868936 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296ed2b9-c97b-4635-8114-8b93b5bddb1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:26.869224 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296ed2b9-c97b-4635-8114-8b93b5bddb1c admin admin] PATH_INFO: `/v3/users/d97678a2822e40e880a0856df832b4b9` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:26.870558 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296ed2b9-c97b-4635-8114-8b93b5bddb1c admin admin] RBAC: Authorizing `identity:delete_user(user_id=d97678a2822e40e880a0856df832b4b9)` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:26.872506 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296ed2b9-c97b-4635-8114-8b93b5bddb1c admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:26.930874 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-296ed2b9-c97b-4635-8114-8b93b5bddb1c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd97678a2822e40e880a0856df832b4b9'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:42:26.931892 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-296ed2b9-c97b-4635-8114-8b93b5bddb1c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd97678a2822e40e880a0856df832b4b9'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:42:26.932630 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-296ed2b9-c97b-4635-8114-8b93b5bddb1c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd97678a2822e40e880a0856df832b4b9'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:42:26.952861 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-296ed2b9-c97b-4635-8114-8b93b5bddb1c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd97678a2822e40e880a0856df832b4b9'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:42:26.965745 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-296ed2b9-c97b-4635-8114-8b93b5bddb1c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd97678a2822e40e880a0856df832b4b9'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:42:26.994586 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 928/1879] 10.222.0.67 () {58 vars in 1223 bytes} [Wed May 25 14:42:26 2022] DELETE /identity/v3/users/d97678a2822e40e880a0856df832b4b9 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:42:27.229245 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6cf7be-e387-430e-bbd8-82fb3dc3dfa2 service cinder] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:27.230836 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-da6cf7be-e387-430e-bbd8-82fb3dc3dfa2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:42:27.244655 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6cf7be-e387-430e-bbd8-82fb3dc3dfa2 service cinder] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:27.290772 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296ed2b9-c97b-4635-8114-8b93b5bddb1c admin admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:27.292358 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-296ed2b9-c97b-4635-8114-8b93b5bddb1c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:42:27.321175 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d569fd3-5489-4f72-a9c9-aebaacddd5a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:27.323596 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d569fd3-5489-4f72-a9c9-aebaacddd5a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:27.323957 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d569fd3-5489-4f72-a9c9-aebaacddd5a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:27.324313 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d569fd3-5489-4f72-a9c9-aebaacddd5a7 admin admin] PATH_INFO: `/v3/users/9e912c577abb45bc91987d7214e6d7d7` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:27.325726 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d569fd3-5489-4f72-a9c9-aebaacddd5a7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9e912c577abb45bc91987d7214e6d7d7)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:27.327798 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d569fd3-5489-4f72-a9c9-aebaacddd5a7 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:27.353060 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:DELETE=1 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:27.409713 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-9d569fd3-5489-4f72-a9c9-aebaacddd5a7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9e912c577abb45bc91987d7214e6d7d7'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:42:27.422033 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296ed2b9-c97b-4635-8114-8b93b5bddb1c admin admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:27.424670 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-9d569fd3-5489-4f72-a9c9-aebaacddd5a7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9e912c577abb45bc91987d7214e6d7d7'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:42:27.425464 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-9d569fd3-5489-4f72-a9c9-aebaacddd5a7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9e912c577abb45bc91987d7214e6d7d7'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:42:27.428345 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21460642-3836-4d44-9476-3d124961a17e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:27.429637 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21460642-3836-4d44-9476-3d124961a17e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:27.430075 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21460642-3836-4d44-9476-3d124961a17e admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:27.430504 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21460642-3836-4d44-9476-3d124961a17e admin admin] PATH_INFO: `/v3/users/303c33e1726d49b489199d67c01c20a7` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:27.432387 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21460642-3836-4d44-9476-3d124961a17e admin admin] RBAC: Authorizing `identity:delete_user(user_id=303c33e1726d49b489199d67c01c20a7)` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:27.434711 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-9d569fd3-5489-4f72-a9c9-aebaacddd5a7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9e912c577abb45bc91987d7214e6d7d7'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:42:27.434884 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21460642-3836-4d44-9476-3d124961a17e admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:27.469119 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-9d569fd3-5489-4f72-a9c9-aebaacddd5a7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9e912c577abb45bc91987d7214e6d7d7'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:42:27.482963 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 952/1880] 10.222.0.67 () {58 vars in 1223 bytes} [Wed May 25 14:42:27 2022] DELETE /identity/v3/users/9e912c577abb45bc91987d7214e6d7d7 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:42:27.484131 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d569fd3-5489-4f72-a9c9-aebaacddd5a7 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:27.486684 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-9d569fd3-5489-4f72-a9c9-aebaacddd5a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:42:27.498072 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:27.534945 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-21460642-3836-4d44-9476-3d124961a17e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '303c33e1726d49b489199d67c01c20a7'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:42:27.535835 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-21460642-3836-4d44-9476-3d124961a17e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '303c33e1726d49b489199d67c01c20a7'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:42:27.536519 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-21460642-3836-4d44-9476-3d124961a17e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '303c33e1726d49b489199d67c01c20a7'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:42:27.553152 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-21460642-3836-4d44-9476-3d124961a17e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '303c33e1726d49b489199d67c01c20a7'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:42:27.560896 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-21460642-3836-4d44-9476-3d124961a17e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '303c33e1726d49b489199d67c01c20a7'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:42:27.578596 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d569fd3-5489-4f72-a9c9-aebaacddd5a7 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:27.583150 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 929/1881] 10.222.0.67 () {58 vars in 1223 bytes} [Wed May 25 14:42:27 2022] DELETE /identity/v3/users/303c33e1726d49b489199d67c01c20a7 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:42:27.584734 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a4911e-7b2e-42b6-bf5c-cc5f50c6948c None None] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:27.585176 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a4911e-7b2e-42b6-bf5c-cc5f50c6948c None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:27.585446 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a4911e-7b2e-42b6-bf5c-cc5f50c6948c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:27.610484 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.auth.core [None req-23a4911e-7b2e-42b6-bf5c-cc5f50c6948c None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:42:27.613807 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-23a4911e-7b2e-42b6-bf5c-cc5f50c6948c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:42:27.681778 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9403307d-d91d-48e1-a882-c499cb57ef9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:27.682646 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9403307d-d91d-48e1-a882-c499cb57ef9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:27.682926 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9403307d-d91d-48e1-a882-c499cb57ef9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:27.683237 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9403307d-d91d-48e1-a882-c499cb57ef9e admin admin] PATH_INFO: `/v3/projects/6a7290c3c32f44d780a893b05a212581` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:27.684554 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9403307d-d91d-48e1-a882-c499cb57ef9e admin admin] RBAC: Authorizing `identity:delete_project(project_id=6a7290c3c32f44d780a893b05a212581)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:27.686669 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9403307d-d91d-48e1-a882-c499cb57ef9e admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:27.713834 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 930/1882] 10.222.0.67 () {58 vars in 957 bytes} [Wed May 25 14:42:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:42:27.713834 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd211172-fc6b-4964-8fd1-37651afe08ff None None] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:27.713834 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd211172-fc6b-4964-8fd1-37651afe08ff None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:27.714218 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd211172-fc6b-4964-8fd1-37651afe08ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:27.741682 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.auth.core [None req-bd211172-fc6b-4964-8fd1-37651afe08ff None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:42:27.742945 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-bd211172-fc6b-4964-8fd1-37651afe08ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:42:27.754389 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:DELETE=12,keystone:SELECT=87,keystone:INSERT=1 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:27.761276 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-9403307d-d91d-48e1-a882-c499cb57ef9e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6a7290c3c32f44d780a893b05a212581', 'request_id': 'req-9403307d-d91d-48e1-a882-c499cb57ef9e'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:42:27.775771 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-9403307d-d91d-48e1-a882-c499cb57ef9e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6a7290c3c32f44d780a893b05a212581', 'request_id': 'req-9403307d-d91d-48e1-a882-c499cb57ef9e'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:42:27.783825 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-9403307d-d91d-48e1-a882-c499cb57ef9e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6a7290c3c32f44d780a893b05a212581', 'request_id': 'req-9403307d-d91d-48e1-a882-c499cb57ef9e'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:42:27.804941 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-9403307d-d91d-48e1-a882-c499cb57ef9e admin admin] The token cache is being invalidate because project 6a7290c3c32f44d780a893b05a212581 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80475) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 14:42:27.805322 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-9403307d-d91d-48e1-a882-c499cb57ef9e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:42:27.806069 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-9403307d-d91d-48e1-a882-c499cb57ef9e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:42:27.811318 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 953/1883] 10.222.0.67 () {58 vars in 1232 bytes} [Wed May 25 14:42:27 2022] DELETE /identity/v3/projects/6a7290c3c32f44d780a893b05a212581 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:42:27.811318 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9403307d-d91d-48e1-a882-c499cb57ef9e admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:27.811318 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-9403307d-d91d-48e1-a882-c499cb57ef9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:42:27.867730 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 931/1884] 10.222.0.67 () {58 vars in 957 bytes} [Wed May 25 14:42:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:42:27.869750 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2724620b-bdbc-4312-a809-69a262044c00 None None] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:27.870147 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2724620b-bdbc-4312-a809-69a262044c00 None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:27.870497 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2724620b-bdbc-4312-a809-69a262044c00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:27.897712 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.auth.core [None req-2724620b-bdbc-4312-a809-69a262044c00 None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:42:27.898943 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-2724620b-bdbc-4312-a809-69a262044c00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:42:27.905503 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9403307d-d91d-48e1-a882-c499cb57ef9e admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:27.910983 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9b4e06-cf2f-463e-992e-8d3e16c19c56 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b68eed985c7b49839bcdd173186ad4ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfe93ee8d32a441295efc0b885de4bd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:27.911774 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9b4e06-cf2f-463e-992e-8d3e16c19c56 service neutron] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:27.912486 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 932/1885] 10.222.0.67 () {58 vars in 957 bytes} [Wed May 25 14:42:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:42:27.912658 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9b4e06-cf2f-463e-992e-8d3e16c19c56 service neutron] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:27.912658 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9b4e06-cf2f-463e-992e-8d3e16c19c56 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:27.916137 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-4a9b4e06-cf2f-463e-992e-8d3e16c19c56 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:42:27.920013 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2724620b-bdbc-4312-a809-69a262044c00 None None] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:27.932703 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2724620b-bdbc-4312-a809-69a262044c00 None None] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:27.934431 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9b4e06-cf2f-463e-992e-8d3e16c19c56 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:27.936292 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9b4e06-cf2f-463e-992e-8d3e16c19c56 service neutron] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:27.937073 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536ecc50-a562-4972-a32b-086fa7395b75 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b68eed985c7b49839bcdd173186ad4ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfe93ee8d32a441295efc0b885de4bd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:27.937958 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536ecc50-a562-4972-a32b-086fa7395b75 service neutron] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:27.938432 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536ecc50-a562-4972-a32b-086fa7395b75 service neutron] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:27.939791 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536ecc50-a562-4972-a32b-086fa7395b75 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:27.949712 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 954/1886] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 14:42:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:42:27.951365 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a690abc-31e4-4ced-81c6-c4d3e264e434 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:27.951730 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a690abc-31e4-4ced-81c6-c4d3e264e434 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:27.952084 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a690abc-31e4-4ced-81c6-c4d3e264e434 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:27.953207 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536ecc50-a562-4972-a32b-086fa7395b75 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:27.955677 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536ecc50-a562-4972-a32b-086fa7395b75 service neutron] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:27.968338 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 933/1887] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 14:42:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:42:28.007645 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-0a690abc-31e4-4ced-81c6-c4d3e264e434 None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:42:28.010678 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-0a690abc-31e4-4ced-81c6-c4d3e264e434 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:42:28.023980 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 955/1888] 10.222.0.67 () {58 vars in 957 bytes} [Wed May 25 14:42:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:42:28.026442 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536ecc50-a562-4972-a32b-086fa7395b75 service neutron] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:28.042609 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536ecc50-a562-4972-a32b-086fa7395b75 service neutron] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:28.049201 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2527cd20-0750-4282-8669-fb3cf128df65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:28.050415 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2527cd20-0750-4282-8669-fb3cf128df65 admin admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:28.050715 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2527cd20-0750-4282-8669-fb3cf128df65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:28.051311 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2527cd20-0750-4282-8669-fb3cf128df65 admin admin] PATH_INFO: `/v3/domains` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:28.052181 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2527cd20-0750-4282-8669-fb3cf128df65 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:42:28.052561 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2527cd20-0750-4282-8669-fb3cf128df65 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:28.055397 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2527cd20-0750-4282-8669-fb3cf128df65 admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:28.078839 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 934/1889] 10.222.0.67 () {58 vars in 1152 bytes} [Wed May 25 14:42:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:42:28.081505 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a690abc-31e4-4ced-81c6-c4d3e264e434 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:28.113391 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a690abc-31e4-4ced-81c6-c4d3e264e434 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:28.123609 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96f85a2-c3a7-422f-a53b-189b09ed787e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:28.128230 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96f85a2-c3a7-422f-a53b-189b09ed787e admin admin] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:28.128686 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96f85a2-c3a7-422f-a53b-189b09ed787e admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:28.129162 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96f85a2-c3a7-422f-a53b-189b09ed787e admin admin] PATH_INFO: `/v3/projects` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:28.130073 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96f85a2-c3a7-422f-a53b-189b09ed787e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:28.133695 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96f85a2-c3a7-422f-a53b-189b09ed787e admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:28.232630 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 956/1890] 10.222.0.67 () {60 vars in 1152 bytes} [Wed May 25 14:42:28 2022] POST /identity/v3/projects => generated 363 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 14:42:28.243712 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2527cd20-0750-4282-8669-fb3cf128df65 admin admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:28.302088 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2527cd20-0750-4282-8669-fb3cf128df65 admin admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:28.319121 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:DELETE=6,keystone:SELECT=93,keystone:INSERT=1 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:28.491931 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc14da0-06ea-48e7-a8ab-f14dde29c204 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:28.494562 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc14da0-06ea-48e7-a8ab-f14dde29c204 admin admin] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:28.495595 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc14da0-06ea-48e7-a8ab-f14dde29c204 admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:28.496165 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc14da0-06ea-48e7-a8ab-f14dde29c204 admin admin] PATH_INFO: `/v3/users` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:28.497416 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc14da0-06ea-48e7-a8ab-f14dde29c204 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:28.512215 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc14da0-06ea-48e7-a8ab-f14dde29c204 admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:28.573812 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96f85a2-c3a7-422f-a53b-189b09ed787e admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:28.582046 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 935/1891] 10.222.0.67 () {60 vars in 1143 bytes} [Wed May 25 14:42:28 2022] POST /identity/v3/users => generated 282 bytes in 336 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:42:28.597603 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96f85a2-c3a7-422f-a53b-189b09ed787e admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:28.607681 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230103cc-6259-4af7-9ac1-139db15aa643 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:28.608883 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230103cc-6259-4af7-9ac1-139db15aa643 admin admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:28.609372 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230103cc-6259-4af7-9ac1-139db15aa643 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:28.609920 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230103cc-6259-4af7-9ac1-139db15aa643 admin admin] PATH_INFO: `/v3/roles` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:28.613303 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230103cc-6259-4af7-9ac1-139db15aa643 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:28.615193 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230103cc-6259-4af7-9ac1-139db15aa643 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:28.630108 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 957/1892] 10.222.0.67 () {58 vars in 1121 bytes} [Wed May 25 14:42:28 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:42:28.634593 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc14da0-06ea-48e7-a8ab-f14dde29c204 admin admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:28.659228 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc14da0-06ea-48e7-a8ab-f14dde29c204 admin admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:28.671450 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b413781d-5917-4fa4-9ca3-c41bdefaf418 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:28.672145 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b413781d-5917-4fa4-9ca3-c41bdefaf418 admin admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:28.672431 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b413781d-5917-4fa4-9ca3-c41bdefaf418 admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:28.672705 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b413781d-5917-4fa4-9ca3-c41bdefaf418 admin admin] PATH_INFO: `/v3/roles` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:28.673523 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b413781d-5917-4fa4-9ca3-c41bdefaf418 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:28.675467 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b413781d-5917-4fa4-9ca3-c41bdefaf418 admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:28.696079 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230103cc-6259-4af7-9ac1-139db15aa643 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:28.703481 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 936/1893] 10.222.0.67 () {58 vars in 1121 bytes} [Wed May 25 14:42:28 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:42:28.713450 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230103cc-6259-4af7-9ac1-139db15aa643 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:28.746023 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5838c8-bd93-441e-ab84-9f71258d9a3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:28.746023 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5838c8-bd93-441e-ab84-9f71258d9a3b admin admin] REQUEST_METHOD: `PUT` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:28.746351 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5838c8-bd93-441e-ab84-9f71258d9a3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:28.746351 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5838c8-bd93-441e-ab84-9f71258d9a3b admin admin] PATH_INFO: `/v3/projects/da189a7e582d4ec78045a8187250ec12/users/b8698a12082b4952ae92f8877846c54b/roles/48808901834b4d5eab2c7e6b5b03791e` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:28.759589 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b413781d-5917-4fa4-9ca3-c41bdefaf418 admin admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:28.761229 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-b413781d-5917-4fa4-9ca3-c41bdefaf418 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:42:28.794061 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b413781d-5917-4fa4-9ca3-c41bdefaf418 admin admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:28.809273 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e804e214-2834-4936-ac44-41d64f3ea544 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:28.812537 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e804e214-2834-4936-ac44-41d64f3ea544 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:28.812828 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e804e214-2834-4936-ac44-41d64f3ea544 admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:28.815723 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e804e214-2834-4936-ac44-41d64f3ea544 admin admin] PATH_INFO: `/v3/projects/79476bd54f0d41089f2d6595c47c415d` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:28.820963 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5838c8-bd93-441e-ab84-9f71258d9a3b admin admin] RBAC: Authorizing `identity:create_grant(project_id=da189a7e582d4ec78045a8187250ec12, user_id=b8698a12082b4952ae92f8877846c54b, role_id=48808901834b4d5eab2c7e6b5b03791e)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:28.822585 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e804e214-2834-4936-ac44-41d64f3ea544 admin admin] RBAC: Authorizing `identity:delete_project(project_id=79476bd54f0d41089f2d6595c47c415d)` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:28.828927 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e804e214-2834-4936-ac44-41d64f3ea544 admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:28.830255 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5838c8-bd93-441e-ab84-9f71258d9a3b admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:28.870109 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 958/1894] 10.222.0.67 () {60 vars in 1482 bytes} [Wed May 25 14:42:28 2022] PUT /identity/v3/projects/da189a7e582d4ec78045a8187250ec12/users/b8698a12082b4952ae92f8877846c54b/roles/48808901834b4d5eab2c7e6b5b03791e => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 14:42:28.895294 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ff2251-8963-4210-a636-7b71e9e7e9a4 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:28.895614 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ff2251-8963-4210-a636-7b71e9e7e9a4 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:28.895856 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ff2251-8963-4210-a636-7b71e9e7e9a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:28.931066 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-55ff2251-8963-4210-a636-7b71e9e7e9a4 None None] MFA Rules not processed for user `b8698a12082b4952ae92f8877846c54b`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:42:28.932602 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-55ff2251-8963-4210-a636-7b71e9e7e9a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:42:28.940800 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-e804e214-2834-4936-ac44-41d64f3ea544 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '79476bd54f0d41089f2d6595c47c415d', 'request_id': 'req-e804e214-2834-4936-ac44-41d64f3ea544'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:42:28.951121 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-e804e214-2834-4936-ac44-41d64f3ea544 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '79476bd54f0d41089f2d6595c47c415d', 'request_id': 'req-e804e214-2834-4936-ac44-41d64f3ea544'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:42:28.961243 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-e804e214-2834-4936-ac44-41d64f3ea544 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '79476bd54f0d41089f2d6595c47c415d', 'request_id': 'req-e804e214-2834-4936-ac44-41d64f3ea544'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:42:28.975109 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-e804e214-2834-4936-ac44-41d64f3ea544 admin admin] The token cache is being invalidate because project 79476bd54f0d41089f2d6595c47c415d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80474) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 14:42:28.975601 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-e804e214-2834-4936-ac44-41d64f3ea544 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:42:28.976552 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-e804e214-2834-4936-ac44-41d64f3ea544 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:42:28.979062 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 937/1895] 10.222.0.67 () {58 vars in 1232 bytes} [Wed May 25 14:42:28 2022] DELETE /identity/v3/projects/79476bd54f0d41089f2d6595c47c415d => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 14:42:28.983231 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e804e214-2834-4936-ac44-41d64f3ea544 admin admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:28.986459 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-e804e214-2834-4936-ac44-41d64f3ea544 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:42:29.003958 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:29.010846 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 959/1896] 10.222.0.67 () {58 vars in 957 bytes} [Wed May 25 14:42:28 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 14:42:29.016108 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ff2251-8963-4210-a636-7b71e9e7e9a4 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:29.022410 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-55ff2251-8963-4210-a636-7b71e9e7e9a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:42:29.108262 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e804e214-2834-4936-ac44-41d64f3ea544 admin admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:29.113316 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8abbfdc-18d3-490b-b748-7a562dd5adaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:29.114199 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8abbfdc-18d3-490b-b748-7a562dd5adaa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:29.114488 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8abbfdc-18d3-490b-b748-7a562dd5adaa admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:29.114764 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8abbfdc-18d3-490b-b748-7a562dd5adaa admin admin] PATH_INFO: `/v3/users/0c9b37113a43498686f6ba3b93f564df` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:29.116180 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8abbfdc-18d3-490b-b748-7a562dd5adaa admin admin] RBAC: Authorizing `identity:delete_user(user_id=0c9b37113a43498686f6ba3b93f564df)` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:29.118145 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8abbfdc-18d3-490b-b748-7a562dd5adaa admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:29.124372 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ff2251-8963-4210-a636-7b71e9e7e9a4 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:29.129489 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f60c56-c238-4346-8fce-371df543a50a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:29.130423 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f60c56-c238-4346-8fce-371df543a50a admin admin] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:29.130718 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f60c56-c238-4346-8fce-371df543a50a admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:29.131311 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f60c56-c238-4346-8fce-371df543a50a admin admin] PATH_INFO: `/v3/projects` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:29.132017 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f60c56-c238-4346-8fce-371df543a50a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:29.133039 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:29.134059 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f60c56-c238-4346-8fce-371df543a50a admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:29.169841 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 960/1897] 10.222.0.67 () {60 vars in 1152 bytes} [Wed May 25 14:42:29 2022] POST /identity/v3/projects => generated 365 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:42:29.169841 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f60c56-c238-4346-8fce-371df543a50a admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:29.171526 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-57f60c56-c238-4346-8fce-371df543a50a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:42:29.174755 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-b8abbfdc-18d3-490b-b748-7a562dd5adaa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0c9b37113a43498686f6ba3b93f564df'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:42:29.175826 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-b8abbfdc-18d3-490b-b748-7a562dd5adaa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0c9b37113a43498686f6ba3b93f564df'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:42:29.176553 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-b8abbfdc-18d3-490b-b748-7a562dd5adaa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0c9b37113a43498686f6ba3b93f564df'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:42:29.190253 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-b8abbfdc-18d3-490b-b748-7a562dd5adaa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0c9b37113a43498686f6ba3b93f564df'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:42:29.198412 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-b8abbfdc-18d3-490b-b748-7a562dd5adaa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0c9b37113a43498686f6ba3b93f564df'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:42:29.214122 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 938/1898] 10.222.0.67 () {58 vars in 1223 bytes} [Wed May 25 14:42:28 2022] DELETE /identity/v3/users/0c9b37113a43498686f6ba3b93f564df => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:42:29.218553 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8abbfdc-18d3-490b-b748-7a562dd5adaa admin admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:29.221507 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-b8abbfdc-18d3-490b-b748-7a562dd5adaa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:42:29.246270 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f60c56-c238-4346-8fce-371df543a50a admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:29.298528 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8abbfdc-18d3-490b-b748-7a562dd5adaa admin admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:29.305340 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1316e8-fdd9-4db7-8f6f-6a65d4b2bb51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:29.306229 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1316e8-fdd9-4db7-8f6f-6a65d4b2bb51 admin admin] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:29.307102 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1316e8-fdd9-4db7-8f6f-6a65d4b2bb51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:29.307395 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1316e8-fdd9-4db7-8f6f-6a65d4b2bb51 admin admin] PATH_INFO: `/v3/users` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:29.308103 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1316e8-fdd9-4db7-8f6f-6a65d4b2bb51 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:29.310141 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1316e8-fdd9-4db7-8f6f-6a65d4b2bb51 admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:29.315977 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db27ce24-f64c-4b63-ba0b-c37ad67264a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:29.316913 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db27ce24-f64c-4b63-ba0b-c37ad67264a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:29.317201 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db27ce24-f64c-4b63-ba0b-c37ad67264a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:29.317502 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db27ce24-f64c-4b63-ba0b-c37ad67264a2 admin admin] PATH_INFO: `/v3/projects/3f1e57776a834295bf5bea465145b3b0` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:29.318969 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db27ce24-f64c-4b63-ba0b-c37ad67264a2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3f1e57776a834295bf5bea465145b3b0)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:29.322299 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db27ce24-f64c-4b63-ba0b-c37ad67264a2 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:29.342482 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 939/1899] 10.222.0.67 () {60 vars in 1143 bytes} [Wed May 25 14:42:29 2022] POST /identity/v3/users => generated 289 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:42:29.343672 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1316e8-fdd9-4db7-8f6f-6a65d4b2bb51 admin admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:29.360020 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1316e8-fdd9-4db7-8f6f-6a65d4b2bb51 admin admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:29.368577 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672a49e1-2ac4-4e63-b74a-026debe70ed7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:29.370338 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672a49e1-2ac4-4e63-b74a-026debe70ed7 admin admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:29.370965 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672a49e1-2ac4-4e63-b74a-026debe70ed7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:29.371352 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672a49e1-2ac4-4e63-b74a-026debe70ed7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:29.372268 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672a49e1-2ac4-4e63-b74a-026debe70ed7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:29.373908 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672a49e1-2ac4-4e63-b74a-026debe70ed7 admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:29.386365 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 940/1900] 10.222.0.67 () {58 vars in 1121 bytes} [Wed May 25 14:42:29 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:42:29.390511 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672a49e1-2ac4-4e63-b74a-026debe70ed7 admin admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:29.393184 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:29.406757 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672a49e1-2ac4-4e63-b74a-026debe70ed7 admin admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:29.407869 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-db27ce24-f64c-4b63-ba0b-c37ad67264a2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3f1e57776a834295bf5bea465145b3b0', 'request_id': 'req-db27ce24-f64c-4b63-ba0b-c37ad67264a2'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:42:29.416889 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-db27ce24-f64c-4b63-ba0b-c37ad67264a2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3f1e57776a834295bf5bea465145b3b0', 'request_id': 'req-db27ce24-f64c-4b63-ba0b-c37ad67264a2'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:42:29.426447 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-db27ce24-f64c-4b63-ba0b-c37ad67264a2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3f1e57776a834295bf5bea465145b3b0', 'request_id': 'req-db27ce24-f64c-4b63-ba0b-c37ad67264a2'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:42:29.453596 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-db27ce24-f64c-4b63-ba0b-c37ad67264a2 admin admin] The token cache is being invalidate because project 3f1e57776a834295bf5bea465145b3b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80475) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 14:42:29.454138 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-db27ce24-f64c-4b63-ba0b-c37ad67264a2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:42:29.455851 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-db27ce24-f64c-4b63-ba0b-c37ad67264a2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:42:29.458095 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 961/1901] 10.222.0.67 () {58 vars in 1232 bytes} [Wed May 25 14:42:29 2022] DELETE /identity/v3/projects/3f1e57776a834295bf5bea465145b3b0 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:42:29.461862 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db27ce24-f64c-4b63-ba0b-c37ad67264a2 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:29.464115 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-db27ce24-f64c-4b63-ba0b-c37ad67264a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:42:29.499624 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7ce036-0e9e-4d5d-be9c-bead77272b89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:29.501948 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7ce036-0e9e-4d5d-be9c-bead77272b89 admin admin] REQUEST_METHOD: `PUT` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:29.502341 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7ce036-0e9e-4d5d-be9c-bead77272b89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:29.502681 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7ce036-0e9e-4d5d-be9c-bead77272b89 admin admin] PATH_INFO: `/v3/projects/4b30a1ec738f4465b95684a6e0c0de92/users/f4f9a323f1de4dbe9baf6398c171823c/roles/399893e19eac4ab5a8e596f7c07be13c` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:29.526472 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7ce036-0e9e-4d5d-be9c-bead77272b89 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b30a1ec738f4465b95684a6e0c0de92, user_id=f4f9a323f1de4dbe9baf6398c171823c, role_id=399893e19eac4ab5a8e596f7c07be13c)` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:29.529484 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7ce036-0e9e-4d5d-be9c-bead77272b89 admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:29.531922 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:29.546982 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 941/1902] 10.222.0.67 () {60 vars in 1482 bytes} [Wed May 25 14:42:29 2022] PUT /identity/v3/projects/4b30a1ec738f4465b95684a6e0c0de92/users/f4f9a323f1de4dbe9baf6398c171823c/roles/399893e19eac4ab5a8e596f7c07be13c => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 14:42:29.551441 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7ce036-0e9e-4d5d-be9c-bead77272b89 admin admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:29.551930 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db27ce24-f64c-4b63-ba0b-c37ad67264a2 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:29.553137 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-eb7ce036-0e9e-4d5d-be9c-bead77272b89 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:42:29.626036 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5bbf3d-4683-439d-9a89-978d23619c92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:29.627751 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7ce036-0e9e-4d5d-be9c-bead77272b89 admin admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:29.628061 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5bbf3d-4683-439d-9a89-978d23619c92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:29.628437 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5bbf3d-4683-439d-9a89-978d23619c92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:29.628659 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5bbf3d-4683-439d-9a89-978d23619c92 admin admin] PATH_INFO: `/v3/users/7953b8664b334b5aaf100484ccdba23d` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:29.629946 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5bbf3d-4683-439d-9a89-978d23619c92 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7953b8664b334b5aaf100484ccdba23d)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:29.632203 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5bbf3d-4683-439d-9a89-978d23619c92 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:29.633293 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aafd740-209e-4100-a3e2-577045d41566 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:29.634036 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aafd740-209e-4100-a3e2-577045d41566 admin admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:29.634327 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aafd740-209e-4100-a3e2-577045d41566 admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:29.634606 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aafd740-209e-4100-a3e2-577045d41566 admin admin] PATH_INFO: `/v3/roles` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:29.635365 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aafd740-209e-4100-a3e2-577045d41566 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:29.637360 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aafd740-209e-4100-a3e2-577045d41566 admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:29.650572 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 942/1903] 10.222.0.67 () {58 vars in 1121 bytes} [Wed May 25 14:42:29 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 25 14:42:29.654377 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aafd740-209e-4100-a3e2-577045d41566 admin admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:29.665656 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aafd740-209e-4100-a3e2-577045d41566 admin admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:29.670962 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b15898-1421-48a4-91e7-addcfe0a5455 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:29.672096 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b15898-1421-48a4-91e7-addcfe0a5455 admin admin] REQUEST_METHOD: `PUT` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:29.672534 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b15898-1421-48a4-91e7-addcfe0a5455 admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:29.672813 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b15898-1421-48a4-91e7-addcfe0a5455 admin admin] PATH_INFO: `/v3/projects/4b30a1ec738f4465b95684a6e0c0de92/users/f4f9a323f1de4dbe9baf6398c171823c/roles/399893e19eac4ab5a8e596f7c07be13c` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:29.675447 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b15898-1421-48a4-91e7-addcfe0a5455 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b30a1ec738f4465b95684a6e0c0de92, user_id=f4f9a323f1de4dbe9baf6398c171823c, role_id=399893e19eac4ab5a8e596f7c07be13c)` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:29.678379 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b15898-1421-48a4-91e7-addcfe0a5455 admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:29.692774 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 943/1904] 10.222.0.67 () {60 vars in 1482 bytes} [Wed May 25 14:42:29 2022] PUT /identity/v3/projects/4b30a1ec738f4465b95684a6e0c0de92/users/f4f9a323f1de4dbe9baf6398c171823c/roles/399893e19eac4ab5a8e596f7c07be13c => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:42:29.700766 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-ca5bbf3d-4683-439d-9a89-978d23619c92 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7953b8664b334b5aaf100484ccdba23d'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:42:29.704964 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c32cc0-365a-4a6d-82a2-a1a15398a197 None None] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:29.705450 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c32cc0-365a-4a6d-82a2-a1a15398a197 None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:29.705616 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c32cc0-365a-4a6d-82a2-a1a15398a197 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:29.713983 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-ca5bbf3d-4683-439d-9a89-978d23619c92 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7953b8664b334b5aaf100484ccdba23d'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:42:29.715341 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-ca5bbf3d-4683-439d-9a89-978d23619c92 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7953b8664b334b5aaf100484ccdba23d'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:42:29.724717 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-ca5bbf3d-4683-439d-9a89-978d23619c92 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7953b8664b334b5aaf100484ccdba23d'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:42:29.734493 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:29.744722 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.auth.core [None req-67c32cc0-365a-4a6d-82a2-a1a15398a197 None None] MFA Rules not processed for user `f4f9a323f1de4dbe9baf6398c171823c`. Rule list: `[]` (Enabled: `True`). {{(pid=80474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:42:29.746019 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-ca5bbf3d-4683-439d-9a89-978d23619c92 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7953b8664b334b5aaf100484ccdba23d'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:42:29.746452 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-67c32cc0-365a-4a6d-82a2-a1a15398a197 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:42:29.766806 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 962/1905] 10.222.0.67 () {58 vars in 1223 bytes} [Wed May 25 14:42:29 2022] DELETE /identity/v3/users/7953b8664b334b5aaf100484ccdba23d => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 14:42:29.778629 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5bbf3d-4683-439d-9a89-978d23619c92 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:29.784047 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-ca5bbf3d-4683-439d-9a89-978d23619c92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:42:29.859829 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 944/1906] 10.222.0.67 () {58 vars in 957 bytes} [Wed May 25 14:42:29 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:42:29.875433 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c32cc0-365a-4a6d-82a2-a1a15398a197 None None] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:29.880111 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-67c32cc0-365a-4a6d-82a2-a1a15398a197 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:42:29.978308 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5bbf3d-4683-439d-9a89-978d23619c92 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:29.990288 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c32cc0-365a-4a6d-82a2-a1a15398a197 None None] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:30.010740 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3657dc93-1e3f-4415-93ab-b6020f9ed36c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:30.014770 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3657dc93-1e3f-4415-93ab-b6020f9ed36c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:30.015962 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3657dc93-1e3f-4415-93ab-b6020f9ed36c admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:30.016862 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3657dc93-1e3f-4415-93ab-b6020f9ed36c admin admin] PATH_INFO: `/v3/projects/ae8a5ac8dcdd4051b5d2a2e81807871d` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:30.020582 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3657dc93-1e3f-4415-93ab-b6020f9ed36c admin admin] RBAC: Authorizing `identity:delete_project(project_id=ae8a5ac8dcdd4051b5d2a2e81807871d)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:30.024814 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:30.027310 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3657dc93-1e3f-4415-93ab-b6020f9ed36c admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:30.128877 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-3657dc93-1e3f-4415-93ab-b6020f9ed36c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ae8a5ac8dcdd4051b5d2a2e81807871d', 'request_id': 'req-3657dc93-1e3f-4415-93ab-b6020f9ed36c'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:42:30.136526 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-3657dc93-1e3f-4415-93ab-b6020f9ed36c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ae8a5ac8dcdd4051b5d2a2e81807871d', 'request_id': 'req-3657dc93-1e3f-4415-93ab-b6020f9ed36c'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:42:30.142840 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d2274d-d7dc-48a3-97e3-fb261903fd76 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e462acc9da84a61bb23998dd54e1858', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfe93ee8d32a441295efc0b885de4bd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:30.143714 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d2274d-d7dc-48a3-97e3-fb261903fd76 service cinder] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:30.144007 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d2274d-d7dc-48a3-97e3-fb261903fd76 service cinder] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:30.144286 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d2274d-d7dc-48a3-97e3-fb261903fd76 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:30.148382 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-3657dc93-1e3f-4415-93ab-b6020f9ed36c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ae8a5ac8dcdd4051b5d2a2e81807871d', 'request_id': 'req-3657dc93-1e3f-4415-93ab-b6020f9ed36c'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:42:30.188375 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-3657dc93-1e3f-4415-93ab-b6020f9ed36c admin admin] The token cache is being invalidate because project ae8a5ac8dcdd4051b5d2a2e81807871d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80475) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 14:42:30.188699 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-3657dc93-1e3f-4415-93ab-b6020f9ed36c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:42:30.189774 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-3657dc93-1e3f-4415-93ab-b6020f9ed36c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:42:30.192316 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 963/1907] 10.222.0.67 () {58 vars in 1232 bytes} [Wed May 25 14:42:29 2022] DELETE /identity/v3/projects/ae8a5ac8dcdd4051b5d2a2e81807871d => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:42:30.208124 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02d9eed-c19e-459b-9b9c-674516fd6e1f None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:30.208475 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02d9eed-c19e-459b-9b9c-674516fd6e1f None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:30.208766 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02d9eed-c19e-459b-9b9c-674516fd6e1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:30.240826 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-e02d9eed-c19e-459b-9b9c-674516fd6e1f None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:42:30.242437 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-e02d9eed-c19e-459b-9b9c-674516fd6e1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:42:30.281071 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d2274d-d7dc-48a3-97e3-fb261903fd76 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:30.284279 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d2274d-d7dc-48a3-97e3-fb261903fd76 service cinder] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:30.297516 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 945/1908] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 14:42:29 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:42:30.336050 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 964/1909] 10.222.0.67 () {58 vars in 957 bytes} [Wed May 25 14:42:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:42:30.343986 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766d8bfe-ba4e-4830-89c0-79199fa165d9 None None] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:30.344289 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766d8bfe-ba4e-4830-89c0-79199fa165d9 None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:30.344678 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766d8bfe-ba4e-4830-89c0-79199fa165d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:30.402805 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.auth.core [None req-766d8bfe-ba4e-4830-89c0-79199fa165d9 None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:42:30.405294 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-766d8bfe-ba4e-4830-89c0-79199fa165d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:42:30.421265 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02d9eed-c19e-459b-9b9c-674516fd6e1f None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:30.423970 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-e02d9eed-c19e-459b-9b9c-674516fd6e1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:42:30.427669 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 946/1910] 10.222.0.67 () {58 vars in 957 bytes} [Wed May 25 14:42:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:42:30.432909 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766d8bfe-ba4e-4830-89c0-79199fa165d9 None None] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:30.444838 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02d9eed-c19e-459b-9b9c-674516fd6e1f None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:30.453974 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b6d62e-4ac1-4c84-accf-37a901e4dfd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:30.455162 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766d8bfe-ba4e-4830-89c0-79199fa165d9 None None] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:30.457235 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b6d62e-4ac1-4c84-accf-37a901e4dfd0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:30.457890 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b6d62e-4ac1-4c84-accf-37a901e4dfd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:30.458443 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b6d62e-4ac1-4c84-accf-37a901e4dfd0 admin admin] PATH_INFO: `/v3/projects/c5a92c9986fa4a37993ad91bb4344cb0` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:30.460835 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b6d62e-4ac1-4c84-accf-37a901e4dfd0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c5a92c9986fa4a37993ad91bb4344cb0)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:30.464036 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b6d62e-4ac1-4c84-accf-37a901e4dfd0 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:30.467568 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc18d42a-f0a9-474a-90b3-78a4a49dbe50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:30.468414 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc18d42a-f0a9-474a-90b3-78a4a49dbe50 admin admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:30.469330 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc18d42a-f0a9-474a-90b3-78a4a49dbe50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:30.469695 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc18d42a-f0a9-474a-90b3-78a4a49dbe50 admin admin] PATH_INFO: `/v3/domains` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:30.471071 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc18d42a-f0a9-474a-90b3-78a4a49dbe50 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:42:30.471794 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc18d42a-f0a9-474a-90b3-78a4a49dbe50 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:30.477349 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc18d42a-f0a9-474a-90b3-78a4a49dbe50 admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:30.512289 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 947/1911] 10.222.0.67 () {58 vars in 1152 bytes} [Wed May 25 14:42:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:42:30.519272 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc18d42a-f0a9-474a-90b3-78a4a49dbe50 admin admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:30.520725 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:30.540262 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc18d42a-f0a9-474a-90b3-78a4a49dbe50 admin admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:30.547615 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fef38af-006d-4f1f-8418-90b8c0331fa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:30.549027 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fef38af-006d-4f1f-8418-90b8c0331fa1 admin admin] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:30.551069 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fef38af-006d-4f1f-8418-90b8c0331fa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:30.551957 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fef38af-006d-4f1f-8418-90b8c0331fa1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:30.552717 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fef38af-006d-4f1f-8418-90b8c0331fa1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:30.554679 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fef38af-006d-4f1f-8418-90b8c0331fa1 admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:30.586724 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-08b6d62e-4ac1-4c84-accf-37a901e4dfd0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c5a92c9986fa4a37993ad91bb4344cb0', 'request_id': 'req-08b6d62e-4ac1-4c84-accf-37a901e4dfd0'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:42:30.593060 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 948/1912] 10.222.0.67 () {60 vars in 1152 bytes} [Wed May 25 14:42:30 2022] POST /identity/v3/projects => generated 381 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:42:30.597183 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fef38af-006d-4f1f-8418-90b8c0331fa1 admin admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:30.600339 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-08b6d62e-4ac1-4c84-accf-37a901e4dfd0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c5a92c9986fa4a37993ad91bb4344cb0', 'request_id': 'req-08b6d62e-4ac1-4c84-accf-37a901e4dfd0'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:42:30.602293 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-3fef38af-006d-4f1f-8418-90b8c0331fa1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:42:30.613324 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-08b6d62e-4ac1-4c84-accf-37a901e4dfd0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c5a92c9986fa4a37993ad91bb4344cb0', 'request_id': 'req-08b6d62e-4ac1-4c84-accf-37a901e4dfd0'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:42:30.679559 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-08b6d62e-4ac1-4c84-accf-37a901e4dfd0 admin admin] The token cache is being invalidate because project c5a92c9986fa4a37993ad91bb4344cb0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80475) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 14:42:30.680572 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-08b6d62e-4ac1-4c84-accf-37a901e4dfd0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:42:30.684116 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-08b6d62e-4ac1-4c84-accf-37a901e4dfd0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:42:30.691321 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 965/1913] 10.222.0.67 () {58 vars in 1232 bytes} [Wed May 25 14:42:30 2022] DELETE /identity/v3/projects/c5a92c9986fa4a37993ad91bb4344cb0 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:42:30.696426 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b6d62e-4ac1-4c84-accf-37a901e4dfd0 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:30.699947 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-08b6d62e-4ac1-4c84-accf-37a901e4dfd0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:42:30.703060 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fef38af-006d-4f1f-8418-90b8c0331fa1 admin admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:30.707828 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46b56a5-f174-4979-b910-61a6a71b6f89 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e462acc9da84a61bb23998dd54e1858', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfe93ee8d32a441295efc0b885de4bd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:30.708895 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46b56a5-f174-4979-b910-61a6a71b6f89 service cinder] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:30.709225 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46b56a5-f174-4979-b910-61a6a71b6f89 service cinder] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:30.710106 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46b56a5-f174-4979-b910-61a6a71b6f89 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:30.712048 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-f46b56a5-f174-4979-b910-61a6a71b6f89 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:42:30.781936 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:30.803502 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46b56a5-f174-4979-b910-61a6a71b6f89 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:30.805033 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b6d62e-4ac1-4c84-accf-37a901e4dfd0 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:30.805185 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46b56a5-f174-4979-b910-61a6a71b6f89 service cinder] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:30.817997 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 949/1914] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 14:42:30 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:42:30.819532 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bdc55a-e444-41e0-b07b-90ba3cac45b2 None None] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:30.819901 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bdc55a-e444-41e0-b07b-90ba3cac45b2 None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:30.820250 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bdc55a-e444-41e0-b07b-90ba3cac45b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:30.852181 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.auth.core [None req-f9bdc55a-e444-41e0-b07b-90ba3cac45b2 None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:42:30.855507 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-f9bdc55a-e444-41e0-b07b-90ba3cac45b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:42:30.918883 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa23114-b00c-4342-b091-bde6571ae134 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:30.919836 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa23114-b00c-4342-b091-bde6571ae134 admin admin] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:30.920267 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa23114-b00c-4342-b091-bde6571ae134 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:30.920782 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa23114-b00c-4342-b091-bde6571ae134 admin admin] PATH_INFO: `/v3/users` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:30.921590 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa23114-b00c-4342-b091-bde6571ae134 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:30.925700 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa23114-b00c-4342-b091-bde6571ae134 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:30.956273 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 966/1915] 10.222.0.67 () {60 vars in 1143 bytes} [Wed May 25 14:42:30 2022] POST /identity/v3/users => generated 291 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:42:30.960849 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa23114-b00c-4342-b091-bde6571ae134 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:30.974673 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa23114-b00c-4342-b091-bde6571ae134 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:30.980356 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07940256-e2c1-44a7-ba01-78849172a260 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:30.981047 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07940256-e2c1-44a7-ba01-78849172a260 admin admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:30.981340 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07940256-e2c1-44a7-ba01-78849172a260 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:30.981623 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07940256-e2c1-44a7-ba01-78849172a260 admin admin] PATH_INFO: `/v3/roles` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:30.981727 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 950/1916] 10.222.0.67 () {58 vars in 957 bytes} [Wed May 25 14:42:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:42:30.982634 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07940256-e2c1-44a7-ba01-78849172a260 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:30.984589 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07940256-e2c1-44a7-ba01-78849172a260 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:30.991443 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b92adf5-7362-4f96-9032-e5ad8166d164 None None] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:30.991732 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b92adf5-7362-4f96-9032-e5ad8166d164 None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:30.992009 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b92adf5-7362-4f96-9032-e5ad8166d164 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:30.999626 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 967/1917] 10.222.0.67 () {58 vars in 1121 bytes} [Wed May 25 14:42:30 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:42:31.004416 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07940256-e2c1-44a7-ba01-78849172a260 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:31.014764 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.auth.core [None req-2b92adf5-7362-4f96-9032-e5ad8166d164 None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:42:31.016053 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-2b92adf5-7362-4f96-9032-e5ad8166d164 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:42:31.021718 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07940256-e2c1-44a7-ba01-78849172a260 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:31.028531 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2998be5b-35a4-4cb5-900a-866255bf3dde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:31.029548 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2998be5b-35a4-4cb5-900a-866255bf3dde admin admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:31.030492 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2998be5b-35a4-4cb5-900a-866255bf3dde admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:31.031335 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2998be5b-35a4-4cb5-900a-866255bf3dde admin admin] PATH_INFO: `/v3/roles` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:31.033675 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2998be5b-35a4-4cb5-900a-866255bf3dde admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:31.036192 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2998be5b-35a4-4cb5-900a-866255bf3dde admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:31.039607 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 951/1918] 10.222.0.67 () {58 vars in 957 bytes} [Wed May 25 14:42:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 14:42:31.041607 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b92adf5-7362-4f96-9032-e5ad8166d164 None None] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:31.052435 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 968/1919] 10.222.0.67 () {58 vars in 1121 bytes} [Wed May 25 14:42:31 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:42:31.056736 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2998be5b-35a4-4cb5-900a-866255bf3dde admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:31.060097 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b92adf5-7362-4f96-9032-e5ad8166d164 None None] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:31.066047 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c928a60b-34b4-48bc-9c88-20d9578f68c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:31.066736 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c928a60b-34b4-48bc-9c88-20d9578f68c1 admin admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:31.067261 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c928a60b-34b4-48bc-9c88-20d9578f68c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:31.067453 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c928a60b-34b4-48bc-9c88-20d9578f68c1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:31.068705 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c928a60b-34b4-48bc-9c88-20d9578f68c1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:42:31.069020 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c928a60b-34b4-48bc-9c88-20d9578f68c1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:31.069955 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2998be5b-35a4-4cb5-900a-866255bf3dde admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:31.073595 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c928a60b-34b4-48bc-9c88-20d9578f68c1 admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:31.075294 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf744f1a-074e-43d9-b663-9b0e87f20a64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:31.076440 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf744f1a-074e-43d9-b663-9b0e87f20a64 admin admin] REQUEST_METHOD: `PUT` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:31.076979 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf744f1a-074e-43d9-b663-9b0e87f20a64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:31.077338 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf744f1a-074e-43d9-b663-9b0e87f20a64 admin admin] PATH_INFO: `/v3/projects/71ebadfa41324bc5a9ba98ee3b2d0a39/users/b86f3f46e4ec4bbabd036b81f4bbd607/roles/48808901834b4d5eab2c7e6b5b03791e` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:31.094469 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf744f1a-074e-43d9-b663-9b0e87f20a64 admin admin] RBAC: Authorizing `identity:create_grant(project_id=71ebadfa41324bc5a9ba98ee3b2d0a39, user_id=b86f3f46e4ec4bbabd036b81f4bbd607, role_id=48808901834b4d5eab2c7e6b5b03791e)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:31.096937 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 952/1920] 10.222.0.67 () {58 vars in 1152 bytes} [Wed May 25 14:42:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:42:31.098499 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf744f1a-074e-43d9-b663-9b0e87f20a64 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:31.101040 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c928a60b-34b4-48bc-9c88-20d9578f68c1 admin admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:31.101860 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:31.115293 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c928a60b-34b4-48bc-9c88-20d9578f68c1 admin admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:31.117523 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 969/1921] 10.222.0.67 () {60 vars in 1482 bytes} [Wed May 25 14:42:31 2022] PUT /identity/v3/projects/71ebadfa41324bc5a9ba98ee3b2d0a39/users/b86f3f46e4ec4bbabd036b81f4bbd607/roles/48808901834b4d5eab2c7e6b5b03791e => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:42:31.127599 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8a94cc-9a19-41c9-9814-60c7d105f637 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:31.127892 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8a94cc-9a19-41c9-9814-60c7d105f637 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:31.128175 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8a94cc-9a19-41c9-9814-60c7d105f637 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:31.154837 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-df8a94cc-9a19-41c9-9814-60c7d105f637 None None] MFA Rules not processed for user `b86f3f46e4ec4bbabd036b81f4bbd607`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:42:31.156101 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-df8a94cc-9a19-41c9-9814-60c7d105f637 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:42:31.184314 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9effcd4-67c7-4bc5-9612-dbfa2852985c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:31.184991 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9effcd4-67c7-4bc5-9612-dbfa2852985c admin admin] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:31.185273 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9effcd4-67c7-4bc5-9612-dbfa2852985c admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:31.185549 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9effcd4-67c7-4bc5-9612-dbfa2852985c admin admin] PATH_INFO: `/v3/projects` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:31.186242 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9effcd4-67c7-4bc5-9612-dbfa2852985c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:31.188240 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9effcd4-67c7-4bc5-9612-dbfa2852985c admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:31.221895 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 953/1922] 10.222.0.67 () {60 vars in 1152 bytes} [Wed May 25 14:42:31 2022] POST /identity/v3/projects => generated 371 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 14:42:31.226021 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9effcd4-67c7-4bc5-9612-dbfa2852985c admin admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:31.240120 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 970/1923] 10.222.0.67 () {58 vars in 957 bytes} [Wed May 25 14:42:31 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 14:42:31.244454 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8a94cc-9a19-41c9-9814-60c7d105f637 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:31.257233 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8a94cc-9a19-41c9-9814-60c7d105f637 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:31.291606 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:31.312718 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9effcd4-67c7-4bc5-9612-dbfa2852985c admin admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:31.318941 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad4f9b3-61f5-45ad-bf47-0c2c9b2b3350 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:31.319666 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad4f9b3-61f5-45ad-bf47-0c2c9b2b3350 admin admin] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:31.319953 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad4f9b3-61f5-45ad-bf47-0c2c9b2b3350 admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:31.320233 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad4f9b3-61f5-45ad-bf47-0c2c9b2b3350 admin admin] PATH_INFO: `/v3/users` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:31.320940 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad4f9b3-61f5-45ad-bf47-0c2c9b2b3350 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:31.321775 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20ab3a5-bf4a-4ab7-b88b-d551b14de8bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:31.322453 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20ab3a5-bf4a-4ab7-b88b-d551b14de8bd admin admin] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:31.322736 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20ab3a5-bf4a-4ab7-b88b-d551b14de8bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:31.322908 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad4f9b3-61f5-45ad-bf47-0c2c9b2b3350 admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:31.323268 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20ab3a5-bf4a-4ab7-b88b-d551b14de8bd admin admin] PATH_INFO: `/v3/projects` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:31.324141 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20ab3a5-bf4a-4ab7-b88b-d551b14de8bd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:31.327272 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20ab3a5-bf4a-4ab7-b88b-d551b14de8bd admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:31.350055 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 954/1924] 10.222.0.67 () {60 vars in 1143 bytes} [Wed May 25 14:42:31 2022] POST /identity/v3/users => generated 286 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 14:42:31.351390 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad4f9b3-61f5-45ad-bf47-0c2c9b2b3350 admin admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:31.362452 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad4f9b3-61f5-45ad-bf47-0c2c9b2b3350 admin admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:31.363722 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 971/1925] 10.222.0.67 () {60 vars in 1152 bytes} [Wed May 25 14:42:31 2022] POST /identity/v3/projects => generated 379 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:42:31.367676 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20ab3a5-bf4a-4ab7-b88b-d551b14de8bd admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:31.438096 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce1025f-1867-4577-9340-90bb2854c911 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:31.438842 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce1025f-1867-4577-9340-90bb2854c911 admin admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:31.439161 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce1025f-1867-4577-9340-90bb2854c911 admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:31.439443 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce1025f-1867-4577-9340-90bb2854c911 admin admin] PATH_INFO: `/v3/roles` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:31.440193 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce1025f-1867-4577-9340-90bb2854c911 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:31.441890 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce1025f-1867-4577-9340-90bb2854c911 admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:31.449137 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20ab3a5-bf4a-4ab7-b88b-d551b14de8bd admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:31.453308 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 955/1926] 10.222.0.67 () {58 vars in 1121 bytes} [Wed May 25 14:42:31 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 25 14:42:31.455979 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a9a79f-ec6e-4345-ba27-d128a230213d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:31.456999 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a9a79f-ec6e-4345-ba27-d128a230213d admin admin] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:31.457397 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a9a79f-ec6e-4345-ba27-d128a230213d admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:31.457780 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a9a79f-ec6e-4345-ba27-d128a230213d admin admin] PATH_INFO: `/v3/users` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:31.458567 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a9a79f-ec6e-4345-ba27-d128a230213d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:31.460970 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a9a79f-ec6e-4345-ba27-d128a230213d admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:31.464066 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce1025f-1867-4577-9340-90bb2854c911 admin admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:31.479174 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce1025f-1867-4577-9340-90bb2854c911 admin admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:31.486298 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:31.486494 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81449a75-3d99-4918-bdf8-cb483f974123 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:31.487361 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81449a75-3d99-4918-bdf8-cb483f974123 admin admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:31.487653 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81449a75-3d99-4918-bdf8-cb483f974123 admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:31.487932 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81449a75-3d99-4918-bdf8-cb483f974123 admin admin] PATH_INFO: `/v3/roles` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:31.488848 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81449a75-3d99-4918-bdf8-cb483f974123 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:31.491187 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81449a75-3d99-4918-bdf8-cb483f974123 admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:31.500094 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 972/1927] 10.222.0.67 () {60 vars in 1143 bytes} [Wed May 25 14:42:31 2022] POST /identity/v3/users => generated 296 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 14:42:31.502131 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a9a79f-ec6e-4345-ba27-d128a230213d admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:31.505516 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 956/1928] 10.222.0.67 () {58 vars in 1121 bytes} [Wed May 25 14:42:31 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:42:31.510221 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81449a75-3d99-4918-bdf8-cb483f974123 admin admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:31.522389 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a9a79f-ec6e-4345-ba27-d128a230213d admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:31.523462 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81449a75-3d99-4918-bdf8-cb483f974123 admin admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:31.528797 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c1b5e2-35b3-48df-8218-83178cbdaad4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:31.529274 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259e4567-c811-4080-aeac-6962f625a650 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:31.529673 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c1b5e2-35b3-48df-8218-83178cbdaad4 admin admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:31.530085 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c1b5e2-35b3-48df-8218-83178cbdaad4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:31.530626 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c1b5e2-35b3-48df-8218-83178cbdaad4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:31.530874 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259e4567-c811-4080-aeac-6962f625a650 admin admin] REQUEST_METHOD: `PUT` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:31.531386 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259e4567-c811-4080-aeac-6962f625a650 admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:31.531526 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c1b5e2-35b3-48df-8218-83178cbdaad4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:31.531902 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259e4567-c811-4080-aeac-6962f625a650 admin admin] PATH_INFO: `/v3/projects/798c254db1c341d981f90f8e0e3fcd5f/users/57b13c7f91e742e684b3f2d9bd3ee736/roles/48808901834b4d5eab2c7e6b5b03791e` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:31.534856 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c1b5e2-35b3-48df-8218-83178cbdaad4 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:31.555266 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 973/1929] 10.222.0.67 () {58 vars in 1121 bytes} [Wed May 25 14:42:31 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:42:31.555439 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259e4567-c811-4080-aeac-6962f625a650 admin admin] RBAC: Authorizing `identity:create_grant(project_id=798c254db1c341d981f90f8e0e3fcd5f, user_id=57b13c7f91e742e684b3f2d9bd3ee736, role_id=48808901834b4d5eab2c7e6b5b03791e)` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:31.556471 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259e4567-c811-4080-aeac-6962f625a650 admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:31.556573 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c1b5e2-35b3-48df-8218-83178cbdaad4 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:31.580802 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 957/1930] 10.222.0.67 () {60 vars in 1482 bytes} [Wed May 25 14:42:31 2022] PUT /identity/v3/projects/798c254db1c341d981f90f8e0e3fcd5f/users/57b13c7f91e742e684b3f2d9bd3ee736/roles/48808901834b4d5eab2c7e6b5b03791e => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 14:42:31.592914 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f44098-8ea6-460d-b123-90e8d667ad0a None None] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:31.593203 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f44098-8ea6-460d-b123-90e8d667ad0a None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:31.593493 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f44098-8ea6-460d-b123-90e8d667ad0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:31.603247 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c1b5e2-35b3-48df-8218-83178cbdaad4 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:31.641825 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.auth.core [None req-49f44098-8ea6-460d-b123-90e8d667ad0a None None] MFA Rules not processed for user `57b13c7f91e742e684b3f2d9bd3ee736`. Rule list: `[]` (Enabled: `True`). {{(pid=80474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:42:31.644073 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-49f44098-8ea6-460d-b123-90e8d667ad0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:42:31.693617 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85905585-f3ea-4e73-bde5-320345736bf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:31.694611 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85905585-f3ea-4e73-bde5-320345736bf7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:31.695149 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85905585-f3ea-4e73-bde5-320345736bf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:31.695549 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85905585-f3ea-4e73-bde5-320345736bf7 admin admin] PATH_INFO: `/v3/projects/35e2b88ad399432bb94479f25964e1d9/users/1b500c5a084047c49c83e7dc76501307/roles/399893e19eac4ab5a8e596f7c07be13c` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:31.715304 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85905585-f3ea-4e73-bde5-320345736bf7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=35e2b88ad399432bb94479f25964e1d9, user_id=1b500c5a084047c49c83e7dc76501307, role_id=399893e19eac4ab5a8e596f7c07be13c)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:31.718231 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85905585-f3ea-4e73-bde5-320345736bf7 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:31.764061 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 974/1931] 10.222.0.67 () {60 vars in 1482 bytes} [Wed May 25 14:42:31 2022] PUT /identity/v3/projects/35e2b88ad399432bb94479f25964e1d9/users/1b500c5a084047c49c83e7dc76501307/roles/399893e19eac4ab5a8e596f7c07be13c => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:42:31.768863 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85905585-f3ea-4e73-bde5-320345736bf7 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:31.788761 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 958/1932] 10.222.0.67 () {58 vars in 957 bytes} [Wed May 25 14:42:31 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:42:31.797901 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f44098-8ea6-460d-b123-90e8d667ad0a None None] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:31.800312 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-49f44098-8ea6-460d-b123-90e8d667ad0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:42:31.863007 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:31.872411 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85905585-f3ea-4e73-bde5-320345736bf7 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:31.878352 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f580fe8a-d84c-482c-945e-9a6aacdfb769 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:31.879277 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f580fe8a-d84c-482c-945e-9a6aacdfb769 admin admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:31.879620 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f580fe8a-d84c-482c-945e-9a6aacdfb769 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:31.879954 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f580fe8a-d84c-482c-945e-9a6aacdfb769 admin admin] PATH_INFO: `/v3/roles` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:31.880650 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f580fe8a-d84c-482c-945e-9a6aacdfb769 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:31.883493 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f580fe8a-d84c-482c-945e-9a6aacdfb769 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:31.902891 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 975/1933] 10.222.0.67 () {58 vars in 1121 bytes} [Wed May 25 14:42:31 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:42:31.902891 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f580fe8a-d84c-482c-945e-9a6aacdfb769 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:31.914318 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f580fe8a-d84c-482c-945e-9a6aacdfb769 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:31.919771 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec6f78c-43dd-4d42-8fd2-f24f7c85666c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:31.920860 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec6f78c-43dd-4d42-8fd2-f24f7c85666c admin admin] REQUEST_METHOD: `PUT` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:31.921151 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec6f78c-43dd-4d42-8fd2-f24f7c85666c admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:31.921436 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec6f78c-43dd-4d42-8fd2-f24f7c85666c admin admin] PATH_INFO: `/v3/projects/35e2b88ad399432bb94479f25964e1d9/users/1b500c5a084047c49c83e7dc76501307/roles/399893e19eac4ab5a8e596f7c07be13c` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:31.923666 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec6f78c-43dd-4d42-8fd2-f24f7c85666c admin admin] RBAC: Authorizing `identity:create_grant(project_id=35e2b88ad399432bb94479f25964e1d9, user_id=1b500c5a084047c49c83e7dc76501307, role_id=399893e19eac4ab5a8e596f7c07be13c)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:31.926316 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec6f78c-43dd-4d42-8fd2-f24f7c85666c admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:31.927840 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f44098-8ea6-460d-b123-90e8d667ad0a None None] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:31.951658 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 976/1934] 10.222.0.67 () {60 vars in 1482 bytes} [Wed May 25 14:42:31 2022] PUT /identity/v3/projects/35e2b88ad399432bb94479f25964e1d9/users/1b500c5a084047c49c83e7dc76501307/roles/399893e19eac4ab5a8e596f7c07be13c => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:42:31.954165 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcadb56-2f9b-4efd-830f-4a2fd5be3c1d None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:31.955479 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcadb56-2f9b-4efd-830f-4a2fd5be3c1d None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:31.956082 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcadb56-2f9b-4efd-830f-4a2fd5be3c1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:31.987571 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-cfcadb56-2f9b-4efd-830f-4a2fd5be3c1d None None] MFA Rules not processed for user `1b500c5a084047c49c83e7dc76501307`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:42:31.989147 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-cfcadb56-2f9b-4efd-830f-4a2fd5be3c1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:42:31.994122 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d965503e-b209-4042-874d-37115b5ba090 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5e4d67668ce40509e057f4f4c994521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfe93ee8d32a441295efc0b885de4bd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:31.994796 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d965503e-b209-4042-874d-37115b5ba090 service glance] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:31.995214 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d965503e-b209-4042-874d-37115b5ba090 service glance] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:31.995503 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d965503e-b209-4042-874d-37115b5ba090 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:32.045099 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:32.078523 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d965503e-b209-4042-874d-37115b5ba090 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:32.080242 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d965503e-b209-4042-874d-37115b5ba090 service glance] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:32.089558 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 977/1935] 10.222.0.67 () {58 vars in 957 bytes} [Wed May 25 14:42:31 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 14:42:32.097972 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcadb56-2f9b-4efd-830f-4a2fd5be3c1d None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:32.100779 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-cfcadb56-2f9b-4efd-830f-4a2fd5be3c1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:42:32.100921 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 959/1936] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 14:42:31 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 14:42:32.180052 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcadb56-2f9b-4efd-830f-4a2fd5be3c1d None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:32.183674 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3598de-5930-4310-a6d3-e4a1e793107b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e462acc9da84a61bb23998dd54e1858', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfe93ee8d32a441295efc0b885de4bd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:32.184328 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3598de-5930-4310-a6d3-e4a1e793107b service cinder] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:32.184617 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3598de-5930-4310-a6d3-e4a1e793107b service cinder] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:32.184891 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3598de-5930-4310-a6d3-e4a1e793107b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:32.195545 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3598de-5930-4310-a6d3-e4a1e793107b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:32.197262 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3598de-5930-4310-a6d3-e4a1e793107b service cinder] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:32.207880 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 978/1937] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 14:42:32 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 14:42:33.547251 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d965503e-b209-4042-874d-37115b5ba090 service glance] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:33.570912 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d965503e-b209-4042-874d-37115b5ba090 service glance] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:33.695525 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed8bc6a-c1dd-406f-a2e9-6ca1ff45f533 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:33.696926 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed8bc6a-c1dd-406f-a2e9-6ca1ff45f533 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:33.696926 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed8bc6a-c1dd-406f-a2e9-6ca1ff45f533 admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:33.697120 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed8bc6a-c1dd-406f-a2e9-6ca1ff45f533 admin admin] PATH_INFO: `/v3/users/b86f3f46e4ec4bbabd036b81f4bbd607` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:33.698438 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed8bc6a-c1dd-406f-a2e9-6ca1ff45f533 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b86f3f46e4ec4bbabd036b81f4bbd607)` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:33.701770 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed8bc6a-c1dd-406f-a2e9-6ca1ff45f533 admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:33.756418 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:33.763684 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-7ed8bc6a-c1dd-406f-a2e9-6ca1ff45f533 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b86f3f46e4ec4bbabd036b81f4bbd607'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:42:33.764750 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-7ed8bc6a-c1dd-406f-a2e9-6ca1ff45f533 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b86f3f46e4ec4bbabd036b81f4bbd607'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:42:33.765409 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-7ed8bc6a-c1dd-406f-a2e9-6ca1ff45f533 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b86f3f46e4ec4bbabd036b81f4bbd607'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:42:33.779246 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-7ed8bc6a-c1dd-406f-a2e9-6ca1ff45f533 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b86f3f46e4ec4bbabd036b81f4bbd607'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:42:33.788032 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-7ed8bc6a-c1dd-406f-a2e9-6ca1ff45f533 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b86f3f46e4ec4bbabd036b81f4bbd607'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:42:33.801599 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 960/1938] 10.222.0.67 () {58 vars in 1223 bytes} [Wed May 25 14:42:33 2022] DELETE /identity/v3/users/b86f3f46e4ec4bbabd036b81f4bbd607 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:42:33.805990 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6268eb7d-53d1-4a68-8774-7864f7782ca8 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:33.806507 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6268eb7d-53d1-4a68-8774-7864f7782ca8 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:33.806668 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6268eb7d-53d1-4a68-8774-7864f7782ca8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:33.830008 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-6268eb7d-53d1-4a68-8774-7864f7782ca8 None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:42:33.830008 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-6268eb7d-53d1-4a68-8774-7864f7782ca8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:42:33.912566 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 979/1939] 10.222.0.67 () {58 vars in 957 bytes} [Wed May 25 14:42:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:42:33.930627 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed8bc6a-c1dd-406f-a2e9-6ca1ff45f533 admin admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:33.934373 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-7ed8bc6a-c1dd-406f-a2e9-6ca1ff45f533 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:42:34.058353 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed8bc6a-c1dd-406f-a2e9-6ca1ff45f533 admin admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:34.062161 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f539c68-847c-4fb6-a5ac-0d8f34ec7bbf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b68eed985c7b49839bcdd173186ad4ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfe93ee8d32a441295efc0b885de4bd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:34.062875 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f539c68-847c-4fb6-a5ac-0d8f34ec7bbf service neutron] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:34.063211 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f539c68-847c-4fb6-a5ac-0d8f34ec7bbf service neutron] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:34.063490 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f539c68-847c-4fb6-a5ac-0d8f34ec7bbf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:34.077633 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f539c68-847c-4fb6-a5ac-0d8f34ec7bbf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:34.079146 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f539c68-847c-4fb6-a5ac-0d8f34ec7bbf service neutron] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:34.090257 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 961/1940] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 14:42:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:42:34.447544 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6268eb7d-53d1-4a68-8774-7864f7782ca8 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:34.450299 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-6268eb7d-53d1-4a68-8774-7864f7782ca8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:42:34.495683 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6268eb7d-53d1-4a68-8774-7864f7782ca8 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:34.506844 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fa824f-32e9-4376-ba97-4c0d402ef2b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:34.511578 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fa824f-32e9-4376-ba97-4c0d402ef2b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:34.512565 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fa824f-32e9-4376-ba97-4c0d402ef2b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:34.513307 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fa824f-32e9-4376-ba97-4c0d402ef2b2 admin admin] PATH_INFO: `/v3/projects/71ebadfa41324bc5a9ba98ee3b2d0a39` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:34.515440 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fa824f-32e9-4376-ba97-4c0d402ef2b2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=71ebadfa41324bc5a9ba98ee3b2d0a39)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:34.521323 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fa824f-32e9-4376-ba97-4c0d402ef2b2 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:34.620802 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-27fa824f-32e9-4376-ba97-4c0d402ef2b2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '71ebadfa41324bc5a9ba98ee3b2d0a39', 'request_id': 'req-27fa824f-32e9-4376-ba97-4c0d402ef2b2'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:42:34.629403 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-27fa824f-32e9-4376-ba97-4c0d402ef2b2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '71ebadfa41324bc5a9ba98ee3b2d0a39', 'request_id': 'req-27fa824f-32e9-4376-ba97-4c0d402ef2b2'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:42:34.638449 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-27fa824f-32e9-4376-ba97-4c0d402ef2b2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '71ebadfa41324bc5a9ba98ee3b2d0a39', 'request_id': 'req-27fa824f-32e9-4376-ba97-4c0d402ef2b2'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:42:34.651997 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f539c68-847c-4fb6-a5ac-0d8f34ec7bbf service neutron] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:34.655370 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-27fa824f-32e9-4376-ba97-4c0d402ef2b2 admin admin] The token cache is being invalidate because project 71ebadfa41324bc5a9ba98ee3b2d0a39 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80475) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 14:42:34.655841 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-27fa824f-32e9-4376-ba97-4c0d402ef2b2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:42:34.656255 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-5f539c68-847c-4fb6-a5ac-0d8f34ec7bbf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:42:34.656593 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-27fa824f-32e9-4376-ba97-4c0d402ef2b2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:42:34.659576 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 980/1941] 10.222.0.67 () {58 vars in 1232 bytes} [Wed May 25 14:42:34 2022] DELETE /identity/v3/projects/71ebadfa41324bc5a9ba98ee3b2d0a39 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:42:34.664036 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fa824f-32e9-4376-ba97-4c0d402ef2b2 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:34.670688 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-27fa824f-32e9-4376-ba97-4c0d402ef2b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:42:34.675602 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f539c68-847c-4fb6-a5ac-0d8f34ec7bbf service neutron] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:34.688639 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:34.771808 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fa824f-32e9-4376-ba97-4c0d402ef2b2 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:34.775180 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc945a5d-f5fc-4905-a916-638f23c10ec6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:34.776462 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc945a5d-f5fc-4905-a916-638f23c10ec6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:34.776846 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc945a5d-f5fc-4905-a916-638f23c10ec6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:34.777127 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc945a5d-f5fc-4905-a916-638f23c10ec6 admin admin] PATH_INFO: `/v3/users/b8698a12082b4952ae92f8877846c54b` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:34.778167 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33d0594-45fd-42b1-8a26-fcf2cb1caf2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:34.778577 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc945a5d-f5fc-4905-a916-638f23c10ec6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b8698a12082b4952ae92f8877846c54b)` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:34.779276 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33d0594-45fd-42b1-8a26-fcf2cb1caf2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:34.779658 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33d0594-45fd-42b1-8a26-fcf2cb1caf2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:34.780041 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33d0594-45fd-42b1-8a26-fcf2cb1caf2d admin admin] PATH_INFO: `/v3/users/1b500c5a084047c49c83e7dc76501307` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:34.781384 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33d0594-45fd-42b1-8a26-fcf2cb1caf2d admin admin] RBAC: Authorizing `identity:delete_user(user_id=1b500c5a084047c49c83e7dc76501307)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:34.781745 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc945a5d-f5fc-4905-a916-638f23c10ec6 admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:34.785809 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33d0594-45fd-42b1-8a26-fcf2cb1caf2d admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:34.855251 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-a33d0594-45fd-42b1-8a26-fcf2cb1caf2d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1b500c5a084047c49c83e7dc76501307'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:42:34.864973 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-cc945a5d-f5fc-4905-a916-638f23c10ec6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b8698a12082b4952ae92f8877846c54b'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:42:34.867525 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-cc945a5d-f5fc-4905-a916-638f23c10ec6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b8698a12082b4952ae92f8877846c54b'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:42:34.869144 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-a33d0594-45fd-42b1-8a26-fcf2cb1caf2d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1b500c5a084047c49c83e7dc76501307'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:42:34.870078 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-a33d0594-45fd-42b1-8a26-fcf2cb1caf2d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1b500c5a084047c49c83e7dc76501307'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:42:34.872334 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-cc945a5d-f5fc-4905-a916-638f23c10ec6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b8698a12082b4952ae92f8877846c54b'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:42:34.887766 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-a33d0594-45fd-42b1-8a26-fcf2cb1caf2d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1b500c5a084047c49c83e7dc76501307'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:42:34.903030 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-a33d0594-45fd-42b1-8a26-fcf2cb1caf2d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1b500c5a084047c49c83e7dc76501307'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:42:34.904425 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:34.912587 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-cc945a5d-f5fc-4905-a916-638f23c10ec6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b8698a12082b4952ae92f8877846c54b'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:42:34.918827 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 981/1942] 10.222.0.67 () {58 vars in 1223 bytes} [Wed May 25 14:42:34 2022] DELETE /identity/v3/users/1b500c5a084047c49c83e7dc76501307 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 14:42:34.928735 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-cc945a5d-f5fc-4905-a916-638f23c10ec6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b8698a12082b4952ae92f8877846c54b'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:42:34.952442 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 962/1943] 10.222.0.67 () {58 vars in 1223 bytes} [Wed May 25 14:42:34 2022] DELETE /identity/v3/users/b8698a12082b4952ae92f8877846c54b => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 14:42:34.958527 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b6e782-6f8c-4c80-b729-f518cc144c8e None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:34.958527 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b6e782-6f8c-4c80-b729-f518cc144c8e None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:34.958527 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b6e782-6f8c-4c80-b729-f518cc144c8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:34.977109 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-34b6e782-6f8c-4c80-b729-f518cc144c8e None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:42:34.978316 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-34b6e782-6f8c-4c80-b729-f518cc144c8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:42:35.046118 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 982/1944] 10.222.0.67 () {58 vars in 957 bytes} [Wed May 25 14:42:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 14:42:35.057722 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc945a5d-f5fc-4905-a916-638f23c10ec6 admin admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:35.059426 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-cc945a5d-f5fc-4905-a916-638f23c10ec6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:42:35.163467 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc945a5d-f5fc-4905-a916-638f23c10ec6 admin admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:35.171434 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ec3a8a-4a4b-4d11-a525-2af5ec902511 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b68eed985c7b49839bcdd173186ad4ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfe93ee8d32a441295efc0b885de4bd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:35.173017 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ec3a8a-4a4b-4d11-a525-2af5ec902511 service neutron] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:35.174182 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ec3a8a-4a4b-4d11-a525-2af5ec902511 service neutron] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:35.174469 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ec3a8a-4a4b-4d11-a525-2af5ec902511 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:35.188236 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ec3a8a-4a4b-4d11-a525-2af5ec902511 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:35.190339 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ec3a8a-4a4b-4d11-a525-2af5ec902511 service neutron] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:35.203209 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 963/1945] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 14:42:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:42:35.503981 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b6e782-6f8c-4c80-b729-f518cc144c8e None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:35.507471 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-34b6e782-6f8c-4c80-b729-f518cc144c8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:42:35.531650 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b6e782-6f8c-4c80-b729-f518cc144c8e None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:35.538978 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6517c89c-86b8-40c1-93c8-61bcb97fe1ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:35.540339 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6517c89c-86b8-40c1-93c8-61bcb97fe1ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:35.540339 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6517c89c-86b8-40c1-93c8-61bcb97fe1ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:35.540558 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6517c89c-86b8-40c1-93c8-61bcb97fe1ac admin admin] PATH_INFO: `/v3/users/f05ebd4c4bbc49a096cd458da7228810` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:35.541802 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6517c89c-86b8-40c1-93c8-61bcb97fe1ac admin admin] RBAC: Authorizing `identity:delete_user(user_id=f05ebd4c4bbc49a096cd458da7228810)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:35.544481 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6517c89c-86b8-40c1-93c8-61bcb97fe1ac admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:35.577933 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:35.646795 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-6517c89c-86b8-40c1-93c8-61bcb97fe1ac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f05ebd4c4bbc49a096cd458da7228810'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:42:35.670976 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-6517c89c-86b8-40c1-93c8-61bcb97fe1ac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f05ebd4c4bbc49a096cd458da7228810'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:42:35.678005 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-6517c89c-86b8-40c1-93c8-61bcb97fe1ac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f05ebd4c4bbc49a096cd458da7228810'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:42:35.712116 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-6517c89c-86b8-40c1-93c8-61bcb97fe1ac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f05ebd4c4bbc49a096cd458da7228810'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:42:35.746744 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-6517c89c-86b8-40c1-93c8-61bcb97fe1ac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f05ebd4c4bbc49a096cd458da7228810'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:42:35.757404 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ec3a8a-4a4b-4d11-a525-2af5ec902511 service neutron] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:35.759296 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-17ec3a8a-4a4b-4d11-a525-2af5ec902511 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:42:35.762026 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 983/1946] 10.222.0.67 () {58 vars in 1223 bytes} [Wed May 25 14:42:35 2022] DELETE /identity/v3/users/f05ebd4c4bbc49a096cd458da7228810 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:42:35.770731 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320c445e-9604-41c2-b2ae-fa9fb743ce7b None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:35.771342 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320c445e-9604-41c2-b2ae-fa9fb743ce7b None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:35.771737 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320c445e-9604-41c2-b2ae-fa9fb743ce7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:35.783101 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ec3a8a-4a4b-4d11-a525-2af5ec902511 service neutron] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:35.819776 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-320c445e-9604-41c2-b2ae-fa9fb743ce7b None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:42:35.821678 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-320c445e-9604-41c2-b2ae-fa9fb743ce7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:42:35.918027 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 984/1947] 10.222.0.67 () {58 vars in 957 bytes} [Wed May 25 14:42:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 14:42:35.920925 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320c445e-9604-41c2-b2ae-fa9fb743ce7b None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:35.923627 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-320c445e-9604-41c2-b2ae-fa9fb743ce7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:42:35.924072 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14df82e6-e359-4fc0-94e4-00f906358aaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:35.925156 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14df82e6-e359-4fc0-94e4-00f906358aaa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:35.925612 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14df82e6-e359-4fc0-94e4-00f906358aaa admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:35.926058 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14df82e6-e359-4fc0-94e4-00f906358aaa admin admin] PATH_INFO: `/v3/projects/35e2b88ad399432bb94479f25964e1d9` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:35.927666 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14df82e6-e359-4fc0-94e4-00f906358aaa admin admin] RBAC: Authorizing `identity:delete_project(project_id=35e2b88ad399432bb94479f25964e1d9)` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:35.929967 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14df82e6-e359-4fc0-94e4-00f906358aaa admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:35.953494 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320c445e-9604-41c2-b2ae-fa9fb743ce7b None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:35.959921 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdc50e0-4ece-409b-85d9-76372f7cee61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:35.960812 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdc50e0-4ece-409b-85d9-76372f7cee61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:35.961103 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdc50e0-4ece-409b-85d9-76372f7cee61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:35.961374 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdc50e0-4ece-409b-85d9-76372f7cee61 admin admin] PATH_INFO: `/v3/projects/da189a7e582d4ec78045a8187250ec12` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:35.962856 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdc50e0-4ece-409b-85d9-76372f7cee61 admin admin] RBAC: Authorizing `identity:delete_project(project_id=da189a7e582d4ec78045a8187250ec12)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:35.965271 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdc50e0-4ece-409b-85d9-76372f7cee61 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:36.023807 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-14df82e6-e359-4fc0-94e4-00f906358aaa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '35e2b88ad399432bb94479f25964e1d9', 'request_id': 'req-14df82e6-e359-4fc0-94e4-00f906358aaa'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:42:36.043454 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-14df82e6-e359-4fc0-94e4-00f906358aaa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '35e2b88ad399432bb94479f25964e1d9', 'request_id': 'req-14df82e6-e359-4fc0-94e4-00f906358aaa'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:42:36.050982 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-14df82e6-e359-4fc0-94e4-00f906358aaa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '35e2b88ad399432bb94479f25964e1d9', 'request_id': 'req-14df82e6-e359-4fc0-94e4-00f906358aaa'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:42:36.054804 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-4cdc50e0-4ece-409b-85d9-76372f7cee61 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da189a7e582d4ec78045a8187250ec12', 'request_id': 'req-4cdc50e0-4ece-409b-85d9-76372f7cee61'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:42:36.064359 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-4cdc50e0-4ece-409b-85d9-76372f7cee61 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da189a7e582d4ec78045a8187250ec12', 'request_id': 'req-4cdc50e0-4ece-409b-85d9-76372f7cee61'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:42:36.067049 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-14df82e6-e359-4fc0-94e4-00f906358aaa admin admin] The token cache is being invalidate because project 35e2b88ad399432bb94479f25964e1d9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80474) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 14:42:36.067401 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-14df82e6-e359-4fc0-94e4-00f906358aaa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:42:36.068098 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-14df82e6-e359-4fc0-94e4-00f906358aaa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:42:36.069888 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 964/1948] 10.222.0.67 () {58 vars in 1232 bytes} [Wed May 25 14:42:35 2022] DELETE /identity/v3/projects/35e2b88ad399432bb94479f25964e1d9 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:42:36.070594 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14df82e6-e359-4fc0-94e4-00f906358aaa admin admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:36.074609 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-14df82e6-e359-4fc0-94e4-00f906358aaa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:42:36.076051 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-4cdc50e0-4ece-409b-85d9-76372f7cee61 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da189a7e582d4ec78045a8187250ec12', 'request_id': 'req-4cdc50e0-4ece-409b-85d9-76372f7cee61'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:42:36.104957 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-4cdc50e0-4ece-409b-85d9-76372f7cee61 admin admin] The token cache is being invalidate because project da189a7e582d4ec78045a8187250ec12 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80475) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 14:42:36.107690 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:DELETE=9,keystone:SELECT=89,keystone:INSERT=2 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:36.107849 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-4cdc50e0-4ece-409b-85d9-76372f7cee61 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:42:36.109534 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-4cdc50e0-4ece-409b-85d9-76372f7cee61 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:42:36.113467 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 985/1949] 10.222.0.67 () {58 vars in 1232 bytes} [Wed May 25 14:42:35 2022] DELETE /identity/v3/projects/da189a7e582d4ec78045a8187250ec12 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:42:36.119917 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2a7207-3f43-4c15-8ec7-d52ea366b80b None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:36.127462 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2a7207-3f43-4c15-8ec7-d52ea366b80b None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:36.128080 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2a7207-3f43-4c15-8ec7-d52ea366b80b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:36.154392 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-8b2a7207-3f43-4c15-8ec7-d52ea366b80b None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:42:36.155722 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-8b2a7207-3f43-4c15-8ec7-d52ea366b80b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:42:36.203885 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:DELETE=15,keystone:SELECT=83,keystone:INSERT=2 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:36.233534 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14df82e6-e359-4fc0-94e4-00f906358aaa admin admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:36.280626 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 986/1950] 10.222.0.67 () {58 vars in 957 bytes} [Wed May 25 14:42:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:42:36.281235 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2a7207-3f43-4c15-8ec7-d52ea366b80b None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:36.283245 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-8b2a7207-3f43-4c15-8ec7-d52ea366b80b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:42:36.296116 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2a7207-3f43-4c15-8ec7-d52ea366b80b None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:36.304086 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfea7cd6-0b24-406f-b8c8-81df1eeda15c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:36.304985 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfea7cd6-0b24-406f-b8c8-81df1eeda15c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:36.305263 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfea7cd6-0b24-406f-b8c8-81df1eeda15c admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:36.305533 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfea7cd6-0b24-406f-b8c8-81df1eeda15c admin admin] PATH_INFO: `/v3/users/f4f9a323f1de4dbe9baf6398c171823c` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:36.306913 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfea7cd6-0b24-406f-b8c8-81df1eeda15c admin admin] RBAC: Authorizing `identity:delete_user(user_id=f4f9a323f1de4dbe9baf6398c171823c)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:36.308881 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfea7cd6-0b24-406f-b8c8-81df1eeda15c admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:36.314476 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09830ca5-646b-4675-be59-da313088e57f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b68eed985c7b49839bcdd173186ad4ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfe93ee8d32a441295efc0b885de4bd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:36.315525 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09830ca5-646b-4675-be59-da313088e57f service neutron] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:36.316016 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09830ca5-646b-4675-be59-da313088e57f service neutron] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:36.316473 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09830ca5-646b-4675-be59-da313088e57f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:36.319037 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-09830ca5-646b-4675-be59-da313088e57f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:42:36.338205 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09830ca5-646b-4675-be59-da313088e57f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:36.340351 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09830ca5-646b-4675-be59-da313088e57f service neutron] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:36.355843 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 965/1951] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 14:42:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:42:36.359377 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee619b2-b2db-4dc2-8b2b-84a08b655957 None None] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:36.359934 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee619b2-b2db-4dc2-8b2b-84a08b655957 None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:36.360493 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee619b2-b2db-4dc2-8b2b-84a08b655957 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:36.416164 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.auth.core [None req-aee619b2-b2db-4dc2-8b2b-84a08b655957 None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:42:36.419796 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-aee619b2-b2db-4dc2-8b2b-84a08b655957 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:42:36.421839 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-cfea7cd6-0b24-406f-b8c8-81df1eeda15c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f4f9a323f1de4dbe9baf6398c171823c'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:42:36.448330 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-cfea7cd6-0b24-406f-b8c8-81df1eeda15c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f4f9a323f1de4dbe9baf6398c171823c'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:42:36.452096 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-cfea7cd6-0b24-406f-b8c8-81df1eeda15c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f4f9a323f1de4dbe9baf6398c171823c'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:42:36.452923 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 966/1952] 10.222.0.67 () {58 vars in 957 bytes} [Wed May 25 14:42:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:42:36.454138 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee619b2-b2db-4dc2-8b2b-84a08b655957 None None] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:36.467373 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee619b2-b2db-4dc2-8b2b-84a08b655957 None None] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:36.471644 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-cfea7cd6-0b24-406f-b8c8-81df1eeda15c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f4f9a323f1de4dbe9baf6398c171823c'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:42:36.483401 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a63eebb-3bf4-4bf0-9311-612f7126fd10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:36.484342 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a63eebb-3bf4-4bf0-9311-612f7126fd10 admin admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:36.484631 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a63eebb-3bf4-4bf0-9311-612f7126fd10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:36.484939 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a63eebb-3bf4-4bf0-9311-612f7126fd10 admin admin] PATH_INFO: `/v3/domains` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:36.489827 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a63eebb-3bf4-4bf0-9311-612f7126fd10 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:42:36.492001 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a63eebb-3bf4-4bf0-9311-612f7126fd10 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:36.496144 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a63eebb-3bf4-4bf0-9311-612f7126fd10 admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:36.499684 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-cfea7cd6-0b24-406f-b8c8-81df1eeda15c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f4f9a323f1de4dbe9baf6398c171823c'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:42:36.526521 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 987/1953] 10.222.0.67 () {58 vars in 1223 bytes} [Wed May 25 14:42:36 2022] DELETE /identity/v3/users/f4f9a323f1de4dbe9baf6398c171823c => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:42:36.527271 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 967/1954] 10.222.0.67 () {58 vars in 1152 bytes} [Wed May 25 14:42:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:42:36.531173 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfea7cd6-0b24-406f-b8c8-81df1eeda15c admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:36.534185 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-cfea7cd6-0b24-406f-b8c8-81df1eeda15c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:42:36.704267 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfea7cd6-0b24-406f-b8c8-81df1eeda15c admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:36.711381 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d53518-a151-4a34-a4d3-52481d16f4b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:36.712573 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d53518-a151-4a34-a4d3-52481d16f4b1 admin admin] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:36.713380 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d53518-a151-4a34-a4d3-52481d16f4b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:36.713872 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d53518-a151-4a34-a4d3-52481d16f4b1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:36.715488 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d53518-a151-4a34-a4d3-52481d16f4b1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:36.718088 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d53518-a151-4a34-a4d3-52481d16f4b1 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:36.779393 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 988/1955] 10.222.0.67 () {60 vars in 1152 bytes} [Wed May 25 14:42:36 2022] POST /identity/v3/projects => generated 385 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:42:36.784093 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a63eebb-3bf4-4bf0-9311-612f7126fd10 admin admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:36.800949 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a63eebb-3bf4-4bf0-9311-612f7126fd10 admin admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:36.911636 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b893b8c-9380-447c-99f2-1fbb92efafea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:36.912339 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b893b8c-9380-447c-99f2-1fbb92efafea admin admin] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:36.912631 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b893b8c-9380-447c-99f2-1fbb92efafea admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:36.912917 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b893b8c-9380-447c-99f2-1fbb92efafea admin admin] PATH_INFO: `/v3/users` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:36.913634 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b893b8c-9380-447c-99f2-1fbb92efafea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:36.915672 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b893b8c-9380-447c-99f2-1fbb92efafea admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:36.949839 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 968/1956] 10.222.0.67 () {60 vars in 1143 bytes} [Wed May 25 14:42:36 2022] POST /identity/v3/users => generated 293 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:42:36.951452 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d53518-a151-4a34-a4d3-52481d16f4b1 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:36.965326 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d53518-a151-4a34-a4d3-52481d16f4b1 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:36.974456 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ac8dee-4676-40fd-8e63-15313c5faf1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:36.975451 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ac8dee-4676-40fd-8e63-15313c5faf1b admin admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:36.976471 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ac8dee-4676-40fd-8e63-15313c5faf1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:36.976862 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ac8dee-4676-40fd-8e63-15313c5faf1b admin admin] PATH_INFO: `/v3/roles` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:36.977786 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ac8dee-4676-40fd-8e63-15313c5faf1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:36.979958 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ac8dee-4676-40fd-8e63-15313c5faf1b admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:36.993354 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 989/1957] 10.222.0.67 () {58 vars in 1121 bytes} [Wed May 25 14:42:36 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:42:36.997403 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b893b8c-9380-447c-99f2-1fbb92efafea admin admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:37.015146 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b893b8c-9380-447c-99f2-1fbb92efafea admin admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:37.023746 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff709bf-d200-4001-af07-2a2589ff4186 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:37.024501 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff709bf-d200-4001-af07-2a2589ff4186 admin admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:37.025306 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff709bf-d200-4001-af07-2a2589ff4186 admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:37.025306 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff709bf-d200-4001-af07-2a2589ff4186 admin admin] PATH_INFO: `/v3/roles` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:37.026302 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff709bf-d200-4001-af07-2a2589ff4186 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:37.028358 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff709bf-d200-4001-af07-2a2589ff4186 admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:37.076530 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 969/1958] 10.222.0.67 () {58 vars in 1121 bytes} [Wed May 25 14:42:36 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:42:37.081308 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ac8dee-4676-40fd-8e63-15313c5faf1b admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:37.091907 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ac8dee-4676-40fd-8e63-15313c5faf1b admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:37.098554 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf3fbc8-1cfa-4d9b-9253-bdb7956a375f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:37.099591 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf3fbc8-1cfa-4d9b-9253-bdb7956a375f admin admin] REQUEST_METHOD: `PUT` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:37.099954 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf3fbc8-1cfa-4d9b-9253-bdb7956a375f admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:37.100329 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf3fbc8-1cfa-4d9b-9253-bdb7956a375f admin admin] PATH_INFO: `/v3/projects/2830a12ef28a4fb3bf19cd2354767979/users/a6465e0bde0e46cbb13f5c7679ee612f/roles/48808901834b4d5eab2c7e6b5b03791e` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:37.104294 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:37.131243 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf3fbc8-1cfa-4d9b-9253-bdb7956a375f admin admin] RBAC: Authorizing `identity:create_grant(project_id=2830a12ef28a4fb3bf19cd2354767979, user_id=a6465e0bde0e46cbb13f5c7679ee612f, role_id=48808901834b4d5eab2c7e6b5b03791e)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:37.135769 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf3fbc8-1cfa-4d9b-9253-bdb7956a375f admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:37.177200 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49957d49-2ad8-4f9d-8061-59a86c86bda1 None None] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:37.177684 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49957d49-2ad8-4f9d-8061-59a86c86bda1 None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:37.181600 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 990/1959] 10.222.0.67 () {60 vars in 1482 bytes} [Wed May 25 14:42:37 2022] PUT /identity/v3/projects/2830a12ef28a4fb3bf19cd2354767979/users/a6465e0bde0e46cbb13f5c7679ee612f/roles/48808901834b4d5eab2c7e6b5b03791e => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:42:37.181712 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49957d49-2ad8-4f9d-8061-59a86c86bda1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:37.224821 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.auth.core [None req-49957d49-2ad8-4f9d-8061-59a86c86bda1 None None] MFA Rules not processed for user `a6465e0bde0e46cbb13f5c7679ee612f`. Rule list: `[]` (Enabled: `True`). {{(pid=80474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:42:37.226351 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-49957d49-2ad8-4f9d-8061-59a86c86bda1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:42:37.267269 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:37.342247 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf3fbc8-1cfa-4d9b-9253-bdb7956a375f admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:37.348769 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-ddf3fbc8-1cfa-4d9b-9253-bdb7956a375f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:42:37.425171 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 970/1960] 10.222.0.67 () {58 vars in 957 bytes} [Wed May 25 14:42:37 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:42:37.435616 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49957d49-2ad8-4f9d-8061-59a86c86bda1 None None] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:37.556294 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf3fbc8-1cfa-4d9b-9253-bdb7956a375f admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:37.566499 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcd1512-7c91-488d-b7fb-aa362ce26443 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:37.568519 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcd1512-7c91-488d-b7fb-aa362ce26443 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:37.568782 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcd1512-7c91-488d-b7fb-aa362ce26443 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:37.569066 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcd1512-7c91-488d-b7fb-aa362ce26443 admin admin] PATH_INFO: `/v3/projects/130c6e363248479e903e92c97c454c8f` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:37.571020 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcd1512-7c91-488d-b7fb-aa362ce26443 admin admin] RBAC: Authorizing `identity:delete_project(project_id=130c6e363248479e903e92c97c454c8f)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:37.572524 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcd1512-7c91-488d-b7fb-aa362ce26443 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:37.645858 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49957d49-2ad8-4f9d-8061-59a86c86bda1 None None] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:37.650612 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-bfcd1512-7c91-488d-b7fb-aa362ce26443 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '130c6e363248479e903e92c97c454c8f', 'request_id': 'req-bfcd1512-7c91-488d-b7fb-aa362ce26443'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:42:37.659660 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-bfcd1512-7c91-488d-b7fb-aa362ce26443 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '130c6e363248479e903e92c97c454c8f', 'request_id': 'req-bfcd1512-7c91-488d-b7fb-aa362ce26443'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:42:37.669093 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-bfcd1512-7c91-488d-b7fb-aa362ce26443 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '130c6e363248479e903e92c97c454c8f', 'request_id': 'req-bfcd1512-7c91-488d-b7fb-aa362ce26443'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:42:37.686498 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-bfcd1512-7c91-488d-b7fb-aa362ce26443 admin admin] The token cache is being invalidate because project 130c6e363248479e903e92c97c454c8f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80475) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 14:42:37.686933 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-bfcd1512-7c91-488d-b7fb-aa362ce26443 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:42:37.687876 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-bfcd1512-7c91-488d-b7fb-aa362ce26443 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:42:37.693493 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 991/1961] 10.222.0.67 () {58 vars in 1232 bytes} [Wed May 25 14:42:37 2022] DELETE /identity/v3/projects/130c6e363248479e903e92c97c454c8f => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:42:37.693493 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcd1512-7c91-488d-b7fb-aa362ce26443 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:37.693729 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-bfcd1512-7c91-488d-b7fb-aa362ce26443 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:42:37.738970 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40db141e-07d2-4429-aab6-1238de60d181 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:37.739846 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40db141e-07d2-4429-aab6-1238de60d181 admin admin] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:37.740175 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40db141e-07d2-4429-aab6-1238de60d181 admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:37.740520 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40db141e-07d2-4429-aab6-1238de60d181 admin admin] PATH_INFO: `/v3/projects` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:37.741698 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40db141e-07d2-4429-aab6-1238de60d181 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:37.743997 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40db141e-07d2-4429-aab6-1238de60d181 admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:37.782104 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 971/1962] 10.222.0.67 () {60 vars in 1152 bytes} [Wed May 25 14:42:37 2022] POST /identity/v3/projects => generated 383 bytes in 353 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 14:42:37.783658 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40db141e-07d2-4429-aab6-1238de60d181 admin admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:37.785706 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-40db141e-07d2-4429-aab6-1238de60d181 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:42:37.799191 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcd1512-7c91-488d-b7fb-aa362ce26443 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:37.818966 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:37.880769 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59187ca-873d-4d3a-8fec-d4dcdc17ec11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:37.882092 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59187ca-873d-4d3a-8fec-d4dcdc17ec11 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:37.882480 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59187ca-873d-4d3a-8fec-d4dcdc17ec11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:37.882829 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59187ca-873d-4d3a-8fec-d4dcdc17ec11 admin admin] PATH_INFO: `/v3/projects/4b30a1ec738f4465b95684a6e0c0de92` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:37.884545 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59187ca-873d-4d3a-8fec-d4dcdc17ec11 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4b30a1ec738f4465b95684a6e0c0de92)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:37.885125 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:37.886839 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59187ca-873d-4d3a-8fec-d4dcdc17ec11 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:37.903039 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40db141e-07d2-4429-aab6-1238de60d181 admin admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:37.910094 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ff4582-6029-41df-9a63-2a31703fb66d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:37.912460 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ff4582-6029-41df-9a63-2a31703fb66d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:37.912750 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ff4582-6029-41df-9a63-2a31703fb66d admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:37.913031 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ff4582-6029-41df-9a63-2a31703fb66d admin admin] PATH_INFO: `/v3/users/5c669dc6f9c34b3c9c60c97ce93093e2` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:37.914643 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ff4582-6029-41df-9a63-2a31703fb66d admin admin] RBAC: Authorizing `identity:delete_user(user_id=5c669dc6f9c34b3c9c60c97ce93093e2)` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:37.916741 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ff4582-6029-41df-9a63-2a31703fb66d admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:37.954847 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-d59187ca-873d-4d3a-8fec-d4dcdc17ec11 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4b30a1ec738f4465b95684a6e0c0de92', 'request_id': 'req-d59187ca-873d-4d3a-8fec-d4dcdc17ec11'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:42:37.964993 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-d59187ca-873d-4d3a-8fec-d4dcdc17ec11 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4b30a1ec738f4465b95684a6e0c0de92', 'request_id': 'req-d59187ca-873d-4d3a-8fec-d4dcdc17ec11'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:42:37.973721 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-d59187ca-873d-4d3a-8fec-d4dcdc17ec11 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4b30a1ec738f4465b95684a6e0c0de92', 'request_id': 'req-d59187ca-873d-4d3a-8fec-d4dcdc17ec11'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:42:37.983948 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-03ff4582-6029-41df-9a63-2a31703fb66d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5c669dc6f9c34b3c9c60c97ce93093e2'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:42:37.984685 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-03ff4582-6029-41df-9a63-2a31703fb66d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5c669dc6f9c34b3c9c60c97ce93093e2'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:42:37.985494 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-03ff4582-6029-41df-9a63-2a31703fb66d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5c669dc6f9c34b3c9c60c97ce93093e2'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:42:37.989997 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-d59187ca-873d-4d3a-8fec-d4dcdc17ec11 admin admin] The token cache is being invalidate because project 4b30a1ec738f4465b95684a6e0c0de92 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80475) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 14:42:37.990296 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-d59187ca-873d-4d3a-8fec-d4dcdc17ec11 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:42:37.990969 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-d59187ca-873d-4d3a-8fec-d4dcdc17ec11 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:42:37.992824 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 992/1963] 10.222.0.67 () {58 vars in 1232 bytes} [Wed May 25 14:42:37 2022] DELETE /identity/v3/projects/4b30a1ec738f4465b95684a6e0c0de92 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:42:37.993721 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59187ca-873d-4d3a-8fec-d4dcdc17ec11 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:37.995318 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-d59187ca-873d-4d3a-8fec-d4dcdc17ec11 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:42:38.004164 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-03ff4582-6029-41df-9a63-2a31703fb66d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5c669dc6f9c34b3c9c60c97ce93093e2'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:42:38.026432 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-03ff4582-6029-41df-9a63-2a31703fb66d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5c669dc6f9c34b3c9c60c97ce93093e2'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:42:38.050543 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 972/1964] 10.222.0.67 () {58 vars in 1223 bytes} [Wed May 25 14:42:37 2022] DELETE /identity/v3/users/5c669dc6f9c34b3c9c60c97ce93093e2 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:42:38.053869 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dac94ba-b6e8-4801-bb40-7e075431ed4b None None] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:38.053869 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dac94ba-b6e8-4801-bb40-7e075431ed4b None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:38.053869 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dac94ba-b6e8-4801-bb40-7e075431ed4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:38.077063 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.auth.core [None req-9dac94ba-b6e8-4801-bb40-7e075431ed4b None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:42:38.078020 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-9dac94ba-b6e8-4801-bb40-7e075431ed4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:42:38.086369 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59187ca-873d-4d3a-8fec-d4dcdc17ec11 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:38.157237 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:38.176318 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdbbb5b-4345-49e3-b46b-95f2b3154aef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:38.176318 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdbbb5b-4345-49e3-b46b-95f2b3154aef admin admin] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:38.176318 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdbbb5b-4345-49e3-b46b-95f2b3154aef admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:38.176318 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdbbb5b-4345-49e3-b46b-95f2b3154aef admin admin] PATH_INFO: `/v3/users` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:38.176627 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdbbb5b-4345-49e3-b46b-95f2b3154aef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:38.178059 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdbbb5b-4345-49e3-b46b-95f2b3154aef admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:38.199424 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 973/1965] 10.222.0.67 () {58 vars in 957 bytes} [Wed May 25 14:42:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:42:38.205114 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a429efb-42dd-4082-9201-cac8d260404b None None] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:38.205822 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a429efb-42dd-4082-9201-cac8d260404b None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:38.206813 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a429efb-42dd-4082-9201-cac8d260404b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:38.217976 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 993/1966] 10.222.0.67 () {60 vars in 1143 bytes} [Wed May 25 14:42:37 2022] POST /identity/v3/users => generated 298 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:42:38.225428 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdbbb5b-4345-49e3-b46b-95f2b3154aef admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:38.248253 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdbbb5b-4345-49e3-b46b-95f2b3154aef admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:38.256823 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.auth.core [None req-9a429efb-42dd-4082-9201-cac8d260404b None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:42:38.257071 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-9a429efb-42dd-4082-9201-cac8d260404b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:42:38.266510 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c87666-79a6-43a7-9e7e-7650fc344b7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:38.269007 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c87666-79a6-43a7-9e7e-7650fc344b7f admin admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:38.269288 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c87666-79a6-43a7-9e7e-7650fc344b7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:38.269566 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c87666-79a6-43a7-9e7e-7650fc344b7f admin admin] PATH_INFO: `/v3/roles` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:38.270331 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c87666-79a6-43a7-9e7e-7650fc344b7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:38.271859 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 974/1967] 10.222.0.67 () {58 vars in 957 bytes} [Wed May 25 14:42:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:42:38.272306 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c87666-79a6-43a7-9e7e-7650fc344b7f admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:38.276426 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a429efb-42dd-4082-9201-cac8d260404b None None] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:38.289551 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a429efb-42dd-4082-9201-cac8d260404b None None] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:38.292502 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 994/1968] 10.222.0.67 () {58 vars in 1121 bytes} [Wed May 25 14:42:38 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:42:38.292502 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c87666-79a6-43a7-9e7e-7650fc344b7f admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:38.300216 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba84c503-767a-4356-9ca1-a78fdd7ad133 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:38.301235 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba84c503-767a-4356-9ca1-a78fdd7ad133 admin admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:38.301730 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba84c503-767a-4356-9ca1-a78fdd7ad133 admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:38.302191 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba84c503-767a-4356-9ca1-a78fdd7ad133 admin admin] PATH_INFO: `/v3/domains` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:38.303290 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba84c503-767a-4356-9ca1-a78fdd7ad133 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:42:38.303772 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba84c503-767a-4356-9ca1-a78fdd7ad133 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:38.305471 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c87666-79a6-43a7-9e7e-7650fc344b7f admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:38.305854 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba84c503-767a-4356-9ca1-a78fdd7ad133 admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:38.311153 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7225964b-a148-4fac-baf6-a6fa4380f1d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:38.312137 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7225964b-a148-4fac-baf6-a6fa4380f1d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:38.312784 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7225964b-a148-4fac-baf6-a6fa4380f1d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:38.313142 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7225964b-a148-4fac-baf6-a6fa4380f1d5 admin admin] PATH_INFO: `/v3/projects/07df52b603a3483e9cb5b568c214cea4/users/3b46afd6625348d591478ecab7ebd723/roles/399893e19eac4ab5a8e596f7c07be13c` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:38.341913 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 975/1969] 10.222.0.67 () {58 vars in 1152 bytes} [Wed May 25 14:42:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:42:38.343186 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7225964b-a148-4fac-baf6-a6fa4380f1d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=07df52b603a3483e9cb5b568c214cea4, user_id=3b46afd6625348d591478ecab7ebd723, role_id=399893e19eac4ab5a8e596f7c07be13c)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:38.346619 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba84c503-767a-4356-9ca1-a78fdd7ad133 admin admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:38.350632 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7225964b-a148-4fac-baf6-a6fa4380f1d5 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:38.358310 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba84c503-767a-4356-9ca1-a78fdd7ad133 admin admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:38.364735 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9bf7b1-b520-4884-b421-6f79201de396 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:38.365424 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9bf7b1-b520-4884-b421-6f79201de396 admin admin] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:38.365783 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9bf7b1-b520-4884-b421-6f79201de396 admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:38.366156 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9bf7b1-b520-4884-b421-6f79201de396 admin admin] PATH_INFO: `/v3/projects` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:38.367231 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9bf7b1-b520-4884-b421-6f79201de396 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:38.369093 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9bf7b1-b520-4884-b421-6f79201de396 admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:38.381496 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 995/1970] 10.222.0.67 () {60 vars in 1482 bytes} [Wed May 25 14:42:38 2022] PUT /identity/v3/projects/07df52b603a3483e9cb5b568c214cea4/users/3b46afd6625348d591478ecab7ebd723/roles/399893e19eac4ab5a8e596f7c07be13c => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:42:38.383046 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7225964b-a148-4fac-baf6-a6fa4380f1d5 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:38.411835 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 976/1971] 10.222.0.67 () {60 vars in 1152 bytes} [Wed May 25 14:42:38 2022] POST /identity/v3/projects => generated 373 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 14:42:38.412998 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9bf7b1-b520-4884-b421-6f79201de396 admin admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:38.462110 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:38.490759 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7225964b-a148-4fac-baf6-a6fa4380f1d5 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:38.511488 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9bf7b1-b520-4884-b421-6f79201de396 admin admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:38.517982 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64735a01-a4a9-426e-933c-105f5e8196bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:38.518695 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64735a01-a4a9-426e-933c-105f5e8196bc admin admin] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:38.519002 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64735a01-a4a9-426e-933c-105f5e8196bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:38.520793 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64735a01-a4a9-426e-933c-105f5e8196bc admin admin] PATH_INFO: `/v3/users` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:38.521530 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64735a01-a4a9-426e-933c-105f5e8196bc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:38.525309 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64735a01-a4a9-426e-933c-105f5e8196bc admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:38.558806 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 977/1972] 10.222.0.67 () {60 vars in 1143 bytes} [Wed May 25 14:42:38 2022] POST /identity/v3/users => generated 287 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:42:38.564445 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64735a01-a4a9-426e-933c-105f5e8196bc admin admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:38.577629 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64735a01-a4a9-426e-933c-105f5e8196bc admin admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:38.578006 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac48897a-de7f-4547-9204-6c50d5f047c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:38.578832 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac48897a-de7f-4547-9204-6c50d5f047c6 admin admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:38.580312 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac48897a-de7f-4547-9204-6c50d5f047c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:38.580679 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac48897a-de7f-4547-9204-6c50d5f047c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:38.581813 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac48897a-de7f-4547-9204-6c50d5f047c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:38.583740 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac48897a-de7f-4547-9204-6c50d5f047c6 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:38.584414 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969d609c-a733-4e4c-8c33-9c42c9afa994 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:38.585373 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969d609c-a733-4e4c-8c33-9c42c9afa994 admin admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:38.585662 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969d609c-a733-4e4c-8c33-9c42c9afa994 admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:38.586479 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969d609c-a733-4e4c-8c33-9c42c9afa994 admin admin] PATH_INFO: `/v3/roles` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:38.587307 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969d609c-a733-4e4c-8c33-9c42c9afa994 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:38.589759 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969d609c-a733-4e4c-8c33-9c42c9afa994 admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:38.603278 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 996/1973] 10.222.0.67 () {58 vars in 1121 bytes} [Wed May 25 14:42:38 2022] GET /identity/v3/roles => generated 1420 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:42:38.604621 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac48897a-de7f-4547-9204-6c50d5f047c6 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:38.608485 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 978/1974] 10.222.0.67 () {58 vars in 1121 bytes} [Wed May 25 14:42:38 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:42:38.610527 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969d609c-a733-4e4c-8c33-9c42c9afa994 admin admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:38.632337 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969d609c-a733-4e4c-8c33-9c42c9afa994 admin admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:38.633161 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac48897a-de7f-4547-9204-6c50d5f047c6 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:38.637750 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a75428-27e4-4522-89ff-900c6412ad93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:38.638584 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a75428-27e4-4522-89ff-900c6412ad93 admin admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:38.638875 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a75428-27e4-4522-89ff-900c6412ad93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:38.639191 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a75428-27e4-4522-89ff-900c6412ad93 admin admin] PATH_INFO: `/v3/roles` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:38.640343 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a75428-27e4-4522-89ff-900c6412ad93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:38.643370 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a75428-27e4-4522-89ff-900c6412ad93 admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:38.650585 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c29f33-8b19-48e4-849f-f7e9675f2309 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:38.651581 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c29f33-8b19-48e4-849f-f7e9675f2309 admin admin] REQUEST_METHOD: `PUT` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:38.651900 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c29f33-8b19-48e4-849f-f7e9675f2309 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:38.652153 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c29f33-8b19-48e4-849f-f7e9675f2309 admin admin] PATH_INFO: `/v3/projects/07df52b603a3483e9cb5b568c214cea4/users/3b46afd6625348d591478ecab7ebd723/roles/399893e19eac4ab5a8e596f7c07be13c` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:38.657153 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c29f33-8b19-48e4-849f-f7e9675f2309 admin admin] RBAC: Authorizing `identity:create_grant(project_id=07df52b603a3483e9cb5b568c214cea4, user_id=3b46afd6625348d591478ecab7ebd723, role_id=399893e19eac4ab5a8e596f7c07be13c)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:38.663511 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 979/1975] 10.222.0.67 () {58 vars in 1121 bytes} [Wed May 25 14:42:38 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:42:38.664961 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c29f33-8b19-48e4-849f-f7e9675f2309 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:38.665544 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a75428-27e4-4522-89ff-900c6412ad93 admin admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:38.681626 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 997/1976] 10.222.0.67 () {60 vars in 1482 bytes} [Wed May 25 14:42:38 2022] PUT /identity/v3/projects/07df52b603a3483e9cb5b568c214cea4/users/3b46afd6625348d591478ecab7ebd723/roles/399893e19eac4ab5a8e596f7c07be13c => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:42:38.684024 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a75428-27e4-4522-89ff-900c6412ad93 admin admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:38.693958 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db7ddec-bf50-4652-9071-65b76927d227 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:38.694263 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db7ddec-bf50-4652-9071-65b76927d227 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:38.694530 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db7ddec-bf50-4652-9071-65b76927d227 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:38.734300 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-8db7ddec-bf50-4652-9071-65b76927d227 None None] MFA Rules not processed for user `3b46afd6625348d591478ecab7ebd723`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:42:38.736509 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-8db7ddec-bf50-4652-9071-65b76927d227 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:42:38.798742 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:38.800951 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8912cd-f19c-4d63-8dff-549102548c1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:38.802076 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8912cd-f19c-4d63-8dff-549102548c1a admin admin] REQUEST_METHOD: `PUT` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:38.802458 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8912cd-f19c-4d63-8dff-549102548c1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:38.804239 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8912cd-f19c-4d63-8dff-549102548c1a admin admin] PATH_INFO: `/v3/projects/c2e80dd462234856a31ad57c6e8c27b7/users/a410509c46324181afa917494917c850/roles/48808901834b4d5eab2c7e6b5b03791e` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:38.834455 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8912cd-f19c-4d63-8dff-549102548c1a admin admin] RBAC: Authorizing `identity:create_grant(project_id=c2e80dd462234856a31ad57c6e8c27b7, user_id=a410509c46324181afa917494917c850, role_id=48808901834b4d5eab2c7e6b5b03791e)` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:38.839040 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8912cd-f19c-4d63-8dff-549102548c1a admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:38.854820 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 980/1977] 10.222.0.67 () {60 vars in 1482 bytes} [Wed May 25 14:42:38 2022] PUT /identity/v3/projects/c2e80dd462234856a31ad57c6e8c27b7/users/a410509c46324181afa917494917c850/roles/48808901834b4d5eab2c7e6b5b03791e => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:42:38.856570 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8912cd-f19c-4d63-8dff-549102548c1a admin admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:38.859280 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-8a8912cd-f19c-4d63-8dff-549102548c1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:42:38.861973 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 998/1978] 10.222.0.67 () {58 vars in 957 bytes} [Wed May 25 14:42:38 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:42:38.866466 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a94d0dd-f58b-4794-82be-85720ef6624f None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:38.866838 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a94d0dd-f58b-4794-82be-85720ef6624f None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:38.867039 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a94d0dd-f58b-4794-82be-85720ef6624f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:38.895697 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-7a94d0dd-f58b-4794-82be-85720ef6624f None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:42:38.900049 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-7a94d0dd-f58b-4794-82be-85720ef6624f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:42:38.948049 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8912cd-f19c-4d63-8dff-549102548c1a admin admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:38.955883 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfa7660-794c-4401-9e9f-9522de3c2e93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:38.957194 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfa7660-794c-4401-9e9f-9522de3c2e93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:38.958340 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfa7660-794c-4401-9e9f-9522de3c2e93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:38.958629 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfa7660-794c-4401-9e9f-9522de3c2e93 admin admin] PATH_INFO: `/v3/projects/de6f8289ecb34708b91dab54c379e2fb` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:38.960976 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfa7660-794c-4401-9e9f-9522de3c2e93 admin admin] RBAC: Authorizing `identity:delete_project(project_id=de6f8289ecb34708b91dab54c379e2fb)` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:38.963872 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfa7660-794c-4401-9e9f-9522de3c2e93 admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:38.984867 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 999/1979] 10.222.0.67 () {58 vars in 957 bytes} [Wed May 25 14:42:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:42:38.987757 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a94d0dd-f58b-4794-82be-85720ef6624f None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:38.989643 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-7a94d0dd-f58b-4794-82be-85720ef6624f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:42:39.002074 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:39.033820 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-0bfa7660-794c-4401-9e9f-9522de3c2e93 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'de6f8289ecb34708b91dab54c379e2fb', 'request_id': 'req-0bfa7660-794c-4401-9e9f-9522de3c2e93'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:42:39.049326 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-0bfa7660-794c-4401-9e9f-9522de3c2e93 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'de6f8289ecb34708b91dab54c379e2fb', 'request_id': 'req-0bfa7660-794c-4401-9e9f-9522de3c2e93'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:42:39.056879 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-0bfa7660-794c-4401-9e9f-9522de3c2e93 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'de6f8289ecb34708b91dab54c379e2fb', 'request_id': 'req-0bfa7660-794c-4401-9e9f-9522de3c2e93'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:42:39.067945 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a94d0dd-f58b-4794-82be-85720ef6624f None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:39.070027 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-0bfa7660-794c-4401-9e9f-9522de3c2e93 admin admin] The token cache is being invalidate because project de6f8289ecb34708b91dab54c379e2fb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80474) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 14:42:39.070545 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-0bfa7660-794c-4401-9e9f-9522de3c2e93 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:42:39.071787 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-0bfa7660-794c-4401-9e9f-9522de3c2e93 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:42:39.082071 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 981/1980] 10.222.0.67 () {58 vars in 1232 bytes} [Wed May 25 14:42:38 2022] DELETE /identity/v3/projects/de6f8289ecb34708b91dab54c379e2fb => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:42:39.082071 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfa7660-794c-4401-9e9f-9522de3c2e93 admin admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:39.082071 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-0bfa7660-794c-4401-9e9f-9522de3c2e93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:42:39.143509 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af1ec04-a3a7-406f-af16-372ba6128898 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e462acc9da84a61bb23998dd54e1858', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfe93ee8d32a441295efc0b885de4bd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:39.144199 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af1ec04-a3a7-406f-af16-372ba6128898 service cinder] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:39.144909 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af1ec04-a3a7-406f-af16-372ba6128898 service cinder] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:39.144909 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af1ec04-a3a7-406f-af16-372ba6128898 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:39.146804 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-7af1ec04-a3a7-406f-af16-372ba6128898 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:42:39.158167 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfa7660-794c-4401-9e9f-9522de3c2e93 admin admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:39.162455 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb06cdc4-28b2-422f-ae34-3511fc1dc51c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b68eed985c7b49839bcdd173186ad4ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfe93ee8d32a441295efc0b885de4bd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:39.163498 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb06cdc4-28b2-422f-ae34-3511fc1dc51c service neutron] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:39.163498 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb06cdc4-28b2-422f-ae34-3511fc1dc51c service neutron] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:39.163701 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb06cdc4-28b2-422f-ae34-3511fc1dc51c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:39.165893 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-bb06cdc4-28b2-422f-ae34-3511fc1dc51c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:42:39.216142 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:39.244504 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af1ec04-a3a7-406f-af16-372ba6128898 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:39.246120 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af1ec04-a3a7-406f-af16-372ba6128898 service cinder] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:39.254524 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb06cdc4-28b2-422f-ae34-3511fc1dc51c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:39.256957 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb06cdc4-28b2-422f-ae34-3511fc1dc51c service neutron] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:39.261136 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1000/1981] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 14:42:38 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 274 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:42:39.262736 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6842a5-e7b0-4964-85f2-91d76e597001 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:39.263243 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6842a5-e7b0-4964-85f2-91d76e597001 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:39.263593 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6842a5-e7b0-4964-85f2-91d76e597001 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:39.269621 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 982/1982] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 14:42:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:42:39.303993 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-aa6842a5-e7b0-4964-85f2-91d76e597001 None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:42:39.305957 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-aa6842a5-e7b0-4964-85f2-91d76e597001 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:42:39.326627 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1001/1983] 10.222.0.67 () {58 vars in 957 bytes} [Wed May 25 14:42:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:42:39.328877 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ab77ca-d515-4af1-9651-f3a625592fef None None] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:39.330405 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ab77ca-d515-4af1-9651-f3a625592fef None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:39.331011 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ab77ca-d515-4af1-9651-f3a625592fef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:39.385278 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.auth.core [None req-76ab77ca-d515-4af1-9651-f3a625592fef None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:42:39.398282 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-76ab77ca-d515-4af1-9651-f3a625592fef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:42:39.428942 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 983/1984] 10.222.0.67 () {58 vars in 957 bytes} [Wed May 25 14:42:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:42:39.430549 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6842a5-e7b0-4964-85f2-91d76e597001 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:39.447336 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6842a5-e7b0-4964-85f2-91d76e597001 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:39.462915 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4afd6b-bf55-4599-999c-b3b51de23da7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:39.462915 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4afd6b-bf55-4599-999c-b3b51de23da7 admin admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:39.462915 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4afd6b-bf55-4599-999c-b3b51de23da7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:39.462915 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4afd6b-bf55-4599-999c-b3b51de23da7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:39.463546 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4afd6b-bf55-4599-999c-b3b51de23da7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:42:39.463546 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4afd6b-bf55-4599-999c-b3b51de23da7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:39.464554 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4afd6b-bf55-4599-999c-b3b51de23da7 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:39.485939 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1002/1985] 10.222.0.67 () {58 vars in 1152 bytes} [Wed May 25 14:42:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:42:39.490807 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ab77ca-d515-4af1-9651-f3a625592fef None None] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:39.508154 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ab77ca-d515-4af1-9651-f3a625592fef None None] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:39.515126 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be4643c-e114-460f-bb23-ea439f43797c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:39.515820 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be4643c-e114-460f-bb23-ea439f43797c admin admin] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:39.516107 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be4643c-e114-460f-bb23-ea439f43797c admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:39.516382 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be4643c-e114-460f-bb23-ea439f43797c admin admin] PATH_INFO: `/v3/projects` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:39.517251 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be4643c-e114-460f-bb23-ea439f43797c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:39.520870 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be4643c-e114-460f-bb23-ea439f43797c admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:39.562740 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 984/1986] 10.222.0.67 () {60 vars in 1152 bytes} [Wed May 25 14:42:39 2022] POST /identity/v3/projects => generated 383 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 14:42:39.568297 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4afd6b-bf55-4599-999c-b3b51de23da7 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:39.586179 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4afd6b-bf55-4599-999c-b3b51de23da7 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:39.685611 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be4643c-e114-460f-bb23-ea439f43797c admin admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:39.687634 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-0be4643c-e114-460f-bb23-ea439f43797c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:42:39.719548 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de47c237-b5cd-468c-838c-b5a7171dca7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:39.720772 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de47c237-b5cd-468c-838c-b5a7171dca7d admin admin] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:39.721680 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de47c237-b5cd-468c-838c-b5a7171dca7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:39.721992 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de47c237-b5cd-468c-838c-b5a7171dca7d admin admin] PATH_INFO: `/v3/users` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:39.722797 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de47c237-b5cd-468c-838c-b5a7171dca7d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:39.726137 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de47c237-b5cd-468c-838c-b5a7171dca7d admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:39.772418 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:DELETE=7,keystone:SELECT=91,keystone:INSERT=2 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:39.795395 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1003/1987] 10.222.0.67 () {60 vars in 1143 bytes} [Wed May 25 14:42:39 2022] POST /identity/v3/users => generated 292 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:42:39.800507 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de47c237-b5cd-468c-838c-b5a7171dca7d admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:39.820161 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de47c237-b5cd-468c-838c-b5a7171dca7d admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:39.834783 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7337684f-af4b-498f-b133-fb861572a7d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:39.836089 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7337684f-af4b-498f-b133-fb861572a7d0 admin admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:39.836523 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7337684f-af4b-498f-b133-fb861572a7d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:39.836816 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7337684f-af4b-498f-b133-fb861572a7d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:39.837576 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7337684f-af4b-498f-b133-fb861572a7d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:39.839334 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7337684f-af4b-498f-b133-fb861572a7d0 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:39.848500 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be4643c-e114-460f-bb23-ea439f43797c admin admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:39.867717 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762c86a2-b82f-4299-8aba-a78f9d2a6ac2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:39.868098 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1004/1988] 10.222.0.67 () {58 vars in 1121 bytes} [Wed May 25 14:42:39 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 25 14:42:39.869569 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7337684f-af4b-498f-b133-fb861572a7d0 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:39.871426 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762c86a2-b82f-4299-8aba-a78f9d2a6ac2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:39.871751 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762c86a2-b82f-4299-8aba-a78f9d2a6ac2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:39.872028 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762c86a2-b82f-4299-8aba-a78f9d2a6ac2 admin admin] PATH_INFO: `/v3/users/e07dd69fffaf46819d1362b61c919a51` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:39.874489 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762c86a2-b82f-4299-8aba-a78f9d2a6ac2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e07dd69fffaf46819d1362b61c919a51)` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:39.885603 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7337684f-af4b-498f-b133-fb861572a7d0 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:39.893369 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f013312-7e51-441b-bc8d-1ee59e94fc75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:39.894153 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f013312-7e51-441b-bc8d-1ee59e94fc75 admin admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:39.894477 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f013312-7e51-441b-bc8d-1ee59e94fc75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:39.894761 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f013312-7e51-441b-bc8d-1ee59e94fc75 admin admin] PATH_INFO: `/v3/roles` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:39.895773 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f013312-7e51-441b-bc8d-1ee59e94fc75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:39.897836 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f013312-7e51-441b-bc8d-1ee59e94fc75 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:39.899036 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762c86a2-b82f-4299-8aba-a78f9d2a6ac2 admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:39.953362 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1005/1989] 10.222.0.67 () {58 vars in 1121 bytes} [Wed May 25 14:42:39 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:42:39.963356 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f013312-7e51-441b-bc8d-1ee59e94fc75 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:39.986740 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f013312-7e51-441b-bc8d-1ee59e94fc75 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:40.003822 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1998e429-8833-451a-aa14-8068453006c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:40.005050 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1998e429-8833-451a-aa14-8068453006c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:40.005510 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1998e429-8833-451a-aa14-8068453006c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:40.005940 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1998e429-8833-451a-aa14-8068453006c2 admin admin] PATH_INFO: `/v3/projects/746155fb80c84d1ca99c221f25e3c3bc/users/a1e3a2be11a341a8a298ff61218f249e/roles/48808901834b4d5eab2c7e6b5b03791e` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:40.031248 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1998e429-8833-451a-aa14-8068453006c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=746155fb80c84d1ca99c221f25e3c3bc, user_id=a1e3a2be11a341a8a298ff61218f249e, role_id=48808901834b4d5eab2c7e6b5b03791e)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:40.036324 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-762c86a2-b82f-4299-8aba-a78f9d2a6ac2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e07dd69fffaf46819d1362b61c919a51'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:42:40.036597 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1998e429-8833-451a-aa14-8068453006c2 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:40.037682 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-762c86a2-b82f-4299-8aba-a78f9d2a6ac2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e07dd69fffaf46819d1362b61c919a51'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:42:40.038975 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-762c86a2-b82f-4299-8aba-a78f9d2a6ac2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e07dd69fffaf46819d1362b61c919a51'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:42:40.080199 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1006/1990] 10.222.0.67 () {60 vars in 1482 bytes} [Wed May 25 14:42:39 2022] PUT /identity/v3/projects/746155fb80c84d1ca99c221f25e3c3bc/users/a1e3a2be11a341a8a298ff61218f249e/roles/48808901834b4d5eab2c7e6b5b03791e => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:42:40.082504 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30962f85-bad5-47ea-b9d6-a039e0abb046 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:40.082851 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30962f85-bad5-47ea-b9d6-a039e0abb046 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:40.083151 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30962f85-bad5-47ea-b9d6-a039e0abb046 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:40.086898 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-762c86a2-b82f-4299-8aba-a78f9d2a6ac2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e07dd69fffaf46819d1362b61c919a51'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:42:40.104507 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-762c86a2-b82f-4299-8aba-a78f9d2a6ac2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e07dd69fffaf46819d1362b61c919a51'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:42:40.132862 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 985/1991] 10.222.0.67 () {58 vars in 1223 bytes} [Wed May 25 14:42:39 2022] DELETE /identity/v3/users/e07dd69fffaf46819d1362b61c919a51 => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:42:40.138314 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-30962f85-bad5-47ea-b9d6-a039e0abb046 None None] MFA Rules not processed for user `a1e3a2be11a341a8a298ff61218f249e`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:42:40.140335 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-30962f85-bad5-47ea-b9d6-a039e0abb046 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:42:40.243354 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:40.300816 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1007/1992] 10.222.0.67 () {58 vars in 957 bytes} [Wed May 25 14:42:40 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:42:40.315157 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762c86a2-b82f-4299-8aba-a78f9d2a6ac2 admin admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:40.316732 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-762c86a2-b82f-4299-8aba-a78f9d2a6ac2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:42:40.444656 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762c86a2-b82f-4299-8aba-a78f9d2a6ac2 admin admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:40.453448 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbfe67e-2e47-48e8-b8a9-79f759470d45 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e462acc9da84a61bb23998dd54e1858', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfe93ee8d32a441295efc0b885de4bd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:40.454680 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbfe67e-2e47-48e8-b8a9-79f759470d45 service cinder] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:40.455149 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbfe67e-2e47-48e8-b8a9-79f759470d45 service cinder] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:40.455664 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbfe67e-2e47-48e8-b8a9-79f759470d45 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:40.467025 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbfe67e-2e47-48e8-b8a9-79f759470d45 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:40.470072 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbfe67e-2e47-48e8-b8a9-79f759470d45 service cinder] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:40.486474 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 986/1993] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 14:42:40 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:42:40.515228 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30962f85-bad5-47ea-b9d6-a039e0abb046 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:40.516815 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-30962f85-bad5-47ea-b9d6-a039e0abb046 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:42:40.615681 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30962f85-bad5-47ea-b9d6-a039e0abb046 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:40.638661 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfe8030-3953-4627-a4af-962ad60e7673 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:40.640077 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfe8030-3953-4627-a4af-962ad60e7673 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:40.640526 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfe8030-3953-4627-a4af-962ad60e7673 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:40.641443 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfe8030-3953-4627-a4af-962ad60e7673 admin admin] PATH_INFO: `/v3/users/a1e3a2be11a341a8a298ff61218f249e` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:40.647809 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfe8030-3953-4627-a4af-962ad60e7673 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a1e3a2be11a341a8a298ff61218f249e)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:40.652547 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfe8030-3953-4627-a4af-962ad60e7673 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:40.730864 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-6bfe8030-3953-4627-a4af-962ad60e7673 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a1e3a2be11a341a8a298ff61218f249e'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:42:40.745288 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-6bfe8030-3953-4627-a4af-962ad60e7673 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a1e3a2be11a341a8a298ff61218f249e'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:42:40.746401 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-6bfe8030-3953-4627-a4af-962ad60e7673 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a1e3a2be11a341a8a298ff61218f249e'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:42:40.755937 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-6bfe8030-3953-4627-a4af-962ad60e7673 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a1e3a2be11a341a8a298ff61218f249e'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:42:40.781715 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-6bfe8030-3953-4627-a4af-962ad60e7673 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a1e3a2be11a341a8a298ff61218f249e'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:42:40.793640 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1008/1994] 10.222.0.67 () {58 vars in 1223 bytes} [Wed May 25 14:42:40 2022] DELETE /identity/v3/users/a1e3a2be11a341a8a298ff61218f249e => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:42:40.799886 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d4d2fc-d227-4986-9d5f-f1a526065537 None None] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:40.806141 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d4d2fc-d227-4986-9d5f-f1a526065537 None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:40.806851 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d4d2fc-d227-4986-9d5f-f1a526065537 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:40.829050 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfe8030-3953-4627-a4af-962ad60e7673 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:40.832024 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-6bfe8030-3953-4627-a4af-962ad60e7673 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:42:40.844233 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.auth.core [None req-74d4d2fc-d227-4986-9d5f-f1a526065537 None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:42:40.846599 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-74d4d2fc-d227-4986-9d5f-f1a526065537 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:42:40.925003 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:40.953936 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 987/1995] 10.222.0.67 () {58 vars in 957 bytes} [Wed May 25 14:42:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:42:40.956260 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c13e79b-a8aa-4eef-8fdf-461657b68ba6 None None] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:40.956748 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c13e79b-a8aa-4eef-8fdf-461657b68ba6 None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:40.964370 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c13e79b-a8aa-4eef-8fdf-461657b68ba6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:40.967253 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfe8030-3953-4627-a4af-962ad60e7673 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:40.973902 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b5892a-4bad-41a3-8819-cf2eba3f12bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:40.975662 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b5892a-4bad-41a3-8819-cf2eba3f12bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:40.976657 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b5892a-4bad-41a3-8819-cf2eba3f12bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:40.976657 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b5892a-4bad-41a3-8819-cf2eba3f12bf admin admin] PATH_INFO: `/v3/projects/c9f1edfe1afe4c01bb3b137d4b4a7733` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:40.977844 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b5892a-4bad-41a3-8819-cf2eba3f12bf admin admin] RBAC: Authorizing `identity:delete_project(project_id=c9f1edfe1afe4c01bb3b137d4b4a7733)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:40.980109 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b5892a-4bad-41a3-8819-cf2eba3f12bf admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:41.008291 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:41.009437 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.auth.core [None req-2c13e79b-a8aa-4eef-8fdf-461657b68ba6 None None] MFA Rules not processed for user `a410509c46324181afa917494917c850`. Rule list: `[]` (Enabled: `True`). {{(pid=80474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:42:41.010888 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-2c13e79b-a8aa-4eef-8fdf-461657b68ba6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:42:41.059035 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-33b5892a-4bad-41a3-8819-cf2eba3f12bf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c9f1edfe1afe4c01bb3b137d4b4a7733', 'request_id': 'req-33b5892a-4bad-41a3-8819-cf2eba3f12bf'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:42:41.069590 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-33b5892a-4bad-41a3-8819-cf2eba3f12bf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c9f1edfe1afe4c01bb3b137d4b4a7733', 'request_id': 'req-33b5892a-4bad-41a3-8819-cf2eba3f12bf'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:42:41.084286 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-33b5892a-4bad-41a3-8819-cf2eba3f12bf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c9f1edfe1afe4c01bb3b137d4b4a7733', 'request_id': 'req-33b5892a-4bad-41a3-8819-cf2eba3f12bf'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:42:41.103536 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-33b5892a-4bad-41a3-8819-cf2eba3f12bf admin admin] The token cache is being invalidate because project c9f1edfe1afe4c01bb3b137d4b4a7733 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80475) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 14:42:41.103842 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-33b5892a-4bad-41a3-8819-cf2eba3f12bf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:42:41.117967 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-33b5892a-4bad-41a3-8819-cf2eba3f12bf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:42:41.124023 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1009/1996] 10.222.0.67 () {58 vars in 1232 bytes} [Wed May 25 14:42:40 2022] DELETE /identity/v3/projects/c9f1edfe1afe4c01bb3b137d4b4a7733 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:42:41.135305 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b5892a-4bad-41a3-8819-cf2eba3f12bf admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:41.140231 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-33b5892a-4bad-41a3-8819-cf2eba3f12bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:42:41.163123 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 988/1997] 10.222.0.67 () {58 vars in 957 bytes} [Wed May 25 14:42:40 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:42:41.164790 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a0f686-b256-469e-b412-e0187ae8621e None None] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:41.165197 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a0f686-b256-469e-b412-e0187ae8621e None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:41.165584 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a0f686-b256-469e-b412-e0187ae8621e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:41.191321 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.auth.core [None req-46a0f686-b256-469e-b412-e0187ae8621e None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:42:41.193340 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-46a0f686-b256-469e-b412-e0187ae8621e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:42:41.252240 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b5892a-4bad-41a3-8819-cf2eba3f12bf admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:41.257900 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013b8e75-2a27-4e51-b9fa-4c8aaf518c33 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b68eed985c7b49839bcdd173186ad4ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfe93ee8d32a441295efc0b885de4bd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:41.257900 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013b8e75-2a27-4e51-b9fa-4c8aaf518c33 service neutron] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:41.258382 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013b8e75-2a27-4e51-b9fa-4c8aaf518c33 service neutron] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:41.259042 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013b8e75-2a27-4e51-b9fa-4c8aaf518c33 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:41.266021 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-013b8e75-2a27-4e51-b9fa-4c8aaf518c33 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:42:41.293874 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 989/1998] 10.222.0.67 () {58 vars in 957 bytes} [Wed May 25 14:42:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:42:41.293874 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a0f686-b256-469e-b412-e0187ae8621e None None] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:41.293874 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-46a0f686-b256-469e-b412-e0187ae8621e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:42:41.305437 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a0f686-b256-469e-b412-e0187ae8621e None None] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:41.316005 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2a69ce-6d37-4375-9f6f-fb81dbc89c4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:41.316688 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2a69ce-6d37-4375-9f6f-fb81dbc89c4c admin admin] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:41.316986 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2a69ce-6d37-4375-9f6f-fb81dbc89c4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:41.317247 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2a69ce-6d37-4375-9f6f-fb81dbc89c4c admin admin] PATH_INFO: `/v3/projects` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:41.317969 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2a69ce-6d37-4375-9f6f-fb81dbc89c4c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:41.323051 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2a69ce-6d37-4375-9f6f-fb81dbc89c4c admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:41.378964 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013b8e75-2a27-4e51-b9fa-4c8aaf518c33 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:41.380805 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 990/1999] 10.222.0.67 () {60 vars in 1152 bytes} [Wed May 25 14:42:41 2022] POST /identity/v3/projects => generated 373 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:42:41.380805 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686dfcb4-a7bb-408a-a25b-c8e1c5b247b6 None None] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:41.380805 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686dfcb4-a7bb-408a-a25b-c8e1c5b247b6 None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:41.380805 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686dfcb4-a7bb-408a-a25b-c8e1c5b247b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:41.385525 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013b8e75-2a27-4e51-b9fa-4c8aaf518c33 service neutron] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:41.404657 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1010/2000] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 14:42:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 280 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:42:41.406065 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013b8e75-2a27-4e51-b9fa-4c8aaf518c33 service neutron] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:41.417746 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013b8e75-2a27-4e51-b9fa-4c8aaf518c33 service neutron] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:41.419810 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.auth.core [None req-686dfcb4-a7bb-408a-a25b-c8e1c5b247b6 None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:42:41.421908 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-686dfcb4-a7bb-408a-a25b-c8e1c5b247b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:42:41.512768 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:41.545598 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d875f0a8-d74f-4999-aff5-df77f623dca3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:41.546514 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d875f0a8-d74f-4999-aff5-df77f623dca3 admin admin] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:41.548325 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d875f0a8-d74f-4999-aff5-df77f623dca3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:41.550950 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d875f0a8-d74f-4999-aff5-df77f623dca3 admin admin] PATH_INFO: `/v3/users` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:41.552706 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d875f0a8-d74f-4999-aff5-df77f623dca3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:41.555847 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d875f0a8-d74f-4999-aff5-df77f623dca3 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:41.589729 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 991/2001] 10.222.0.67 () {58 vars in 957 bytes} [Wed May 25 14:42:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:42:41.594416 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686dfcb4-a7bb-408a-a25b-c8e1c5b247b6 None None] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:41.600726 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1011/2002] 10.222.0.67 () {60 vars in 1143 bytes} [Wed May 25 14:42:41 2022] POST /identity/v3/users => generated 293 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:42:41.601089 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:41.601842 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d875f0a8-d74f-4999-aff5-df77f623dca3 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:41.609359 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686dfcb4-a7bb-408a-a25b-c8e1c5b247b6 None None] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:41.614463 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d875f0a8-d74f-4999-aff5-df77f623dca3 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:41.616107 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d165b5eb-89df-4d1d-aa5f-b5e126344c73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:41.616863 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d165b5eb-89df-4d1d-aa5f-b5e126344c73 admin admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:41.617229 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d165b5eb-89df-4d1d-aa5f-b5e126344c73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:41.617577 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d165b5eb-89df-4d1d-aa5f-b5e126344c73 admin admin] PATH_INFO: `/v3/domains` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:41.618856 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d165b5eb-89df-4d1d-aa5f-b5e126344c73 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:42:41.618856 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d165b5eb-89df-4d1d-aa5f-b5e126344c73 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:41.620996 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d165b5eb-89df-4d1d-aa5f-b5e126344c73 admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:41.621703 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75647745-53e7-43b9-8c26-c5d9b553a205 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:41.622432 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75647745-53e7-43b9-8c26-c5d9b553a205 admin admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:41.622793 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75647745-53e7-43b9-8c26-c5d9b553a205 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:41.623242 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75647745-53e7-43b9-8c26-c5d9b553a205 admin admin] PATH_INFO: `/v3/roles` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:41.624000 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75647745-53e7-43b9-8c26-c5d9b553a205 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:41.626625 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75647745-53e7-43b9-8c26-c5d9b553a205 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:41.657621 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 992/2003] 10.222.0.67 () {58 vars in 1152 bytes} [Wed May 25 14:42:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:42:41.664279 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1012/2004] 10.222.0.67 () {58 vars in 1121 bytes} [Wed May 25 14:42:41 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:42:41.668112 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d165b5eb-89df-4d1d-aa5f-b5e126344c73 admin admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:41.668852 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75647745-53e7-43b9-8c26-c5d9b553a205 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:41.682623 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75647745-53e7-43b9-8c26-c5d9b553a205 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:41.686797 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d165b5eb-89df-4d1d-aa5f-b5e126344c73 admin admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:41.699122 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642aa104-a38f-4257-b05e-ffa029152e8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:41.700299 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642aa104-a38f-4257-b05e-ffa029152e8d admin admin] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:41.700920 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642aa104-a38f-4257-b05e-ffa029152e8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:41.701217 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642aa104-a38f-4257-b05e-ffa029152e8d admin admin] PATH_INFO: `/v3/projects` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:41.702132 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642aa104-a38f-4257-b05e-ffa029152e8d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:41.705756 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642aa104-a38f-4257-b05e-ffa029152e8d admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:41.711795 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a6b780-785d-464f-844a-8efb54bf5801 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:41.712713 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a6b780-785d-464f-844a-8efb54bf5801 admin admin] REQUEST_METHOD: `PUT` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:41.712985 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a6b780-785d-464f-844a-8efb54bf5801 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:41.713261 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a6b780-785d-464f-844a-8efb54bf5801 admin admin] PATH_INFO: `/v3/projects/b0f47d81a5b14df7909cd8d606ccc277/users/12a6c9016d874523a1f2885d46756763/roles/399893e19eac4ab5a8e596f7c07be13c` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:41.750381 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a6b780-785d-464f-844a-8efb54bf5801 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b0f47d81a5b14df7909cd8d606ccc277, user_id=12a6c9016d874523a1f2885d46756763, role_id=399893e19eac4ab5a8e596f7c07be13c)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:41.755323 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a6b780-785d-464f-844a-8efb54bf5801 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:41.765201 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 993/2005] 10.222.0.67 () {60 vars in 1152 bytes} [Wed May 25 14:42:41 2022] POST /identity/v3/projects => generated 377 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:42:41.769854 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642aa104-a38f-4257-b05e-ffa029152e8d admin admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:41.783396 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1013/2006] 10.222.0.67 () {60 vars in 1482 bytes} [Wed May 25 14:42:41 2022] PUT /identity/v3/projects/b0f47d81a5b14df7909cd8d606ccc277/users/12a6c9016d874523a1f2885d46756763/roles/399893e19eac4ab5a8e596f7c07be13c => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:42:41.787635 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a6b780-785d-464f-844a-8efb54bf5801 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:41.894873 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642aa104-a38f-4257-b05e-ffa029152e8d admin admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:41.898943 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a6b780-785d-464f-844a-8efb54bf5801 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:41.900025 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c286c786-e6d3-4fb9-b22d-0692f2ed97ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:41.900761 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c286c786-e6d3-4fb9-b22d-0692f2ed97ba admin admin] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:41.901053 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c286c786-e6d3-4fb9-b22d-0692f2ed97ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:41.901402 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c286c786-e6d3-4fb9-b22d-0692f2ed97ba admin admin] PATH_INFO: `/v3/users` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:41.902136 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c286c786-e6d3-4fb9-b22d-0692f2ed97ba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:41.904158 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c286c786-e6d3-4fb9-b22d-0692f2ed97ba admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:41.910220 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533a5c1c-e62c-4648-b065-2673f7d9c42e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:41.910882 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533a5c1c-e62c-4648-b065-2673f7d9c42e admin admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:41.911196 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533a5c1c-e62c-4648-b065-2673f7d9c42e admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:41.911472 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533a5c1c-e62c-4648-b065-2673f7d9c42e admin admin] PATH_INFO: `/v3/roles` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:41.912460 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533a5c1c-e62c-4648-b065-2673f7d9c42e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:41.914429 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533a5c1c-e62c-4648-b065-2673f7d9c42e admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:41.931163 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1014/2007] 10.222.0.67 () {58 vars in 1121 bytes} [Wed May 25 14:42:41 2022] GET /identity/v3/roles => generated 1420 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:42:41.933069 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533a5c1c-e62c-4648-b065-2673f7d9c42e admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:41.937143 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 994/2008] 10.222.0.67 () {60 vars in 1143 bytes} [Wed May 25 14:42:41 2022] POST /identity/v3/users => generated 289 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:42:41.937649 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-533a5c1c-e62c-4648-b065-2673f7d9c42e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:42:41.937746 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c286c786-e6d3-4fb9-b22d-0692f2ed97ba admin admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:41.949719 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c286c786-e6d3-4fb9-b22d-0692f2ed97ba admin admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:41.955586 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0396ee1c-0b4f-4bd7-b8b8-1d30e2af3d73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:41.956455 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533a5c1c-e62c-4648-b065-2673f7d9c42e admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:41.956583 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0396ee1c-0b4f-4bd7-b8b8-1d30e2af3d73 admin admin] REQUEST_METHOD: `PUT` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:41.956793 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0396ee1c-0b4f-4bd7-b8b8-1d30e2af3d73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:41.957081 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0396ee1c-0b4f-4bd7-b8b8-1d30e2af3d73 admin admin] PATH_INFO: `/v3/projects/b0f47d81a5b14df7909cd8d606ccc277/users/12a6c9016d874523a1f2885d46756763/roles/399893e19eac4ab5a8e596f7c07be13c` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:41.959139 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0396ee1c-0b4f-4bd7-b8b8-1d30e2af3d73 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b0f47d81a5b14df7909cd8d606ccc277, user_id=12a6c9016d874523a1f2885d46756763, role_id=399893e19eac4ab5a8e596f7c07be13c)` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:41.961792 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0396ee1c-0b4f-4bd7-b8b8-1d30e2af3d73 admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:41.962492 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ac5c28-fcfa-487c-ad37-2c72eff6b0b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:41.963400 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ac5c28-fcfa-487c-ad37-2c72eff6b0b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:41.963688 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ac5c28-fcfa-487c-ad37-2c72eff6b0b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:41.963961 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ac5c28-fcfa-487c-ad37-2c72eff6b0b3 admin admin] PATH_INFO: `/v3/projects/746155fb80c84d1ca99c221f25e3c3bc` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:41.965158 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ac5c28-fcfa-487c-ad37-2c72eff6b0b3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=746155fb80c84d1ca99c221f25e3c3bc)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:41.967112 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ac5c28-fcfa-487c-ad37-2c72eff6b0b3 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:41.974707 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 995/2009] 10.222.0.67 () {60 vars in 1482 bytes} [Wed May 25 14:42:41 2022] PUT /identity/v3/projects/b0f47d81a5b14df7909cd8d606ccc277/users/12a6c9016d874523a1f2885d46756763/roles/399893e19eac4ab5a8e596f7c07be13c => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:42:41.975408 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0396ee1c-0b4f-4bd7-b8b8-1d30e2af3d73 admin admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:42.029808 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-12ac5c28-fcfa-487c-ad37-2c72eff6b0b3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '746155fb80c84d1ca99c221f25e3c3bc', 'request_id': 'req-12ac5c28-fcfa-487c-ad37-2c72eff6b0b3'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:42:42.035465 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-12ac5c28-fcfa-487c-ad37-2c72eff6b0b3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '746155fb80c84d1ca99c221f25e3c3bc', 'request_id': 'req-12ac5c28-fcfa-487c-ad37-2c72eff6b0b3'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:42:42.042856 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-12ac5c28-fcfa-487c-ad37-2c72eff6b0b3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '746155fb80c84d1ca99c221f25e3c3bc', 'request_id': 'req-12ac5c28-fcfa-487c-ad37-2c72eff6b0b3'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:42:42.054812 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0396ee1c-0b4f-4bd7-b8b8-1d30e2af3d73 admin admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:42.065103 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-12ac5c28-fcfa-487c-ad37-2c72eff6b0b3 admin admin] The token cache is being invalidate because project 746155fb80c84d1ca99c221f25e3c3bc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80475) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 14:42:42.065410 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-12ac5c28-fcfa-487c-ad37-2c72eff6b0b3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:42:42.066139 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-12ac5c28-fcfa-487c-ad37-2c72eff6b0b3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:42:42.068101 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1015/2010] 10.222.0.67 () {58 vars in 1232 bytes} [Wed May 25 14:42:41 2022] DELETE /identity/v3/projects/746155fb80c84d1ca99c221f25e3c3bc => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:42:42.072816 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5dba79-c579-4c04-9bec-53bd036596e7 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:42.073105 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5dba79-c579-4c04-9bec-53bd036596e7 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:42.073424 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5dba79-c579-4c04-9bec-53bd036596e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:42.093994 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-eb5dba79-c579-4c04-9bec-53bd036596e7 None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:42:42.095635 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-eb5dba79-c579-4c04-9bec-53bd036596e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:42:42.117984 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:42.120497 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:42.139347 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e632133-1346-46ed-8128-6d33cf568203 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:42.140688 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e632133-1346-46ed-8128-6d33cf568203 admin admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:42.140688 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e632133-1346-46ed-8128-6d33cf568203 admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:42.140688 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e632133-1346-46ed-8128-6d33cf568203 admin admin] PATH_INFO: `/v3/roles` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:42.143918 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e632133-1346-46ed-8128-6d33cf568203 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:42.143918 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e632133-1346-46ed-8128-6d33cf568203 admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:42.154771 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 996/2011] 10.222.0.67 () {58 vars in 1121 bytes} [Wed May 25 14:42:41 2022] GET /identity/v3/roles => generated 1420 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:42:42.160401 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e632133-1346-46ed-8128-6d33cf568203 admin admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:42.162888 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-8e632133-1346-46ed-8128-6d33cf568203 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:42:42.179098 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e632133-1346-46ed-8128-6d33cf568203 admin admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:42.184352 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a6c43d-27f7-44e3-91ef-7176f4f7e985 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:42.185028 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a6c43d-27f7-44e3-91ef-7176f4f7e985 admin admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:42.185347 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a6c43d-27f7-44e3-91ef-7176f4f7e985 admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:42.185631 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a6c43d-27f7-44e3-91ef-7176f4f7e985 admin admin] PATH_INFO: `/v3/roles` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:42.186426 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a6c43d-27f7-44e3-91ef-7176f4f7e985 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:42.188000 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a6c43d-27f7-44e3-91ef-7176f4f7e985 admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:42.191726 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1016/2012] 10.222.0.67 () {58 vars in 957 bytes} [Wed May 25 14:42:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:42:42.199704 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1f8768-b26c-4257-904a-49d7e0c0a2ee None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:42.199945 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1f8768-b26c-4257-904a-49d7e0c0a2ee None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:42.200281 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1f8768-b26c-4257-904a-49d7e0c0a2ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:42.204351 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 997/2013] 10.222.0.67 () {58 vars in 1121 bytes} [Wed May 25 14:42:42 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 25 14:42:42.209851 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a6c43d-27f7-44e3-91ef-7176f4f7e985 admin admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:42.225194 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-df1f8768-b26c-4257-904a-49d7e0c0a2ee None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:42:42.226095 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a6c43d-27f7-44e3-91ef-7176f4f7e985 admin admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:42.227189 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-df1f8768-b26c-4257-904a-49d7e0c0a2ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:42:42.230926 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4169fcc4-861a-4506-ab75-bac01c22613f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:42.232249 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4169fcc4-861a-4506-ab75-bac01c22613f admin admin] REQUEST_METHOD: `PUT` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:42.232566 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4169fcc4-861a-4506-ab75-bac01c22613f admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:42.232961 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4169fcc4-861a-4506-ab75-bac01c22613f admin admin] PATH_INFO: `/v3/projects/d6b081b8dcf645819f0586cf97896121/users/c03ca6f74c8d44a8812fba029e5c641c/roles/48808901834b4d5eab2c7e6b5b03791e` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:42.239641 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1017/2014] 10.222.0.67 () {58 vars in 957 bytes} [Wed May 25 14:42:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:42:42.244280 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1f8768-b26c-4257-904a-49d7e0c0a2ee None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:42.253105 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4169fcc4-861a-4506-ab75-bac01c22613f admin admin] RBAC: Authorizing `identity:create_grant(project_id=d6b081b8dcf645819f0586cf97896121, user_id=c03ca6f74c8d44a8812fba029e5c641c, role_id=48808901834b4d5eab2c7e6b5b03791e)` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:42.255804 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4169fcc4-861a-4506-ab75-bac01c22613f admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:42.256022 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1f8768-b26c-4257-904a-49d7e0c0a2ee None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:42.263266 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939556bf-8502-4f76-b3f0-097aaa603ff3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:42.263946 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939556bf-8502-4f76-b3f0-097aaa603ff3 admin admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:42.264347 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939556bf-8502-4f76-b3f0-097aaa603ff3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:42.264632 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939556bf-8502-4f76-b3f0-097aaa603ff3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:42.265394 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939556bf-8502-4f76-b3f0-097aaa603ff3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:42:42.265700 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939556bf-8502-4f76-b3f0-097aaa603ff3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:42.268230 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939556bf-8502-4f76-b3f0-097aaa603ff3 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:42.276490 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 998/2015] 10.222.0.67 () {60 vars in 1482 bytes} [Wed May 25 14:42:42 2022] PUT /identity/v3/projects/d6b081b8dcf645819f0586cf97896121/users/c03ca6f74c8d44a8812fba029e5c641c/roles/48808901834b4d5eab2c7e6b5b03791e => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 14:42:42.283065 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1018/2016] 10.222.0.67 () {58 vars in 1152 bytes} [Wed May 25 14:42:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:42:42.287567 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4169fcc4-861a-4506-ab75-bac01c22613f admin admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:42.290112 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c376a4d4-9a19-4530-b920-37614af85093 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:42.290506 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c376a4d4-9a19-4530-b920-37614af85093 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:42.290705 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c376a4d4-9a19-4530-b920-37614af85093 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:42.330888 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-c376a4d4-9a19-4530-b920-37614af85093 None None] MFA Rules not processed for user `c03ca6f74c8d44a8812fba029e5c641c`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:42:42.332820 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-c376a4d4-9a19-4530-b920-37614af85093 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:42:42.398344 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4169fcc4-861a-4506-ab75-bac01c22613f admin admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:42.405672 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b00c939-6d7d-4d91-b4db-62fa267b2c57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:42.406715 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b00c939-6d7d-4d91-b4db-62fa267b2c57 admin admin] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:42.407425 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b00c939-6d7d-4d91-b4db-62fa267b2c57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:42.408560 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b00c939-6d7d-4d91-b4db-62fa267b2c57 admin admin] PATH_INFO: `/v3/projects` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:42.409513 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b00c939-6d7d-4d91-b4db-62fa267b2c57 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:42.411976 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b00c939-6d7d-4d91-b4db-62fa267b2c57 admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:42.422183 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1019/2017] 10.222.0.67 () {58 vars in 957 bytes} [Wed May 25 14:42:42 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:42:42.423718 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c376a4d4-9a19-4530-b920-37614af85093 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:42.436229 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c376a4d4-9a19-4530-b920-37614af85093 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:42.442959 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68db574d-0856-4728-a6ac-6a355c9a0a15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:42.443852 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68db574d-0856-4728-a6ac-6a355c9a0a15 admin admin] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:42.444150 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68db574d-0856-4728-a6ac-6a355c9a0a15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:42.444508 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68db574d-0856-4728-a6ac-6a355c9a0a15 admin admin] PATH_INFO: `/v3/projects` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:42.445202 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68db574d-0856-4728-a6ac-6a355c9a0a15 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:42.447528 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68db574d-0856-4728-a6ac-6a355c9a0a15 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:42.451061 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 999/2018] 10.222.0.67 () {60 vars in 1152 bytes} [Wed May 25 14:42:42 2022] POST /identity/v3/projects => generated 375 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 14:42:42.456253 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b00c939-6d7d-4d91-b4db-62fa267b2c57 admin admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:42.481427 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1020/2019] 10.222.0.67 () {60 vars in 1152 bytes} [Wed May 25 14:42:42 2022] POST /identity/v3/projects => generated 377 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:42:42.487270 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68db574d-0856-4728-a6ac-6a355c9a0a15 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:42.544349 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b00c939-6d7d-4d91-b4db-62fa267b2c57 admin admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:42.582789 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68db574d-0856-4728-a6ac-6a355c9a0a15 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:42.589085 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fa4bfd-dc91-44f9-9f83-8706bae203d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:42.590243 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fa4bfd-dc91-44f9-9f83-8706bae203d3 admin admin] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:42.590538 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fa4bfd-dc91-44f9-9f83-8706bae203d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:42.590819 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fa4bfd-dc91-44f9-9f83-8706bae203d3 admin admin] PATH_INFO: `/v3/users` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:42.591561 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25fa4bfd-dc91-44f9-9f83-8706bae203d3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:42.593519 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25fa4bfd-dc91-44f9-9f83-8706bae203d3 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:42.600767 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:42.624805 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1021/2020] 10.222.0.67 () {60 vars in 1143 bytes} [Wed May 25 14:42:42 2022] POST /identity/v3/users => generated 295 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:42:42.627331 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fa4bfd-dc91-44f9-9f83-8706bae203d3 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:42.630614 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c489cb-5d5c-48ee-8d88-8181deef2651 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:42.631732 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c489cb-5d5c-48ee-8d88-8181deef2651 admin admin] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:42.632778 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c489cb-5d5c-48ee-8d88-8181deef2651 admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:42.633123 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c489cb-5d5c-48ee-8d88-8181deef2651 admin admin] PATH_INFO: `/v3/users` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:42.633883 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c489cb-5d5c-48ee-8d88-8181deef2651 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:42.637121 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:42.637337 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c489cb-5d5c-48ee-8d88-8181deef2651 admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:42.646315 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fa4bfd-dc91-44f9-9f83-8706bae203d3 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:42.652845 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af1b12c-ae0c-4182-b4c5-51f9184e0f79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:42.653678 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af1b12c-ae0c-4182-b4c5-51f9184e0f79 admin admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:42.654078 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af1b12c-ae0c-4182-b4c5-51f9184e0f79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:42.654434 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af1b12c-ae0c-4182-b4c5-51f9184e0f79 admin admin] PATH_INFO: `/v3/roles` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:42.655320 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af1b12c-ae0c-4182-b4c5-51f9184e0f79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:42.657053 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af1b12c-ae0c-4182-b4c5-51f9184e0f79 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:42.685749 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1022/2021] 10.222.0.67 () {58 vars in 1121 bytes} [Wed May 25 14:42:42 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:42:42.686673 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af1b12c-ae0c-4182-b4c5-51f9184e0f79 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:42.695213 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1000/2022] 10.222.0.67 () {60 vars in 1143 bytes} [Wed May 25 14:42:42 2022] POST /identity/v3/users => generated 288 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 14:42:42.699715 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c489cb-5d5c-48ee-8d88-8181deef2651 admin admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:42.703109 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af1b12c-ae0c-4182-b4c5-51f9184e0f79 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:42.710550 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0482d7ce-74a6-4c79-8fb9-b125056dd861 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:42.711597 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0482d7ce-74a6-4c79-8fb9-b125056dd861 admin admin] REQUEST_METHOD: `PUT` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:42.711974 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0482d7ce-74a6-4c79-8fb9-b125056dd861 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:42.712323 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0482d7ce-74a6-4c79-8fb9-b125056dd861 admin admin] PATH_INFO: `/v3/projects/60eaf62ea64a4c1fbd5d231c53983f5b/users/bdd07ea79dd7465fb2f67e532dbeeda7/roles/399893e19eac4ab5a8e596f7c07be13c` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:42.717024 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c489cb-5d5c-48ee-8d88-8181deef2651 admin admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:42.725919 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d60b68-e2b3-4909-8902-a039ff0f5d30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:42.727122 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d60b68-e2b3-4909-8902-a039ff0f5d30 admin admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:42.727555 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d60b68-e2b3-4909-8902-a039ff0f5d30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:42.728405 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d60b68-e2b3-4909-8902-a039ff0f5d30 admin admin] PATH_INFO: `/v3/roles` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:42.729846 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d60b68-e2b3-4909-8902-a039ff0f5d30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:42.731096 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0482d7ce-74a6-4c79-8fb9-b125056dd861 admin admin] RBAC: Authorizing `identity:create_grant(project_id=60eaf62ea64a4c1fbd5d231c53983f5b, user_id=bdd07ea79dd7465fb2f67e532dbeeda7, role_id=399893e19eac4ab5a8e596f7c07be13c)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:42.731965 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d60b68-e2b3-4909-8902-a039ff0f5d30 admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:42.734090 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0482d7ce-74a6-4c79-8fb9-b125056dd861 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:42.755941 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1001/2023] 10.222.0.67 () {58 vars in 1121 bytes} [Wed May 25 14:42:42 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 25 14:42:42.762281 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1023/2024] 10.222.0.67 () {60 vars in 1482 bytes} [Wed May 25 14:42:42 2022] PUT /identity/v3/projects/60eaf62ea64a4c1fbd5d231c53983f5b/users/bdd07ea79dd7465fb2f67e532dbeeda7/roles/399893e19eac4ab5a8e596f7c07be13c => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 14:42:42.762962 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d60b68-e2b3-4909-8902-a039ff0f5d30 admin admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:42.768464 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0482d7ce-74a6-4c79-8fb9-b125056dd861 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:42.820679 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d60b68-e2b3-4909-8902-a039ff0f5d30 admin admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:42.894553 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0482d7ce-74a6-4c79-8fb9-b125056dd861 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:42.901385 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f782a4f1-7f73-49f0-a1fd-13c7e603bdbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:42.902639 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f782a4f1-7f73-49f0-a1fd-13c7e603bdbf admin admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:42.903199 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f782a4f1-7f73-49f0-a1fd-13c7e603bdbf admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:42.903870 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f782a4f1-7f73-49f0-a1fd-13c7e603bdbf admin admin] PATH_INFO: `/v3/roles` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:42.905480 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f782a4f1-7f73-49f0-a1fd-13c7e603bdbf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:42.911971 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f782a4f1-7f73-49f0-a1fd-13c7e603bdbf admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:42.932527 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1024/2025] 10.222.0.67 () {58 vars in 1121 bytes} [Wed May 25 14:42:42 2022] GET /identity/v3/roles => generated 1420 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:42:42.932527 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2913a081-2d36-4a29-9ac0-84a5db304c68 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:42.932527 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2913a081-2d36-4a29-9ac0-84a5db304c68 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:42.932527 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2913a081-2d36-4a29-9ac0-84a5db304c68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:42.949956 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40972aed-0a75-4249-bdb9-d780fbc0c2f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:42.951358 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40972aed-0a75-4249-bdb9-d780fbc0c2f3 admin admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:42.951645 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40972aed-0a75-4249-bdb9-d780fbc0c2f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:42.951923 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40972aed-0a75-4249-bdb9-d780fbc0c2f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:42.952672 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40972aed-0a75-4249-bdb9-d780fbc0c2f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:42.956507 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40972aed-0a75-4249-bdb9-d780fbc0c2f3 admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:42.968043 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-2913a081-2d36-4a29-9ac0-84a5db304c68 None None] MFA Rules not processed for user `12a6c9016d874523a1f2885d46756763`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:42:42.970037 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-2913a081-2d36-4a29-9ac0-84a5db304c68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:42:42.980019 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1002/2026] 10.222.0.67 () {58 vars in 1121 bytes} [Wed May 25 14:42:42 2022] GET /identity/v3/roles => generated 1420 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:42:42.981170 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40972aed-0a75-4249-bdb9-d780fbc0c2f3 admin admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:42.994550 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40972aed-0a75-4249-bdb9-d780fbc0c2f3 admin admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:43.000092 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1de3e6-c3d7-4424-b499-b84d86ded3fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:43.003030 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1de3e6-c3d7-4424-b499-b84d86ded3fa admin admin] REQUEST_METHOD: `PUT` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:43.003030 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1de3e6-c3d7-4424-b499-b84d86ded3fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:43.003030 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1de3e6-c3d7-4424-b499-b84d86ded3fa admin admin] PATH_INFO: `/v3/projects/60eaf62ea64a4c1fbd5d231c53983f5b/users/bdd07ea79dd7465fb2f67e532dbeeda7/roles/399893e19eac4ab5a8e596f7c07be13c` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:43.005016 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1de3e6-c3d7-4424-b499-b84d86ded3fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=60eaf62ea64a4c1fbd5d231c53983f5b, user_id=bdd07ea79dd7465fb2f67e532dbeeda7, role_id=399893e19eac4ab5a8e596f7c07be13c)` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:43.009208 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1de3e6-c3d7-4424-b499-b84d86ded3fa admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:43.027179 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1003/2027] 10.222.0.67 () {60 vars in 1482 bytes} [Wed May 25 14:42:42 2022] PUT /identity/v3/projects/60eaf62ea64a4c1fbd5d231c53983f5b/users/bdd07ea79dd7465fb2f67e532dbeeda7/roles/399893e19eac4ab5a8e596f7c07be13c => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:42:43.028254 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1de3e6-c3d7-4424-b499-b84d86ded3fa admin admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:43.058300 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1025/2028] 10.222.0.67 () {58 vars in 957 bytes} [Wed May 25 14:42:42 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:42:43.058843 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcf0475-05ce-4c1d-a3fe-7d8dacde7d7a None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:43.058843 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcf0475-05ce-4c1d-a3fe-7d8dacde7d7a None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:43.059183 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcf0475-05ce-4c1d-a3fe-7d8dacde7d7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:43.092097 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-cdcf0475-05ce-4c1d-a3fe-7d8dacde7d7a None None] MFA Rules not processed for user `bdd07ea79dd7465fb2f67e532dbeeda7`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:42:43.094787 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-cdcf0475-05ce-4c1d-a3fe-7d8dacde7d7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:42:43.119046 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1de3e6-c3d7-4424-b499-b84d86ded3fa admin admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:43.125327 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d930d2-9fb0-4bd3-b55c-8a4e4ad7d0bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:43.127439 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d930d2-9fb0-4bd3-b55c-8a4e4ad7d0bb admin admin] REQUEST_METHOD: `PUT` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:43.127916 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d930d2-9fb0-4bd3-b55c-8a4e4ad7d0bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:43.128205 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d930d2-9fb0-4bd3-b55c-8a4e4ad7d0bb admin admin] PATH_INFO: `/v3/projects/90924dc5536443c2bedc9bcfecc479da/users/2d4cda804b8d43f6a5c204f005ed5224/roles/48808901834b4d5eab2c7e6b5b03791e` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:43.148635 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d930d2-9fb0-4bd3-b55c-8a4e4ad7d0bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=90924dc5536443c2bedc9bcfecc479da, user_id=2d4cda804b8d43f6a5c204f005ed5224, role_id=48808901834b4d5eab2c7e6b5b03791e)` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:43.151467 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:43.152870 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d930d2-9fb0-4bd3-b55c-8a4e4ad7d0bb admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:43.168651 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1004/2029] 10.222.0.67 () {60 vars in 1482 bytes} [Wed May 25 14:42:43 2022] PUT /identity/v3/projects/90924dc5536443c2bedc9bcfecc479da/users/2d4cda804b8d43f6a5c204f005ed5224/roles/48808901834b4d5eab2c7e6b5b03791e => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:42:43.170007 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cc955f-f785-4506-88b6-2186b1226199 None None] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:43.170278 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cc955f-f785-4506-88b6-2186b1226199 None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:43.170565 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cc955f-f785-4506-88b6-2186b1226199 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:43.192555 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.auth.core [None req-d1cc955f-f785-4506-88b6-2186b1226199 None None] MFA Rules not processed for user `a410509c46324181afa917494917c850`. Rule list: `[]` (Enabled: `True`). {{(pid=80474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:42:43.193766 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-d1cc955f-f785-4506-88b6-2186b1226199 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:42:43.199916 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1026/2030] 10.222.0.67 () {58 vars in 957 bytes} [Wed May 25 14:42:43 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:42:43.203212 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d536a40-2529-4978-b3d7-2a5a5ce1c930 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:43.203212 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d536a40-2529-4978-b3d7-2a5a5ce1c930 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:43.203212 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d536a40-2529-4978-b3d7-2a5a5ce1c930 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:43.230776 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:43.241180 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-3d536a40-2529-4978-b3d7-2a5a5ce1c930 None None] MFA Rules not processed for user `2d4cda804b8d43f6a5c204f005ed5224`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:42:43.243684 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-3d536a40-2529-4978-b3d7-2a5a5ce1c930 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:42:43.291972 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1005/2031] 10.222.0.67 () {58 vars in 957 bytes} [Wed May 25 14:42:43 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:42:43.293138 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cc955f-f785-4506-88b6-2186b1226199 None None] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:43.294655 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-d1cc955f-f785-4506-88b6-2186b1226199 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:42:43.352282 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1027/2032] 10.222.0.67 () {58 vars in 957 bytes} [Wed May 25 14:42:43 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:42:43.353230 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d536a40-2529-4978-b3d7-2a5a5ce1c930 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:43.354620 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-3d536a40-2529-4978-b3d7-2a5a5ce1c930 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:42:43.385405 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cc955f-f785-4506-88b6-2186b1226199 None None] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:43.389335 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c738f20b-47cf-4526-9665-a954bb5b84b2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e462acc9da84a61bb23998dd54e1858', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfe93ee8d32a441295efc0b885de4bd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:43.390636 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c738f20b-47cf-4526-9665-a954bb5b84b2 service cinder] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:43.390923 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c738f20b-47cf-4526-9665-a954bb5b84b2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:43.391245 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c738f20b-47cf-4526-9665-a954bb5b84b2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:43.445726 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d536a40-2529-4978-b3d7-2a5a5ce1c930 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:43.451326 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5f0f9b-7d1c-450b-bd80-814525a4b6e2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '428ec99478284743943ed41e9d24a603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfe93ee8d32a441295efc0b885de4bd7', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:43.451980 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5f0f9b-7d1c-450b-bd80-814525a4b6e2 service nova] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:43.452263 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5f0f9b-7d1c-450b-bd80-814525a4b6e2 service nova] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:43.452538 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5f0f9b-7d1c-450b-bd80-814525a4b6e2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:43.454917 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-ec5f0f9b-7d1c-450b-bd80-814525a4b6e2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:42:43.460889 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c738f20b-47cf-4526-9665-a954bb5b84b2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:43.462334 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c738f20b-47cf-4526-9665-a954bb5b84b2 service cinder] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:43.465677 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5f0f9b-7d1c-450b-bd80-814525a4b6e2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:43.467292 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5f0f9b-7d1c-450b-bd80-814525a4b6e2 service nova] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:43.472443 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1006/2033] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 14:42:43 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:42:43.473057 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c738f20b-47cf-4526-9665-a954bb5b84b2 service cinder] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:43.476817 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1028/2034] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 14:42:43 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:42:43.550917 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c738f20b-47cf-4526-9665-a954bb5b84b2 service cinder] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:43.555957 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc14123-624d-442d-a8d7-873c1ccb9d81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:43.556613 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc14123-624d-442d-a8d7-873c1ccb9d81 admin admin] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:43.556893 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc14123-624d-442d-a8d7-873c1ccb9d81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:43.557168 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc14123-624d-442d-a8d7-873c1ccb9d81 admin admin] PATH_INFO: `/v3/projects` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:43.557864 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc14123-624d-442d-a8d7-873c1ccb9d81 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:43.559816 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc14123-624d-442d-a8d7-873c1ccb9d81 admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:43.594174 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1007/2035] 10.222.0.67 () {60 vars in 1152 bytes} [Wed May 25 14:42:43 2022] POST /identity/v3/projects => generated 375 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:42:43.595516 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5f0f9b-7d1c-450b-bd80-814525a4b6e2 service nova] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:43.609823 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5f0f9b-7d1c-450b-bd80-814525a4b6e2 service nova] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:43.677174 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:43.691935 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8eabcc-729f-4690-af0f-293df4442c71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:43.692753 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8eabcc-729f-4690-af0f-293df4442c71 admin admin] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:43.693045 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8eabcc-729f-4690-af0f-293df4442c71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:43.693470 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8eabcc-729f-4690-af0f-293df4442c71 admin admin] PATH_INFO: `/v3/users` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:43.694366 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8eabcc-729f-4690-af0f-293df4442c71 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:43.696666 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8eabcc-729f-4690-af0f-293df4442c71 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:43.726984 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1029/2036] 10.222.0.67 () {60 vars in 1143 bytes} [Wed May 25 14:42:43 2022] POST /identity/v3/users => generated 294 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 14:42:43.730956 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc14123-624d-442d-a8d7-873c1ccb9d81 admin admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:43.747180 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc14123-624d-442d-a8d7-873c1ccb9d81 admin admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:43.772126 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a7ebfc-c0d9-4a69-8fbf-8fba72b5b3dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:43.772126 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a7ebfc-c0d9-4a69-8fbf-8fba72b5b3dd admin admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:43.772126 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a7ebfc-c0d9-4a69-8fbf-8fba72b5b3dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:43.772126 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a7ebfc-c0d9-4a69-8fbf-8fba72b5b3dd admin admin] PATH_INFO: `/v3/roles` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:43.772519 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a7ebfc-c0d9-4a69-8fbf-8fba72b5b3dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:43.772519 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a7ebfc-c0d9-4a69-8fbf-8fba72b5b3dd admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:43.806439 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1008/2037] 10.222.0.67 () {58 vars in 1121 bytes} [Wed May 25 14:42:43 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:42:43.809020 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8eabcc-729f-4690-af0f-293df4442c71 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:43.835346 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8eabcc-729f-4690-af0f-293df4442c71 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:43.858274 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7121bc-ee9f-40e0-9c34-d8157caacff1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:43.859818 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7121bc-ee9f-40e0-9c34-d8157caacff1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:43.860427 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7121bc-ee9f-40e0-9c34-d8157caacff1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:43.860804 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7121bc-ee9f-40e0-9c34-d8157caacff1 admin admin] PATH_INFO: `/v3/projects/37e99b93275348e4bf0b03e18cc8a5f3/users/f1914fe6aef1491b8a0ba52aebaf53a4/roles/399893e19eac4ab5a8e596f7c07be13c` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:43.905897 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7121bc-ee9f-40e0-9c34-d8157caacff1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=37e99b93275348e4bf0b03e18cc8a5f3, user_id=f1914fe6aef1491b8a0ba52aebaf53a4, role_id=399893e19eac4ab5a8e596f7c07be13c)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:43.908809 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7121bc-ee9f-40e0-9c34-d8157caacff1 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:43.926685 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1030/2038] 10.222.0.67 () {60 vars in 1482 bytes} [Wed May 25 14:42:43 2022] PUT /identity/v3/projects/37e99b93275348e4bf0b03e18cc8a5f3/users/f1914fe6aef1491b8a0ba52aebaf53a4/roles/399893e19eac4ab5a8e596f7c07be13c => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:42:43.931336 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a7ebfc-c0d9-4a69-8fbf-8fba72b5b3dd admin admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:43.936712 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:43.944978 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a7ebfc-c0d9-4a69-8fbf-8fba72b5b3dd admin admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:44.038694 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c155ee4-669b-4ad7-a929-0ae4021ddecd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:44.039407 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c155ee4-669b-4ad7-a929-0ae4021ddecd admin admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:44.039692 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c155ee4-669b-4ad7-a929-0ae4021ddecd admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:44.039971 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c155ee4-669b-4ad7-a929-0ae4021ddecd admin admin] PATH_INFO: `/v3/roles` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:44.040707 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c155ee4-669b-4ad7-a929-0ae4021ddecd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:44.042452 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c155ee4-669b-4ad7-a929-0ae4021ddecd admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:44.053767 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1009/2039] 10.222.0.67 () {58 vars in 1121 bytes} [Wed May 25 14:42:43 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:42:44.058309 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7121bc-ee9f-40e0-9c34-d8157caacff1 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:44.069643 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7121bc-ee9f-40e0-9c34-d8157caacff1 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:44.074441 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57682a8e-cb04-4f74-a3e0-e327a4083a43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:44.075439 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57682a8e-cb04-4f74-a3e0-e327a4083a43 admin admin] REQUEST_METHOD: `PUT` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:44.075793 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57682a8e-cb04-4f74-a3e0-e327a4083a43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:44.076137 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57682a8e-cb04-4f74-a3e0-e327a4083a43 admin admin] PATH_INFO: `/v3/projects/37e99b93275348e4bf0b03e18cc8a5f3/users/f1914fe6aef1491b8a0ba52aebaf53a4/roles/399893e19eac4ab5a8e596f7c07be13c` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:44.078204 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57682a8e-cb04-4f74-a3e0-e327a4083a43 admin admin] RBAC: Authorizing `identity:create_grant(project_id=37e99b93275348e4bf0b03e18cc8a5f3, user_id=f1914fe6aef1491b8a0ba52aebaf53a4, role_id=399893e19eac4ab5a8e596f7c07be13c)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:44.081095 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57682a8e-cb04-4f74-a3e0-e327a4083a43 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:44.094827 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1031/2040] 10.222.0.67 () {60 vars in 1482 bytes} [Wed May 25 14:42:44 2022] PUT /identity/v3/projects/37e99b93275348e4bf0b03e18cc8a5f3/users/f1914fe6aef1491b8a0ba52aebaf53a4/roles/399893e19eac4ab5a8e596f7c07be13c => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:42:44.108031 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6268200-e58d-4a2e-898a-14e35b17e6d6 None None] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:44.108327 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6268200-e58d-4a2e-898a-14e35b17e6d6 None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:44.108633 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6268200-e58d-4a2e-898a-14e35b17e6d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:44.147399 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.auth.core [None req-f6268200-e58d-4a2e-898a-14e35b17e6d6 None None] MFA Rules not processed for user `f1914fe6aef1491b8a0ba52aebaf53a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:42:44.148814 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-f6268200-e58d-4a2e-898a-14e35b17e6d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:42:44.244648 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1010/2041] 10.222.0.67 () {58 vars in 957 bytes} [Wed May 25 14:42:44 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 14:42:44.252324 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57682a8e-cb04-4f74-a3e0-e327a4083a43 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:44.254003 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-57682a8e-cb04-4f74-a3e0-e327a4083a43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:42:44.321946 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57682a8e-cb04-4f74-a3e0-e327a4083a43 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:44.325861 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0553cb2-6add-4b29-be46-6c067fbabe45 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e462acc9da84a61bb23998dd54e1858', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfe93ee8d32a441295efc0b885de4bd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:44.326519 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0553cb2-6add-4b29-be46-6c067fbabe45 service cinder] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:44.326801 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0553cb2-6add-4b29-be46-6c067fbabe45 service cinder] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:44.327108 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0553cb2-6add-4b29-be46-6c067fbabe45 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:44.401400 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0553cb2-6add-4b29-be46-6c067fbabe45 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:44.402946 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0553cb2-6add-4b29-be46-6c067fbabe45 service cinder] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:44.414587 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1032/2042] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 14:42:44 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:42:44.442232 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6268200-e58d-4a2e-898a-14e35b17e6d6 None None] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:44.454875 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6268200-e58d-4a2e-898a-14e35b17e6d6 None None] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:44.458966 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df846781-844d-43eb-997e-75d44c948533 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e462acc9da84a61bb23998dd54e1858', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfe93ee8d32a441295efc0b885de4bd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:44.459695 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df846781-844d-43eb-997e-75d44c948533 service cinder] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:44.460053 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df846781-844d-43eb-997e-75d44c948533 service cinder] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:44.460428 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df846781-844d-43eb-997e-75d44c948533 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:44.462955 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-df846781-844d-43eb-997e-75d44c948533 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:42:44.575768 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df846781-844d-43eb-997e-75d44c948533 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:44.577406 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df846781-844d-43eb-997e-75d44c948533 service cinder] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:44.593615 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1011/2043] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 14:42:44 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:42:46.255845 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0553cb2-6add-4b29-be46-6c067fbabe45 service cinder] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:46.266267 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0553cb2-6add-4b29-be46-6c067fbabe45 service cinder] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:46.272089 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81f66e3-a115-49b5-be0a-ed8c6eb720f1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e462acc9da84a61bb23998dd54e1858', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfe93ee8d32a441295efc0b885de4bd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:46.272758 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81f66e3-a115-49b5-be0a-ed8c6eb720f1 service cinder] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:46.273040 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81f66e3-a115-49b5-be0a-ed8c6eb720f1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:46.273315 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81f66e3-a115-49b5-be0a-ed8c6eb720f1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:46.348619 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:46.363286 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81f66e3-a115-49b5-be0a-ed8c6eb720f1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:46.367014 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81f66e3-a115-49b5-be0a-ed8c6eb720f1 service cinder] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:46.384822 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1033/2044] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 14:42:46 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:42:47.087285 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df846781-844d-43eb-997e-75d44c948533 service cinder] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:47.111220 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:47.167913 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df846781-844d-43eb-997e-75d44c948533 service cinder] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:47.174088 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927d1d16-8547-418a-957e-c7d7366acc51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:47.175235 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927d1d16-8547-418a-957e-c7d7366acc51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:47.175529 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927d1d16-8547-418a-957e-c7d7366acc51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:47.176434 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927d1d16-8547-418a-957e-c7d7366acc51 admin admin] PATH_INFO: `/v3/users/2d4cda804b8d43f6a5c204f005ed5224` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:47.177854 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927d1d16-8547-418a-957e-c7d7366acc51 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2d4cda804b8d43f6a5c204f005ed5224)` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:47.180085 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927d1d16-8547-418a-957e-c7d7366acc51 admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:47.235125 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-927d1d16-8547-418a-957e-c7d7366acc51 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2d4cda804b8d43f6a5c204f005ed5224'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:42:47.235947 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-927d1d16-8547-418a-957e-c7d7366acc51 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2d4cda804b8d43f6a5c204f005ed5224'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:42:47.236679 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-927d1d16-8547-418a-957e-c7d7366acc51 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2d4cda804b8d43f6a5c204f005ed5224'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:42:47.249171 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-927d1d16-8547-418a-957e-c7d7366acc51 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2d4cda804b8d43f6a5c204f005ed5224'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:42:47.257486 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-927d1d16-8547-418a-957e-c7d7366acc51 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2d4cda804b8d43f6a5c204f005ed5224'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:42:47.273875 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1012/2045] 10.222.0.67 () {58 vars in 1223 bytes} [Wed May 25 14:42:47 2022] DELETE /identity/v3/users/2d4cda804b8d43f6a5c204f005ed5224 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:42:47.278590 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd250d41-922b-4879-b3e4-51b31583493c None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:47.280106 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd250d41-922b-4879-b3e4-51b31583493c None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:47.280396 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd250d41-922b-4879-b3e4-51b31583493c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:47.300559 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-cd250d41-922b-4879-b3e4-51b31583493c None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:42:47.301790 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-cd250d41-922b-4879-b3e4-51b31583493c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:42:47.373562 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1034/2046] 10.222.0.67 () {58 vars in 957 bytes} [Wed May 25 14:42:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 14:42:47.383344 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927d1d16-8547-418a-957e-c7d7366acc51 admin admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:47.384930 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-927d1d16-8547-418a-957e-c7d7366acc51 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:42:47.466336 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927d1d16-8547-418a-957e-c7d7366acc51 admin admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:47.474221 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1966536b-8b99-4308-8543-62142272d44e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b68eed985c7b49839bcdd173186ad4ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfe93ee8d32a441295efc0b885de4bd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:47.475522 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1966536b-8b99-4308-8543-62142272d44e service neutron] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:47.476030 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1966536b-8b99-4308-8543-62142272d44e service neutron] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:47.476254 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1966536b-8b99-4308-8543-62142272d44e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:47.491225 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1966536b-8b99-4308-8543-62142272d44e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:47.492452 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1966536b-8b99-4308-8543-62142272d44e service neutron] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:47.504492 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1013/2047] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 14:42:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:42:47.951656 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd250d41-922b-4879-b3e4-51b31583493c None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:47.954427 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-cd250d41-922b-4879-b3e4-51b31583493c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:42:47.979475 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd250d41-922b-4879-b3e4-51b31583493c None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:47.986247 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c3c232-7a27-4f5b-a295-95be837951fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:47.987623 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c3c232-7a27-4f5b-a295-95be837951fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:47.988089 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c3c232-7a27-4f5b-a295-95be837951fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:47.988753 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c3c232-7a27-4f5b-a295-95be837951fa admin admin] PATH_INFO: `/v3/projects/90924dc5536443c2bedc9bcfecc479da` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:47.990171 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c3c232-7a27-4f5b-a295-95be837951fa admin admin] RBAC: Authorizing `identity:delete_project(project_id=90924dc5536443c2bedc9bcfecc479da)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:47.992259 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c3c232-7a27-4f5b-a295-95be837951fa admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:48.059398 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-37c3c232-7a27-4f5b-a295-95be837951fa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '90924dc5536443c2bedc9bcfecc479da', 'request_id': 'req-37c3c232-7a27-4f5b-a295-95be837951fa'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:42:48.066454 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-37c3c232-7a27-4f5b-a295-95be837951fa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '90924dc5536443c2bedc9bcfecc479da', 'request_id': 'req-37c3c232-7a27-4f5b-a295-95be837951fa'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:42:48.073765 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-37c3c232-7a27-4f5b-a295-95be837951fa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '90924dc5536443c2bedc9bcfecc479da', 'request_id': 'req-37c3c232-7a27-4f5b-a295-95be837951fa'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:42:48.089171 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-37c3c232-7a27-4f5b-a295-95be837951fa admin admin] The token cache is being invalidate because project 90924dc5536443c2bedc9bcfecc479da was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80475) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 14:42:48.089463 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-37c3c232-7a27-4f5b-a295-95be837951fa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:42:48.090113 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-37c3c232-7a27-4f5b-a295-95be837951fa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:42:48.094534 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1035/2048] 10.222.0.67 () {58 vars in 1232 bytes} [Wed May 25 14:42:47 2022] DELETE /identity/v3/projects/90924dc5536443c2bedc9bcfecc479da => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:42:48.096216 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1966536b-8b99-4308-8543-62142272d44e service neutron] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:48.106684 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1966536b-8b99-4308-8543-62142272d44e service neutron] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:48.157984 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:48.190569 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a1fd7f-b007-4384-a88b-13ebb59da20e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:48.191488 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a1fd7f-b007-4384-a88b-13ebb59da20e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:48.191773 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a1fd7f-b007-4384-a88b-13ebb59da20e admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:48.192041 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a1fd7f-b007-4384-a88b-13ebb59da20e admin admin] PATH_INFO: `/v3/users/f1914fe6aef1491b8a0ba52aebaf53a4` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:48.193263 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a1fd7f-b007-4384-a88b-13ebb59da20e admin admin] RBAC: Authorizing `identity:delete_user(user_id=f1914fe6aef1491b8a0ba52aebaf53a4)` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:48.195211 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a1fd7f-b007-4384-a88b-13ebb59da20e admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:48.244118 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-99a1fd7f-b007-4384-a88b-13ebb59da20e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f1914fe6aef1491b8a0ba52aebaf53a4'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:42:48.244761 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-99a1fd7f-b007-4384-a88b-13ebb59da20e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f1914fe6aef1491b8a0ba52aebaf53a4'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:42:48.245357 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-99a1fd7f-b007-4384-a88b-13ebb59da20e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f1914fe6aef1491b8a0ba52aebaf53a4'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:42:48.257501 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-99a1fd7f-b007-4384-a88b-13ebb59da20e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f1914fe6aef1491b8a0ba52aebaf53a4'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:42:48.264496 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-99a1fd7f-b007-4384-a88b-13ebb59da20e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f1914fe6aef1491b8a0ba52aebaf53a4'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:42:48.277670 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1014/2049] 10.222.0.67 () {58 vars in 1223 bytes} [Wed May 25 14:42:48 2022] DELETE /identity/v3/users/f1914fe6aef1491b8a0ba52aebaf53a4 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:42:48.565178 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c3c232-7a27-4f5b-a295-95be837951fa admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:48.566680 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-37c3c232-7a27-4f5b-a295-95be837951fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:42:48.580905 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c3c232-7a27-4f5b-a295-95be837951fa admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:48.656844 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819eb9d5-1c1d-4737-b8c2-9a5e33563d23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:48.658398 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819eb9d5-1c1d-4737-b8c2-9a5e33563d23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:48.658678 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819eb9d5-1c1d-4737-b8c2-9a5e33563d23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:48.658955 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819eb9d5-1c1d-4737-b8c2-9a5e33563d23 admin admin] PATH_INFO: `/v3/projects/37e99b93275348e4bf0b03e18cc8a5f3` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:48.660247 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819eb9d5-1c1d-4737-b8c2-9a5e33563d23 admin admin] RBAC: Authorizing `identity:delete_project(project_id=37e99b93275348e4bf0b03e18cc8a5f3)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:48.662169 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819eb9d5-1c1d-4737-b8c2-9a5e33563d23 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:48.680952 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:48.716635 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-819eb9d5-1c1d-4737-b8c2-9a5e33563d23 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '37e99b93275348e4bf0b03e18cc8a5f3', 'request_id': 'req-819eb9d5-1c1d-4737-b8c2-9a5e33563d23'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:42:48.722687 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-819eb9d5-1c1d-4737-b8c2-9a5e33563d23 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '37e99b93275348e4bf0b03e18cc8a5f3', 'request_id': 'req-819eb9d5-1c1d-4737-b8c2-9a5e33563d23'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:42:48.729274 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-819eb9d5-1c1d-4737-b8c2-9a5e33563d23 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '37e99b93275348e4bf0b03e18cc8a5f3', 'request_id': 'req-819eb9d5-1c1d-4737-b8c2-9a5e33563d23'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:42:48.744016 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-819eb9d5-1c1d-4737-b8c2-9a5e33563d23 admin admin] The token cache is being invalidate because project 37e99b93275348e4bf0b03e18cc8a5f3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80475) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 14:42:48.744316 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-819eb9d5-1c1d-4737-b8c2-9a5e33563d23 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:42:48.744968 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-819eb9d5-1c1d-4737-b8c2-9a5e33563d23 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:42:48.746612 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1036/2050] 10.222.0.67 () {58 vars in 1232 bytes} [Wed May 25 14:42:48 2022] DELETE /identity/v3/projects/37e99b93275348e4bf0b03e18cc8a5f3 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:42:48.752446 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecae398-b051-4994-b8e7-aebfc49dc7e4 None None] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:48.752740 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecae398-b051-4994-b8e7-aebfc49dc7e4 None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:48.753886 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecae398-b051-4994-b8e7-aebfc49dc7e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:48.782688 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.auth.core [None req-6ecae398-b051-4994-b8e7-aebfc49dc7e4 None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:42:48.784193 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-6ecae398-b051-4994-b8e7-aebfc49dc7e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:42:48.880864 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1015/2051] 10.222.0.67 () {58 vars in 957 bytes} [Wed May 25 14:42:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:42:48.889249 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033e7483-59d5-4346-b25a-e0ceca39f4bd None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:48.889457 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033e7483-59d5-4346-b25a-e0ceca39f4bd None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:48.889569 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033e7483-59d5-4346-b25a-e0ceca39f4bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:48.911936 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-033e7483-59d5-4346-b25a-e0ceca39f4bd None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:42:48.913420 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-033e7483-59d5-4346-b25a-e0ceca39f4bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:42:48.922225 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1037/2052] 10.222.0.67 () {58 vars in 957 bytes} [Wed May 25 14:42:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:42:48.927741 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecae398-b051-4994-b8e7-aebfc49dc7e4 None None] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:48.938173 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecae398-b051-4994-b8e7-aebfc49dc7e4 None None] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:48.943290 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cab92d2-7a7a-46c4-aa95-b6d2001f3b77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:48.944054 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cab92d2-7a7a-46c4-aa95-b6d2001f3b77 admin admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:48.944363 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cab92d2-7a7a-46c4-aa95-b6d2001f3b77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:48.944906 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cab92d2-7a7a-46c4-aa95-b6d2001f3b77 admin admin] PATH_INFO: `/v3/domains` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:48.949405 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cab92d2-7a7a-46c4-aa95-b6d2001f3b77 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:42:48.949728 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cab92d2-7a7a-46c4-aa95-b6d2001f3b77 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:48.951390 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cab92d2-7a7a-46c4-aa95-b6d2001f3b77 admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:48.965368 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1016/2053] 10.222.0.67 () {58 vars in 1152 bytes} [Wed May 25 14:42:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:42:48.970297 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033e7483-59d5-4346-b25a-e0ceca39f4bd None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:48.980824 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033e7483-59d5-4346-b25a-e0ceca39f4bd None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:48.986949 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4f1fab-e5b9-45b1-b5e5-13e6f3dac777 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:48.987781 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4f1fab-e5b9-45b1-b5e5-13e6f3dac777 admin admin] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:48.988143 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4f1fab-e5b9-45b1-b5e5-13e6f3dac777 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:48.988483 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4f1fab-e5b9-45b1-b5e5-13e6f3dac777 admin admin] PATH_INFO: `/v3/projects` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:48.989257 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4f1fab-e5b9-45b1-b5e5-13e6f3dac777 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:48.991977 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4f1fab-e5b9-45b1-b5e5-13e6f3dac777 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:49.035039 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1038/2054] 10.222.0.67 () {60 vars in 1152 bytes} [Wed May 25 14:42:48 2022] POST /identity/v3/projects => generated 373 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 14:42:49.038789 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cab92d2-7a7a-46c4-aa95-b6d2001f3b77 admin admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:49.051614 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cab92d2-7a7a-46c4-aa95-b6d2001f3b77 admin admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:49.115840 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:49.138121 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ad89f6-297c-4f3e-918b-a02d6a34182f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:49.138853 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ad89f6-297c-4f3e-918b-a02d6a34182f admin admin] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:49.139241 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ad89f6-297c-4f3e-918b-a02d6a34182f admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:49.139655 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ad89f6-297c-4f3e-918b-a02d6a34182f admin admin] PATH_INFO: `/v3/users` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:49.140294 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ad89f6-297c-4f3e-918b-a02d6a34182f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:49.142714 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ad89f6-297c-4f3e-918b-a02d6a34182f admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:49.169702 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1017/2055] 10.222.0.67 () {60 vars in 1143 bytes} [Wed May 25 14:42:49 2022] POST /identity/v3/users => generated 287 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:42:49.174281 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4f1fab-e5b9-45b1-b5e5-13e6f3dac777 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:49.187964 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4f1fab-e5b9-45b1-b5e5-13e6f3dac777 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:49.193055 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2d199c-87f9-4387-b9f9-2fdcb12be26c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:49.193854 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2d199c-87f9-4387-b9f9-2fdcb12be26c admin admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:49.194203 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2d199c-87f9-4387-b9f9-2fdcb12be26c admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:49.194549 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2d199c-87f9-4387-b9f9-2fdcb12be26c admin admin] PATH_INFO: `/v3/roles` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:49.195414 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2d199c-87f9-4387-b9f9-2fdcb12be26c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:49.197872 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2d199c-87f9-4387-b9f9-2fdcb12be26c admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:49.223820 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1039/2056] 10.222.0.67 () {58 vars in 1121 bytes} [Wed May 25 14:42:49 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:42:49.225254 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ad89f6-297c-4f3e-918b-a02d6a34182f admin admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:49.236831 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ad89f6-297c-4f3e-918b-a02d6a34182f admin admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:49.241918 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9416f7ca-4ec2-4e7a-bed4-d054c5cad9b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:49.242598 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9416f7ca-4ec2-4e7a-bed4-d054c5cad9b4 admin admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:49.242887 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9416f7ca-4ec2-4e7a-bed4-d054c5cad9b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:49.243212 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9416f7ca-4ec2-4e7a-bed4-d054c5cad9b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:49.243962 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9416f7ca-4ec2-4e7a-bed4-d054c5cad9b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:49.245584 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9416f7ca-4ec2-4e7a-bed4-d054c5cad9b4 admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:49.257546 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1018/2057] 10.222.0.67 () {58 vars in 1121 bytes} [Wed May 25 14:42:49 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:42:49.265526 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2d199c-87f9-4387-b9f9-2fdcb12be26c admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:49.277160 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2d199c-87f9-4387-b9f9-2fdcb12be26c admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:49.282193 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f408c3d-6c6d-4c13-be9f-ece4086a6523 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:49.283848 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f408c3d-6c6d-4c13-be9f-ece4086a6523 admin admin] REQUEST_METHOD: `PUT` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:49.284138 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f408c3d-6c6d-4c13-be9f-ece4086a6523 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:49.284419 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f408c3d-6c6d-4c13-be9f-ece4086a6523 admin admin] PATH_INFO: `/v3/projects/48a020448dc5468ab51f56fad68b3e73/users/db5a248f2e54452ebcd188ad524153d0/roles/48808901834b4d5eab2c7e6b5b03791e` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:49.301603 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f408c3d-6c6d-4c13-be9f-ece4086a6523 admin admin] RBAC: Authorizing `identity:create_grant(project_id=48a020448dc5468ab51f56fad68b3e73, user_id=db5a248f2e54452ebcd188ad524153d0, role_id=48808901834b4d5eab2c7e6b5b03791e)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:49.304485 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f408c3d-6c6d-4c13-be9f-ece4086a6523 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:49.320128 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1040/2058] 10.222.0.67 () {60 vars in 1482 bytes} [Wed May 25 14:42:49 2022] PUT /identity/v3/projects/48a020448dc5468ab51f56fad68b3e73/users/db5a248f2e54452ebcd188ad524153d0/roles/48808901834b4d5eab2c7e6b5b03791e => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:42:49.332238 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f8fa08-aeb2-4d11-a5c2-fc1f58f91fde None None] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:49.332535 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f8fa08-aeb2-4d11-a5c2-fc1f58f91fde None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:49.332823 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f8fa08-aeb2-4d11-a5c2-fc1f58f91fde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:49.364927 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.auth.core [None req-37f8fa08-aeb2-4d11-a5c2-fc1f58f91fde None None] MFA Rules not processed for user `db5a248f2e54452ebcd188ad524153d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:42:49.366371 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-37f8fa08-aeb2-4d11-a5c2-fc1f58f91fde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:42:49.451865 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1019/2059] 10.222.0.67 () {58 vars in 957 bytes} [Wed May 25 14:42:49 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:42:49.465339 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f408c3d-6c6d-4c13-be9f-ece4086a6523 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:49.467408 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-3f408c3d-6c6d-4c13-be9f-ece4086a6523 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:42:49.533558 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f408c3d-6c6d-4c13-be9f-ece4086a6523 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:49.537925 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1326e64a-1c42-484d-bf16-3b64bf0992ae service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e462acc9da84a61bb23998dd54e1858', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfe93ee8d32a441295efc0b885de4bd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:49.538594 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1326e64a-1c42-484d-bf16-3b64bf0992ae service cinder] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:49.538881 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1326e64a-1c42-484d-bf16-3b64bf0992ae service cinder] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:49.539197 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1326e64a-1c42-484d-bf16-3b64bf0992ae service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:49.549349 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1326e64a-1c42-484d-bf16-3b64bf0992ae service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:49.551383 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1326e64a-1c42-484d-bf16-3b64bf0992ae service cinder] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:49.561266 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1041/2060] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 14:42:49 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:42:49.910536 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f8fa08-aeb2-4d11-a5c2-fc1f58f91fde None None] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:49.916005 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-37f8fa08-aeb2-4d11-a5c2-fc1f58f91fde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:42:50.009849 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f8fa08-aeb2-4d11-a5c2-fc1f58f91fde None None] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:50.015688 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c1ceb9-e3fd-4e8d-8bb2-e15bb2960cdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:50.016961 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c1ceb9-e3fd-4e8d-8bb2-e15bb2960cdd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:50.017488 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c1ceb9-e3fd-4e8d-8bb2-e15bb2960cdd admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:50.017979 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c1ceb9-e3fd-4e8d-8bb2-e15bb2960cdd admin admin] PATH_INFO: `/v3/users/a6465e0bde0e46cbb13f5c7679ee612f` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:50.019311 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c1ceb9-e3fd-4e8d-8bb2-e15bb2960cdd admin admin] RBAC: Authorizing `identity:delete_user(user_id=a6465e0bde0e46cbb13f5c7679ee612f)` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:50.021236 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c1ceb9-e3fd-4e8d-8bb2-e15bb2960cdd admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:50.071517 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-d8c1ceb9-e3fd-4e8d-8bb2-e15bb2960cdd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a6465e0bde0e46cbb13f5c7679ee612f'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:42:50.072176 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-d8c1ceb9-e3fd-4e8d-8bb2-e15bb2960cdd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a6465e0bde0e46cbb13f5c7679ee612f'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:42:50.072779 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-d8c1ceb9-e3fd-4e8d-8bb2-e15bb2960cdd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a6465e0bde0e46cbb13f5c7679ee612f'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:42:50.082002 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=89,keystone:INSERT=3,keystone:DELETE=8 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:50.089164 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-d8c1ceb9-e3fd-4e8d-8bb2-e15bb2960cdd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a6465e0bde0e46cbb13f5c7679ee612f'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:42:50.098090 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-d8c1ceb9-e3fd-4e8d-8bb2-e15bb2960cdd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a6465e0bde0e46cbb13f5c7679ee612f'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:42:50.112147 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1020/2061] 10.222.0.67 () {58 vars in 1223 bytes} [Wed May 25 14:42:49 2022] DELETE /identity/v3/users/a6465e0bde0e46cbb13f5c7679ee612f => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:42:50.116670 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b34cc71-2862-439b-a70d-9bf632fe813b None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:50.117161 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b34cc71-2862-439b-a70d-9bf632fe813b None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:50.117250 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b34cc71-2862-439b-a70d-9bf632fe813b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:50.136123 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-8b34cc71-2862-439b-a70d-9bf632fe813b None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:42:50.137371 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-8b34cc71-2862-439b-a70d-9bf632fe813b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:42:50.176862 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:50.208098 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1042/2062] 10.222.0.67 () {58 vars in 957 bytes} [Wed May 25 14:42:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:42:50.218190 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c1ceb9-e3fd-4e8d-8bb2-e15bb2960cdd admin admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:50.220723 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-d8c1ceb9-e3fd-4e8d-8bb2-e15bb2960cdd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:42:50.296999 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c1ceb9-e3fd-4e8d-8bb2-e15bb2960cdd admin admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:50.301423 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1586d6b2-f8c0-46c3-8460-751077b44250 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b68eed985c7b49839bcdd173186ad4ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfe93ee8d32a441295efc0b885de4bd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:50.302079 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1586d6b2-f8c0-46c3-8460-751077b44250 service neutron] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:50.302371 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1586d6b2-f8c0-46c3-8460-751077b44250 service neutron] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:50.302708 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1586d6b2-f8c0-46c3-8460-751077b44250 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:50.312972 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1586d6b2-f8c0-46c3-8460-751077b44250 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:50.314457 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1586d6b2-f8c0-46c3-8460-751077b44250 service neutron] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:50.325327 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1021/2063] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 14:42:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:42:50.631501 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b34cc71-2862-439b-a70d-9bf632fe813b None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:50.632991 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-8b34cc71-2862-439b-a70d-9bf632fe813b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:42:50.653129 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b34cc71-2862-439b-a70d-9bf632fe813b None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:50.658383 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0437bc18-30d9-468a-8571-342e41299115 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:50.659345 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0437bc18-30d9-468a-8571-342e41299115 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:50.659629 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0437bc18-30d9-468a-8571-342e41299115 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:50.659911 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0437bc18-30d9-468a-8571-342e41299115 admin admin] PATH_INFO: `/v3/projects/2830a12ef28a4fb3bf19cd2354767979` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:50.661390 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0437bc18-30d9-468a-8571-342e41299115 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2830a12ef28a4fb3bf19cd2354767979)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:50.663376 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0437bc18-30d9-468a-8571-342e41299115 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:50.713105 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-0437bc18-30d9-468a-8571-342e41299115 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2830a12ef28a4fb3bf19cd2354767979', 'request_id': 'req-0437bc18-30d9-468a-8571-342e41299115'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:42:50.718955 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-0437bc18-30d9-468a-8571-342e41299115 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2830a12ef28a4fb3bf19cd2354767979', 'request_id': 'req-0437bc18-30d9-468a-8571-342e41299115'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:42:50.725465 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-0437bc18-30d9-468a-8571-342e41299115 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2830a12ef28a4fb3bf19cd2354767979', 'request_id': 'req-0437bc18-30d9-468a-8571-342e41299115'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:42:50.740055 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-0437bc18-30d9-468a-8571-342e41299115 admin admin] The token cache is being invalidate because project 2830a12ef28a4fb3bf19cd2354767979 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80475) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 14:42:50.740347 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-0437bc18-30d9-468a-8571-342e41299115 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:42:50.740982 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-0437bc18-30d9-468a-8571-342e41299115 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:42:50.742537 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1043/2064] 10.222.0.67 () {58 vars in 1232 bytes} [Wed May 25 14:42:50 2022] DELETE /identity/v3/projects/2830a12ef28a4fb3bf19cd2354767979 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:42:50.746654 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1586d6b2-f8c0-46c3-8460-751077b44250 service neutron] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:50.757912 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1586d6b2-f8c0-46c3-8460-751077b44250 service neutron] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:50.817256 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729767bf-4ab3-4dda-b5a9-ece3e02441de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:50.818133 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729767bf-4ab3-4dda-b5a9-ece3e02441de admin admin] REQUEST_METHOD: `DELETE` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:50.818415 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729767bf-4ab3-4dda-b5a9-ece3e02441de admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:50.818692 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729767bf-4ab3-4dda-b5a9-ece3e02441de admin admin] PATH_INFO: `/v3/users/3b46afd6625348d591478ecab7ebd723` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:50.819923 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729767bf-4ab3-4dda-b5a9-ece3e02441de admin admin] RBAC: Authorizing `identity:delete_user(user_id=3b46afd6625348d591478ecab7ebd723)` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:50.821834 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729767bf-4ab3-4dda-b5a9-ece3e02441de admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:50.886796 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-729767bf-4ab3-4dda-b5a9-ece3e02441de admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3b46afd6625348d591478ecab7ebd723'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:42:50.887603 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-729767bf-4ab3-4dda-b5a9-ece3e02441de admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3b46afd6625348d591478ecab7ebd723'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:42:50.888322 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-729767bf-4ab3-4dda-b5a9-ece3e02441de admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3b46afd6625348d591478ecab7ebd723'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:42:50.904030 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-729767bf-4ab3-4dda-b5a9-ece3e02441de admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3b46afd6625348d591478ecab7ebd723'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:42:50.914326 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-729767bf-4ab3-4dda-b5a9-ece3e02441de admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3b46afd6625348d591478ecab7ebd723'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:42:50.918133 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:50.930462 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1022/2065] 10.222.0.67 () {58 vars in 1223 bytes} [Wed May 25 14:42:50 2022] DELETE /identity/v3/users/3b46afd6625348d591478ecab7ebd723 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:42:51.331756 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0437bc18-30d9-468a-8571-342e41299115 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:51.337443 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-0437bc18-30d9-468a-8571-342e41299115 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:42:51.408806 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0437bc18-30d9-468a-8571-342e41299115 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:51.519983 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f76329-d972-4615-be5f-3520988c4027 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:51.520990 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f76329-d972-4615-be5f-3520988c4027 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:51.521270 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f76329-d972-4615-be5f-3520988c4027 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:51.521685 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f76329-d972-4615-be5f-3520988c4027 admin admin] PATH_INFO: `/v3/projects/07df52b603a3483e9cb5b568c214cea4` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:51.526034 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f76329-d972-4615-be5f-3520988c4027 admin admin] RBAC: Authorizing `identity:delete_project(project_id=07df52b603a3483e9cb5b568c214cea4)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:51.528233 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f76329-d972-4615-be5f-3520988c4027 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:51.619733 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-e7f76329-d972-4615-be5f-3520988c4027 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '07df52b603a3483e9cb5b568c214cea4', 'request_id': 'req-e7f76329-d972-4615-be5f-3520988c4027'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:42:51.629556 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-e7f76329-d972-4615-be5f-3520988c4027 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '07df52b603a3483e9cb5b568c214cea4', 'request_id': 'req-e7f76329-d972-4615-be5f-3520988c4027'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:42:51.647171 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-e7f76329-d972-4615-be5f-3520988c4027 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '07df52b603a3483e9cb5b568c214cea4', 'request_id': 'req-e7f76329-d972-4615-be5f-3520988c4027'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:42:51.655166 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:51.672052 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-e7f76329-d972-4615-be5f-3520988c4027 admin admin] The token cache is being invalidate because project 07df52b603a3483e9cb5b568c214cea4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80475) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 14:42:51.674393 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-e7f76329-d972-4615-be5f-3520988c4027 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:42:51.675518 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-e7f76329-d972-4615-be5f-3520988c4027 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:42:51.677401 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1044/2066] 10.222.0.67 () {58 vars in 1232 bytes} [Wed May 25 14:42:51 2022] DELETE /identity/v3/projects/07df52b603a3483e9cb5b568c214cea4 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 14:42:51.683552 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac0a5a7-82b2-4f3a-b1e2-b708c1ee3832 None None] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:51.684043 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac0a5a7-82b2-4f3a-b1e2-b708c1ee3832 None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:51.684139 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac0a5a7-82b2-4f3a-b1e2-b708c1ee3832 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:51.716562 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.auth.core [None req-cac0a5a7-82b2-4f3a-b1e2-b708c1ee3832 None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:42:51.717803 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-cac0a5a7-82b2-4f3a-b1e2-b708c1ee3832 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:42:51.803944 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1023/2067] 10.222.0.67 () {58 vars in 957 bytes} [Wed May 25 14:42:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:42:51.813231 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244aa7e1-4b6a-4e17-9a23-0478a406d78d None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:51.814001 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244aa7e1-4b6a-4e17-9a23-0478a406d78d None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:51.814513 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244aa7e1-4b6a-4e17-9a23-0478a406d78d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:51.853315 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-244aa7e1-4b6a-4e17-9a23-0478a406d78d None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:42:51.854783 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-244aa7e1-4b6a-4e17-9a23-0478a406d78d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:42:51.866915 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1045/2068] 10.222.0.67 () {58 vars in 957 bytes} [Wed May 25 14:42:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:42:51.871644 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac0a5a7-82b2-4f3a-b1e2-b708c1ee3832 None None] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:51.884703 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac0a5a7-82b2-4f3a-b1e2-b708c1ee3832 None None] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:51.890679 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4646e18-64d5-43cc-a9a9-7ae4fa9b8ae5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:51.891650 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4646e18-64d5-43cc-a9a9-7ae4fa9b8ae5 admin admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:51.892085 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4646e18-64d5-43cc-a9a9-7ae4fa9b8ae5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:51.892492 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4646e18-64d5-43cc-a9a9-7ae4fa9b8ae5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:51.893757 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4646e18-64d5-43cc-a9a9-7ae4fa9b8ae5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:42:51.893757 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4646e18-64d5-43cc-a9a9-7ae4fa9b8ae5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:51.895388 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4646e18-64d5-43cc-a9a9-7ae4fa9b8ae5 admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:51.912814 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1024/2069] 10.222.0.67 () {58 vars in 1152 bytes} [Wed May 25 14:42:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:42:51.917369 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244aa7e1-4b6a-4e17-9a23-0478a406d78d None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:51.928081 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244aa7e1-4b6a-4e17-9a23-0478a406d78d None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:51.934683 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e805f5-395f-410f-a0b3-eafec9c4906d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:51.935617 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e805f5-395f-410f-a0b3-eafec9c4906d admin admin] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:51.936194 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e805f5-395f-410f-a0b3-eafec9c4906d admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:51.936540 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e805f5-395f-410f-a0b3-eafec9c4906d admin admin] PATH_INFO: `/v3/projects` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:51.937430 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e805f5-395f-410f-a0b3-eafec9c4906d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:51.940207 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e805f5-395f-410f-a0b3-eafec9c4906d admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:51.993258 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1046/2070] 10.222.0.67 () {60 vars in 1152 bytes} [Wed May 25 14:42:51 2022] POST /identity/v3/projects => generated 383 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:42:51.997806 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4646e18-64d5-43cc-a9a9-7ae4fa9b8ae5 admin admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:52.009402 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4646e18-64d5-43cc-a9a9-7ae4fa9b8ae5 admin admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:52.082884 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0de5329-2ed5-47b3-8115-9a44f1aa4ecc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:52.083690 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0de5329-2ed5-47b3-8115-9a44f1aa4ecc admin admin] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:52.083984 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0de5329-2ed5-47b3-8115-9a44f1aa4ecc admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:52.084360 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0de5329-2ed5-47b3-8115-9a44f1aa4ecc admin admin] PATH_INFO: `/v3/users` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:52.085062 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0de5329-2ed5-47b3-8115-9a44f1aa4ecc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:52.087053 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0de5329-2ed5-47b3-8115-9a44f1aa4ecc admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:52.113291 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1025/2071] 10.222.0.67 () {60 vars in 1143 bytes} [Wed May 25 14:42:51 2022] POST /identity/v3/users => generated 292 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:42:52.118378 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e805f5-395f-410f-a0b3-eafec9c4906d admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:52.130092 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e805f5-395f-410f-a0b3-eafec9c4906d admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:52.135942 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f59234-14f2-4bc5-81c3-05bb435cfa61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:52.136624 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f59234-14f2-4bc5-81c3-05bb435cfa61 admin admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:52.136911 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f59234-14f2-4bc5-81c3-05bb435cfa61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:52.137373 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f59234-14f2-4bc5-81c3-05bb435cfa61 admin admin] PATH_INFO: `/v3/roles` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:52.138116 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f59234-14f2-4bc5-81c3-05bb435cfa61 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:52.139791 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f59234-14f2-4bc5-81c3-05bb435cfa61 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:52.152756 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1047/2072] 10.222.0.67 () {58 vars in 1121 bytes} [Wed May 25 14:42:52 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 25 14:42:52.158524 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0de5329-2ed5-47b3-8115-9a44f1aa4ecc admin admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:52.169310 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0de5329-2ed5-47b3-8115-9a44f1aa4ecc admin admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:52.175235 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f0fa44-6c04-47fc-9700-b37b0373d978 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:52.175929 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f0fa44-6c04-47fc-9700-b37b0373d978 admin admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:52.176218 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f0fa44-6c04-47fc-9700-b37b0373d978 admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:52.176502 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f0fa44-6c04-47fc-9700-b37b0373d978 admin admin] PATH_INFO: `/v3/roles` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:52.177250 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f0fa44-6c04-47fc-9700-b37b0373d978 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:52.178856 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f0fa44-6c04-47fc-9700-b37b0373d978 admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:52.189686 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1026/2073] 10.222.0.67 () {58 vars in 1121 bytes} [Wed May 25 14:42:52 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:42:52.194224 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f59234-14f2-4bc5-81c3-05bb435cfa61 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:52.204839 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f59234-14f2-4bc5-81c3-05bb435cfa61 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:52.209589 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29adde80-0483-46eb-81e8-3ca20ae8b83f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:52.210472 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29adde80-0483-46eb-81e8-3ca20ae8b83f admin admin] REQUEST_METHOD: `PUT` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:52.210878 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29adde80-0483-46eb-81e8-3ca20ae8b83f admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:52.211203 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29adde80-0483-46eb-81e8-3ca20ae8b83f admin admin] PATH_INFO: `/v3/projects/b7d16d016929436ab480d8781c22388f/users/3d6ff094535147ccaa65d145d35e7c51/roles/48808901834b4d5eab2c7e6b5b03791e` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:52.230261 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29adde80-0483-46eb-81e8-3ca20ae8b83f admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7d16d016929436ab480d8781c22388f, user_id=3d6ff094535147ccaa65d145d35e7c51, role_id=48808901834b4d5eab2c7e6b5b03791e)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:52.234149 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29adde80-0483-46eb-81e8-3ca20ae8b83f admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:52.251528 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1048/2074] 10.222.0.67 () {60 vars in 1482 bytes} [Wed May 25 14:42:52 2022] PUT /identity/v3/projects/b7d16d016929436ab480d8781c22388f/users/3d6ff094535147ccaa65d145d35e7c51/roles/48808901834b4d5eab2c7e6b5b03791e => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:42:52.265539 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850fcda7-b75f-4cf6-9cb4-d0dbad7c9011 None None] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:52.266009 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850fcda7-b75f-4cf6-9cb4-d0dbad7c9011 None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:52.266953 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850fcda7-b75f-4cf6-9cb4-d0dbad7c9011 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:52.300256 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.auth.core [None req-850fcda7-b75f-4cf6-9cb4-d0dbad7c9011 None None] MFA Rules not processed for user `3d6ff094535147ccaa65d145d35e7c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:42:52.301658 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-850fcda7-b75f-4cf6-9cb4-d0dbad7c9011 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:42:52.354240 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:52.382523 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1027/2075] 10.222.0.67 () {58 vars in 957 bytes} [Wed May 25 14:42:52 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 14:42:52.390760 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29adde80-0483-46eb-81e8-3ca20ae8b83f admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:52.393503 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-29adde80-0483-46eb-81e8-3ca20ae8b83f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:42:52.475368 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29adde80-0483-46eb-81e8-3ca20ae8b83f admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:52.480565 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3ff4a8-15bb-4c64-89a0-ebe07fdbfd02 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e462acc9da84a61bb23998dd54e1858', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfe93ee8d32a441295efc0b885de4bd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:52.481540 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3ff4a8-15bb-4c64-89a0-ebe07fdbfd02 service cinder] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:52.481951 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3ff4a8-15bb-4c64-89a0-ebe07fdbfd02 service cinder] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:52.482307 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3ff4a8-15bb-4c64-89a0-ebe07fdbfd02 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:52.499891 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3ff4a8-15bb-4c64-89a0-ebe07fdbfd02 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:52.502721 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3ff4a8-15bb-4c64-89a0-ebe07fdbfd02 service cinder] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:52.515110 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1049/2076] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 14:42:52 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:42:52.833146 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850fcda7-b75f-4cf6-9cb4-d0dbad7c9011 None None] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:52.834638 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-850fcda7-b75f-4cf6-9cb4-d0dbad7c9011 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:42:52.931130 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850fcda7-b75f-4cf6-9cb4-d0dbad7c9011 None None] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:52.935962 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d8d899-7313-4e35-966d-d8daf447c080 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:52.936864 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d8d899-7313-4e35-966d-d8daf447c080 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:52.937152 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d8d899-7313-4e35-966d-d8daf447c080 admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:52.937434 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d8d899-7313-4e35-966d-d8daf447c080 admin admin] PATH_INFO: `/v3/users/db5a248f2e54452ebcd188ad524153d0` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:52.938949 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d8d899-7313-4e35-966d-d8daf447c080 admin admin] RBAC: Authorizing `identity:delete_user(user_id=db5a248f2e54452ebcd188ad524153d0)` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:52.940964 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d8d899-7313-4e35-966d-d8daf447c080 admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:52.991021 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-63d8d899-7313-4e35-966d-d8daf447c080 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'db5a248f2e54452ebcd188ad524153d0'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:42:52.991740 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-63d8d899-7313-4e35-966d-d8daf447c080 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'db5a248f2e54452ebcd188ad524153d0'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:42:52.992359 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-63d8d899-7313-4e35-966d-d8daf447c080 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'db5a248f2e54452ebcd188ad524153d0'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:42:53.006162 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-63d8d899-7313-4e35-966d-d8daf447c080 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'db5a248f2e54452ebcd188ad524153d0'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:42:53.013337 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-63d8d899-7313-4e35-966d-d8daf447c080 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'db5a248f2e54452ebcd188ad524153d0'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:42:53.031066 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1028/2077] 10.222.0.67 () {58 vars in 1223 bytes} [Wed May 25 14:42:52 2022] DELETE /identity/v3/users/db5a248f2e54452ebcd188ad524153d0 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:42:53.036282 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba3d1e8-8841-47f7-a634-c6615d19353d None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:53.036650 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba3d1e8-8841-47f7-a634-c6615d19353d None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:53.036999 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba3d1e8-8841-47f7-a634-c6615d19353d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:53.058683 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-0ba3d1e8-8841-47f7-a634-c6615d19353d None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:42:53.060352 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-0ba3d1e8-8841-47f7-a634-c6615d19353d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:42:53.143138 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1050/2078] 10.222.0.67 () {58 vars in 957 bytes} [Wed May 25 14:42:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:42:53.149768 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d8d899-7313-4e35-966d-d8daf447c080 admin admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:53.153522 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-63d8d899-7313-4e35-966d-d8daf447c080 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:42:53.234802 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d8d899-7313-4e35-966d-d8daf447c080 admin admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:53.239234 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b31022-c66d-497b-ab76-058cb4eebc6c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b68eed985c7b49839bcdd173186ad4ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfe93ee8d32a441295efc0b885de4bd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:53.239920 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b31022-c66d-497b-ab76-058cb4eebc6c service neutron] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:53.240206 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b31022-c66d-497b-ab76-058cb4eebc6c service neutron] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:53.240488 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b31022-c66d-497b-ab76-058cb4eebc6c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:53.250590 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b31022-c66d-497b-ab76-058cb4eebc6c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:53.252800 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b31022-c66d-497b-ab76-058cb4eebc6c service neutron] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:53.263681 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1029/2079] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 14:42:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:42:53.558012 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba3d1e8-8841-47f7-a634-c6615d19353d None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:53.559717 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-0ba3d1e8-8841-47f7-a634-c6615d19353d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:42:53.575408 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba3d1e8-8841-47f7-a634-c6615d19353d None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:53.580798 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80a8bc0-cfb8-4692-a588-363e9c696e2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:53.581671 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80a8bc0-cfb8-4692-a588-363e9c696e2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:53.581960 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80a8bc0-cfb8-4692-a588-363e9c696e2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:53.582238 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80a8bc0-cfb8-4692-a588-363e9c696e2a admin admin] PATH_INFO: `/v3/projects/48a020448dc5468ab51f56fad68b3e73` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:53.583631 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80a8bc0-cfb8-4692-a588-363e9c696e2a admin admin] RBAC: Authorizing `identity:delete_project(project_id=48a020448dc5468ab51f56fad68b3e73)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:53.585765 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80a8bc0-cfb8-4692-a588-363e9c696e2a admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:53.622752 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=96,keystone:INSERT=2,keystone:DELETE=2 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:53.645485 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-b80a8bc0-cfb8-4692-a588-363e9c696e2a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '48a020448dc5468ab51f56fad68b3e73', 'request_id': 'req-b80a8bc0-cfb8-4692-a588-363e9c696e2a'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:42:53.653280 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-b80a8bc0-cfb8-4692-a588-363e9c696e2a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '48a020448dc5468ab51f56fad68b3e73', 'request_id': 'req-b80a8bc0-cfb8-4692-a588-363e9c696e2a'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:42:53.666399 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-b80a8bc0-cfb8-4692-a588-363e9c696e2a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '48a020448dc5468ab51f56fad68b3e73', 'request_id': 'req-b80a8bc0-cfb8-4692-a588-363e9c696e2a'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:42:53.682461 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-b80a8bc0-cfb8-4692-a588-363e9c696e2a admin admin] The token cache is being invalidate because project 48a020448dc5468ab51f56fad68b3e73 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80475) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 14:42:53.683396 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-b80a8bc0-cfb8-4692-a588-363e9c696e2a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:42:53.684314 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-b80a8bc0-cfb8-4692-a588-363e9c696e2a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:42:53.685941 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1051/2080] 10.222.0.67 () {58 vars in 1232 bytes} [Wed May 25 14:42:53 2022] DELETE /identity/v3/projects/48a020448dc5468ab51f56fad68b3e73 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:42:58.057171 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b31022-c66d-497b-ab76-058cb4eebc6c service neutron] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:58.059219 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-43b31022-c66d-497b-ab76-058cb4eebc6c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:42:58.072433 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b31022-c66d-497b-ab76-058cb4eebc6c service neutron] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:58.081977 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:58.131146 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fdb1cd-39e2-4488-93e8-47781b524aa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:58.132273 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fdb1cd-39e2-4488-93e8-47781b524aa5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:58.132559 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fdb1cd-39e2-4488-93e8-47781b524aa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:58.132847 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fdb1cd-39e2-4488-93e8-47781b524aa5 admin admin] PATH_INFO: `/v3/users/3d6ff094535147ccaa65d145d35e7c51` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:58.134040 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fdb1cd-39e2-4488-93e8-47781b524aa5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3d6ff094535147ccaa65d145d35e7c51)` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:58.136015 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fdb1cd-39e2-4488-93e8-47781b524aa5 admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:58.186711 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-57fdb1cd-39e2-4488-93e8-47781b524aa5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3d6ff094535147ccaa65d145d35e7c51'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:42:58.187381 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-57fdb1cd-39e2-4488-93e8-47781b524aa5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3d6ff094535147ccaa65d145d35e7c51'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:42:58.188007 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-57fdb1cd-39e2-4488-93e8-47781b524aa5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3d6ff094535147ccaa65d145d35e7c51'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:42:58.200411 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-57fdb1cd-39e2-4488-93e8-47781b524aa5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3d6ff094535147ccaa65d145d35e7c51'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:42:58.208178 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-57fdb1cd-39e2-4488-93e8-47781b524aa5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3d6ff094535147ccaa65d145d35e7c51'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:42:58.222901 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1030/2081] 10.222.0.67 () {58 vars in 1223 bytes} [Wed May 25 14:42:58 2022] DELETE /identity/v3/users/3d6ff094535147ccaa65d145d35e7c51 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:42:58.229463 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f42a12-f800-4553-bdbc-3af3116100f1 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:58.229947 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f42a12-f800-4553-bdbc-3af3116100f1 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:58.230120 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f42a12-f800-4553-bdbc-3af3116100f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:58.253440 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-77f42a12-f800-4553-bdbc-3af3116100f1 None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:42:58.254695 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-77f42a12-f800-4553-bdbc-3af3116100f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:42:58.321829 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1052/2082] 10.222.0.67 () {58 vars in 957 bytes} [Wed May 25 14:42:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:42:58.332727 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fdb1cd-39e2-4488-93e8-47781b524aa5 admin admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:58.334382 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-57fdb1cd-39e2-4488-93e8-47781b524aa5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:42:58.394791 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fdb1cd-39e2-4488-93e8-47781b524aa5 admin admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:58.399001 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deeb5b73-2226-476c-a7bc-025e603430dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b68eed985c7b49839bcdd173186ad4ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfe93ee8d32a441295efc0b885de4bd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:58.399686 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deeb5b73-2226-476c-a7bc-025e603430dd service neutron] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:58.400155 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deeb5b73-2226-476c-a7bc-025e603430dd service neutron] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:58.400437 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deeb5b73-2226-476c-a7bc-025e603430dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:58.411419 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deeb5b73-2226-476c-a7bc-025e603430dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:58.413097 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deeb5b73-2226-476c-a7bc-025e603430dd service neutron] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:58.424062 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1031/2083] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 14:42:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:42:58.713457 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f42a12-f800-4553-bdbc-3af3116100f1 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:58.714908 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-77f42a12-f800-4553-bdbc-3af3116100f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:42:58.736496 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f42a12-f800-4553-bdbc-3af3116100f1 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:58.744476 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db941168-2f73-4978-b800-17c505d02eb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:58.745874 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db941168-2f73-4978-b800-17c505d02eb8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:58.746171 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db941168-2f73-4978-b800-17c505d02eb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:58.746451 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db941168-2f73-4978-b800-17c505d02eb8 admin admin] PATH_INFO: `/v3/projects/b7d16d016929436ab480d8781c22388f` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:58.747997 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db941168-2f73-4978-b800-17c505d02eb8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b7d16d016929436ab480d8781c22388f)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:58.753453 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db941168-2f73-4978-b800-17c505d02eb8 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:58.823676 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-db941168-2f73-4978-b800-17c505d02eb8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b7d16d016929436ab480d8781c22388f', 'request_id': 'req-db941168-2f73-4978-b800-17c505d02eb8'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:42:58.829138 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-db941168-2f73-4978-b800-17c505d02eb8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b7d16d016929436ab480d8781c22388f', 'request_id': 'req-db941168-2f73-4978-b800-17c505d02eb8'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:42:58.835875 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-db941168-2f73-4978-b800-17c505d02eb8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b7d16d016929436ab480d8781c22388f', 'request_id': 'req-db941168-2f73-4978-b800-17c505d02eb8'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:42:58.848758 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-db941168-2f73-4978-b800-17c505d02eb8 admin admin] The token cache is being invalidate because project b7d16d016929436ab480d8781c22388f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80475) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 14:42:58.849047 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-db941168-2f73-4978-b800-17c505d02eb8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:42:58.849653 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-db941168-2f73-4978-b800-17c505d02eb8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:42:58.851237 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1053/2084] 10.222.0.67 () {58 vars in 1232 bytes} [Wed May 25 14:42:58 2022] DELETE /identity/v3/projects/b7d16d016929436ab480d8781c22388f => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:42:58.856291 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d6999b-3776-447e-9bdf-7d789b946b31 None None] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:58.856589 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d6999b-3776-447e-9bdf-7d789b946b31 None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:58.856918 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d6999b-3776-447e-9bdf-7d789b946b31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:58.876236 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.auth.core [None req-50d6999b-3776-447e-9bdf-7d789b946b31 None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:42:58.877599 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-50d6999b-3776-447e-9bdf-7d789b946b31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:42:58.909147 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:58.943094 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1032/2085] 10.222.0.67 () {58 vars in 957 bytes} [Wed May 25 14:42:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:42:58.951137 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ed35b5-a23e-4d09-b733-7b45636f9435 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:58.951429 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ed35b5-a23e-4d09-b733-7b45636f9435 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:58.951711 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ed35b5-a23e-4d09-b733-7b45636f9435 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:58.969827 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-26ed35b5-a23e-4d09-b733-7b45636f9435 None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:42:58.971042 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-26ed35b5-a23e-4d09-b733-7b45636f9435 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:42:58.978886 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1054/2086] 10.222.0.67 () {58 vars in 957 bytes} [Wed May 25 14:42:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:42:58.983283 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d6999b-3776-447e-9bdf-7d789b946b31 None None] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:58.993910 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d6999b-3776-447e-9bdf-7d789b946b31 None None] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:58.998694 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b86136b-1710-4e87-8cd2-fc84f86b22e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:58.999388 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b86136b-1710-4e87-8cd2-fc84f86b22e9 admin admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:58.999679 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b86136b-1710-4e87-8cd2-fc84f86b22e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:58.999959 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b86136b-1710-4e87-8cd2-fc84f86b22e9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:59.001258 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b86136b-1710-4e87-8cd2-fc84f86b22e9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:42:59.001578 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b86136b-1710-4e87-8cd2-fc84f86b22e9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:59.003206 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b86136b-1710-4e87-8cd2-fc84f86b22e9 admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:59.015430 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1033/2087] 10.222.0.67 () {58 vars in 1152 bytes} [Wed May 25 14:42:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:42:59.020028 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ed35b5-a23e-4d09-b733-7b45636f9435 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:59.029421 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ed35b5-a23e-4d09-b733-7b45636f9435 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:59.034930 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afc55f5-5c59-4c20-bd79-78836c06daf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:59.035609 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afc55f5-5c59-4c20-bd79-78836c06daf0 admin admin] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:59.035895 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afc55f5-5c59-4c20-bd79-78836c06daf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:59.036198 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afc55f5-5c59-4c20-bd79-78836c06daf0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:59.036900 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afc55f5-5c59-4c20-bd79-78836c06daf0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:59.038786 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afc55f5-5c59-4c20-bd79-78836c06daf0 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:59.065336 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1055/2088] 10.222.0.67 () {60 vars in 1152 bytes} [Wed May 25 14:42:59 2022] POST /identity/v3/projects => generated 375 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:42:59.069688 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b86136b-1710-4e87-8cd2-fc84f86b22e9 admin admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:59.080726 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b86136b-1710-4e87-8cd2-fc84f86b22e9 admin admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:59.138385 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c581567-d592-4756-a75d-03257d98259b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:59.139085 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c581567-d592-4756-a75d-03257d98259b admin admin] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:59.139367 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c581567-d592-4756-a75d-03257d98259b admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:59.139644 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c581567-d592-4756-a75d-03257d98259b admin admin] PATH_INFO: `/v3/users` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:59.140336 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c581567-d592-4756-a75d-03257d98259b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:59.142310 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c581567-d592-4756-a75d-03257d98259b admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:59.162476 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1034/2089] 10.222.0.67 () {60 vars in 1143 bytes} [Wed May 25 14:42:59 2022] POST /identity/v3/users => generated 288 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 14:42:59.166803 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afc55f5-5c59-4c20-bd79-78836c06daf0 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:59.178623 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afc55f5-5c59-4c20-bd79-78836c06daf0 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:59.184861 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ffc75e-c9c6-4bc3-acc1-09dd52d173f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:59.185930 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ffc75e-c9c6-4bc3-acc1-09dd52d173f4 admin admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:59.186182 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ffc75e-c9c6-4bc3-acc1-09dd52d173f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:59.186490 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ffc75e-c9c6-4bc3-acc1-09dd52d173f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:59.187330 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ffc75e-c9c6-4bc3-acc1-09dd52d173f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:59.189530 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ffc75e-c9c6-4bc3-acc1-09dd52d173f4 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:59.201496 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1056/2090] 10.222.0.67 () {58 vars in 1121 bytes} [Wed May 25 14:42:59 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:42:59.205772 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c581567-d592-4756-a75d-03257d98259b admin admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:59.217506 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c581567-d592-4756-a75d-03257d98259b admin admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:59.224023 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add0db98-5417-48ee-8f58-ab2e54007ee0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:59.224807 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add0db98-5417-48ee-8f58-ab2e54007ee0 admin admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:59.225200 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add0db98-5417-48ee-8f58-ab2e54007ee0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:59.225563 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add0db98-5417-48ee-8f58-ab2e54007ee0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:59.226349 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add0db98-5417-48ee-8f58-ab2e54007ee0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:59.228106 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add0db98-5417-48ee-8f58-ab2e54007ee0 admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:59.239530 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1035/2091] 10.222.0.67 () {58 vars in 1121 bytes} [Wed May 25 14:42:59 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 25 14:42:59.243741 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ffc75e-c9c6-4bc3-acc1-09dd52d173f4 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:59.249521 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:59.256668 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ffc75e-c9c6-4bc3-acc1-09dd52d173f4 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:59.262412 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46a7526-47e1-4966-92b7-28342e481e5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:59.263343 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46a7526-47e1-4966-92b7-28342e481e5f admin admin] REQUEST_METHOD: `PUT` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:59.263623 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46a7526-47e1-4966-92b7-28342e481e5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:59.263900 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46a7526-47e1-4966-92b7-28342e481e5f admin admin] PATH_INFO: `/v3/projects/0c6c97438ddf484e80972750c6e05899/users/fddf70d1221742f4b532d54000b1ccdb/roles/48808901834b4d5eab2c7e6b5b03791e` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:59.280255 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46a7526-47e1-4966-92b7-28342e481e5f admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c6c97438ddf484e80972750c6e05899, user_id=fddf70d1221742f4b532d54000b1ccdb, role_id=48808901834b4d5eab2c7e6b5b03791e)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:59.283625 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46a7526-47e1-4966-92b7-28342e481e5f admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:59.298694 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1057/2092] 10.222.0.67 () {60 vars in 1482 bytes} [Wed May 25 14:42:59 2022] PUT /identity/v3/projects/0c6c97438ddf484e80972750c6e05899/users/fddf70d1221742f4b532d54000b1ccdb/roles/48808901834b4d5eab2c7e6b5b03791e => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:42:59.309167 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4073e791-5ed9-4730-916b-bf275d618e18 None None] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:59.309499 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4073e791-5ed9-4730-916b-bf275d618e18 None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:59.309739 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4073e791-5ed9-4730-916b-bf275d618e18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:59.336832 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.auth.core [None req-4073e791-5ed9-4730-916b-bf275d618e18 None None] MFA Rules not processed for user `fddf70d1221742f4b532d54000b1ccdb`. Rule list: `[]` (Enabled: `True`). {{(pid=80474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:42:59.338165 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-4073e791-5ed9-4730-916b-bf275d618e18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:42:59.389053 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46a7526-47e1-4966-92b7-28342e481e5f admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:59.396249 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-d46a7526-47e1-4966-92b7-28342e481e5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:42:59.430522 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1036/2093] 10.222.0.67 () {58 vars in 957 bytes} [Wed May 25 14:42:59 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:42:59.435445 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4073e791-5ed9-4730-916b-bf275d618e18 None None] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:59.484524 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:59.493581 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46a7526-47e1-4966-92b7-28342e481e5f admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:59.498451 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26b6b59-7335-4e7c-a7f2-ab90bb59ef6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:59.499352 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26b6b59-7335-4e7c-a7f2-ab90bb59ef6c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:59.499635 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26b6b59-7335-4e7c-a7f2-ab90bb59ef6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:59.499908 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26b6b59-7335-4e7c-a7f2-ab90bb59ef6c admin admin] PATH_INFO: `/v3/users/c03ca6f74c8d44a8812fba029e5c641c` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:59.501275 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26b6b59-7335-4e7c-a7f2-ab90bb59ef6c admin admin] RBAC: Authorizing `identity:delete_user(user_id=c03ca6f74c8d44a8812fba029e5c641c)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:59.503349 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26b6b59-7335-4e7c-a7f2-ab90bb59ef6c admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:59.517996 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4073e791-5ed9-4730-916b-bf275d618e18 None None] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:59.522856 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3759c0a9-2413-462a-84e8-6a78ebfa24da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:59.523552 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3759c0a9-2413-462a-84e8-6a78ebfa24da admin admin] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:59.523842 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3759c0a9-2413-462a-84e8-6a78ebfa24da admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:59.524126 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3759c0a9-2413-462a-84e8-6a78ebfa24da admin admin] PATH_INFO: `/v3/projects` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:59.524833 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3759c0a9-2413-462a-84e8-6a78ebfa24da admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:59.527020 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3759c0a9-2413-462a-84e8-6a78ebfa24da admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:59.553469 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-b26b6b59-7335-4e7c-a7f2-ab90bb59ef6c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c03ca6f74c8d44a8812fba029e5c641c'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:42:59.564906 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1037/2094] 10.222.0.67 () {60 vars in 1152 bytes} [Wed May 25 14:42:59 2022] POST /identity/v3/projects => generated 375 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 14:42:59.564906 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3759c0a9-2413-462a-84e8-6a78ebfa24da admin admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:59.565399 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-3759c0a9-2413-462a-84e8-6a78ebfa24da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:42:59.566303 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-b26b6b59-7335-4e7c-a7f2-ab90bb59ef6c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c03ca6f74c8d44a8812fba029e5c641c'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:42:59.566972 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-b26b6b59-7335-4e7c-a7f2-ab90bb59ef6c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c03ca6f74c8d44a8812fba029e5c641c'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:42:59.575315 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-b26b6b59-7335-4e7c-a7f2-ab90bb59ef6c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c03ca6f74c8d44a8812fba029e5c641c'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:42:59.588345 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-b26b6b59-7335-4e7c-a7f2-ab90bb59ef6c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c03ca6f74c8d44a8812fba029e5c641c'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:42:59.596106 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1058/2095] 10.222.0.67 () {58 vars in 1223 bytes} [Wed May 25 14:42:59 2022] DELETE /identity/v3/users/c03ca6f74c8d44a8812fba029e5c641c => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 14:42:59.599312 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26b6b59-7335-4e7c-a7f2-ab90bb59ef6c admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:59.599312 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-b26b6b59-7335-4e7c-a7f2-ab90bb59ef6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:42:59.632200 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3759c0a9-2413-462a-84e8-6a78ebfa24da admin admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:59.661825 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:59.667447 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26b6b59-7335-4e7c-a7f2-ab90bb59ef6c admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:59.674266 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9945230-2d02-4b70-8658-8476bce3ffb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:59.675210 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9945230-2d02-4b70-8658-8476bce3ffb7 admin admin] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:59.675519 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9945230-2d02-4b70-8658-8476bce3ffb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:59.675803 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9945230-2d02-4b70-8658-8476bce3ffb7 admin admin] PATH_INFO: `/v3/users` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:59.676506 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9945230-2d02-4b70-8658-8476bce3ffb7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:59.678444 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9945230-2d02-4b70-8658-8476bce3ffb7 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:59.688336 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8736c0-78cd-48f8-a273-315a198a6af1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e462acc9da84a61bb23998dd54e1858', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfe93ee8d32a441295efc0b885de4bd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:59.689082 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8736c0-78cd-48f8-a273-315a198a6af1 service cinder] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:59.689373 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8736c0-78cd-48f8-a273-315a198a6af1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:59.689653 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8736c0-78cd-48f8-a273-315a198a6af1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:59.691860 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-aa8736c0-78cd-48f8-a273-315a198a6af1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:42:59.699839 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1059/2096] 10.222.0.67 () {60 vars in 1143 bytes} [Wed May 25 14:42:59 2022] POST /identity/v3/users => generated 288 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:42:59.700697 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2008780c-5f0b-4356-b15f-dd9bd733866e None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:59.701058 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2008780c-5f0b-4356-b15f-dd9bd733866e None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:59.701275 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2008780c-5f0b-4356-b15f-dd9bd733866e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:59.719412 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-2008780c-5f0b-4356-b15f-dd9bd733866e None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:42:59.721138 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-2008780c-5f0b-4356-b15f-dd9bd733866e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:42:59.729520 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1060/2097] 10.222.0.67 () {58 vars in 957 bytes} [Wed May 25 14:42:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:42:59.732418 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2008780c-5f0b-4356-b15f-dd9bd733866e None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:59.741871 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2008780c-5f0b-4356-b15f-dd9bd733866e None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:59.747995 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513c837a-169f-4bca-a1f4-ffb62f5ab31f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:59.748832 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513c837a-169f-4bca-a1f4-ffb62f5ab31f admin admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:59.749120 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513c837a-169f-4bca-a1f4-ffb62f5ab31f admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:59.749402 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513c837a-169f-4bca-a1f4-ffb62f5ab31f admin admin] PATH_INFO: `/v3/roles` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:59.750139 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513c837a-169f-4bca-a1f4-ffb62f5ab31f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:59.752524 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513c837a-169f-4bca-a1f4-ffb62f5ab31f admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:59.763907 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1061/2098] 10.222.0.67 () {58 vars in 1121 bytes} [Wed May 25 14:42:59 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:42:59.768587 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513c837a-169f-4bca-a1f4-ffb62f5ab31f admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:59.770236 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-513c837a-169f-4bca-a1f4-ffb62f5ab31f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:42:59.773577 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8736c0-78cd-48f8-a273-315a198a6af1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:59.775088 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8736c0-78cd-48f8-a273-315a198a6af1 service cinder] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:59.788576 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1038/2099] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 14:42:59 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:42:59.789444 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8736c0-78cd-48f8-a273-315a198a6af1 service cinder] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:59.804021 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8736c0-78cd-48f8-a273-315a198a6af1 service cinder] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:59.809606 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed50aba-b29c-4a1e-aedd-c279e2ac1c83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:59.810336 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed50aba-b29c-4a1e-aedd-c279e2ac1c83 admin admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:59.810624 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed50aba-b29c-4a1e-aedd-c279e2ac1c83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:59.810899 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed50aba-b29c-4a1e-aedd-c279e2ac1c83 admin admin] PATH_INFO: `/v3/roles` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:59.811780 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed50aba-b29c-4a1e-aedd-c279e2ac1c83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:59.814225 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed50aba-b29c-4a1e-aedd-c279e2ac1c83 admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:59.827545 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1039/2100] 10.222.0.67 () {58 vars in 1121 bytes} [Wed May 25 14:42:59 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:42:59.846902 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed50aba-b29c-4a1e-aedd-c279e2ac1c83 admin admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:59.868803 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed50aba-b29c-4a1e-aedd-c279e2ac1c83 admin admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:59.869978 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513c837a-169f-4bca-a1f4-ffb62f5ab31f admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:59.877212 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c3a940-ce3b-4dd6-beb8-e3a108810d61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:59.877619 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c3a940-ce3b-4dd6-beb8-e3a108810d61 admin admin] REQUEST_METHOD: `PUT` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:59.877908 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c3a940-ce3b-4dd6-beb8-e3a108810d61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:59.878193 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c3a940-ce3b-4dd6-beb8-e3a108810d61 admin admin] PATH_INFO: `/v3/projects/04cd77002454493a932e9023746d5f2f/users/5cae755e99c04962a24bd34bcde1f485/roles/48808901834b4d5eab2c7e6b5b03791e` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:59.879467 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beabf375-4ee4-41a7-a0c9-524b3161faeb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b68eed985c7b49839bcdd173186ad4ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfe93ee8d32a441295efc0b885de4bd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:59.880158 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beabf375-4ee4-41a7-a0c9-524b3161faeb service neutron] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:59.881212 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beabf375-4ee4-41a7-a0c9-524b3161faeb service neutron] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:59.882028 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beabf375-4ee4-41a7-a0c9-524b3161faeb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:59.889553 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:59.897039 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beabf375-4ee4-41a7-a0c9-524b3161faeb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:59.898853 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beabf375-4ee4-41a7-a0c9-524b3161faeb service neutron] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:59.912391 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c3a940-ce3b-4dd6-beb8-e3a108810d61 admin admin] RBAC: Authorizing `identity:create_grant(project_id=04cd77002454493a932e9023746d5f2f, user_id=5cae755e99c04962a24bd34bcde1f485, role_id=48808901834b4d5eab2c7e6b5b03791e)` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:59.913050 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1062/2101] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 14:42:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:42:59.916325 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c3a940-ce3b-4dd6-beb8-e3a108810d61 admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:59.940677 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1040/2102] 10.222.0.67 () {60 vars in 1482 bytes} [Wed May 25 14:42:59 2022] PUT /identity/v3/projects/04cd77002454493a932e9023746d5f2f/users/5cae755e99c04962a24bd34bcde1f485/roles/48808901834b4d5eab2c7e6b5b03791e => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:42:59.952014 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136c175c-a07c-44a2-b85a-385c85a67f15 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:59.952561 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136c175c-a07c-44a2-b85a-385c85a67f15 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:59.952930 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136c175c-a07c-44a2-b85a-385c85a67f15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:59.983480 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-136c175c-a07c-44a2-b85a-385c85a67f15 None None] MFA Rules not processed for user `5cae755e99c04962a24bd34bcde1f485`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:42:59.984955 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-136c175c-a07c-44a2-b85a-385c85a67f15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:43:00.067529 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1063/2103] 10.222.0.67 () {58 vars in 957 bytes} [Wed May 25 14:42:59 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:43:00.072784 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c3a940-ce3b-4dd6-beb8-e3a108810d61 admin admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:00.167692 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c3a940-ce3b-4dd6-beb8-e3a108810d61 admin admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:00.175612 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48833d5d-3ee4-4339-b926-0b4404373b80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:00.176413 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48833d5d-3ee4-4339-b926-0b4404373b80 admin admin] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:00.176770 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48833d5d-3ee4-4339-b926-0b4404373b80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:00.177115 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48833d5d-3ee4-4339-b926-0b4404373b80 admin admin] PATH_INFO: `/v3/projects` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:00.177901 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48833d5d-3ee4-4339-b926-0b4404373b80 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:00.180031 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48833d5d-3ee4-4339-b926-0b4404373b80 admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:00.211397 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1041/2104] 10.222.0.67 () {60 vars in 1152 bytes} [Wed May 25 14:43:00 2022] POST /identity/v3/projects => generated 377 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:43:00.215715 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136c175c-a07c-44a2-b85a-385c85a67f15 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:00.232712 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136c175c-a07c-44a2-b85a-385c85a67f15 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:00.279413 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48833d5d-3ee4-4339-b926-0b4404373b80 admin admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:00.281333 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-48833d5d-3ee4-4339-b926-0b4404373b80 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:43:00.310565 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082bb910-de37-4f40-8574-a320dce03dde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:00.311243 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082bb910-de37-4f40-8574-a320dce03dde admin admin] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:00.311552 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082bb910-de37-4f40-8574-a320dce03dde admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:00.311801 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082bb910-de37-4f40-8574-a320dce03dde admin admin] PATH_INFO: `/v3/users` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:00.312555 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082bb910-de37-4f40-8574-a320dce03dde admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:00.316189 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082bb910-de37-4f40-8574-a320dce03dde admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:00.326456 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:00.344225 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1064/2105] 10.222.0.67 () {60 vars in 1143 bytes} [Wed May 25 14:43:00 2022] POST /identity/v3/users => generated 295 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:43:00.349980 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082bb910-de37-4f40-8574-a320dce03dde admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:00.363782 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082bb910-de37-4f40-8574-a320dce03dde admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:00.377572 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d93fd0e-9a05-421a-b593-17ee1ee7ee5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:00.378628 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d93fd0e-9a05-421a-b593-17ee1ee7ee5c admin admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:00.379181 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d93fd0e-9a05-421a-b593-17ee1ee7ee5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:00.379867 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d93fd0e-9a05-421a-b593-17ee1ee7ee5c admin admin] PATH_INFO: `/v3/roles` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:00.381231 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d93fd0e-9a05-421a-b593-17ee1ee7ee5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:00.384589 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d93fd0e-9a05-421a-b593-17ee1ee7ee5c admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:00.384711 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48833d5d-3ee4-4339-b926-0b4404373b80 admin admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:00.390823 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e7990b-8e0f-4114-ad74-8d92c0207f09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:00.392379 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e7990b-8e0f-4114-ad74-8d92c0207f09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:00.392788 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e7990b-8e0f-4114-ad74-8d92c0207f09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:00.393210 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e7990b-8e0f-4114-ad74-8d92c0207f09 admin admin] PATH_INFO: `/v3/projects/d6b081b8dcf645819f0586cf97896121` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:00.394858 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e7990b-8e0f-4114-ad74-8d92c0207f09 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d6b081b8dcf645819f0586cf97896121)` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:00.397586 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e7990b-8e0f-4114-ad74-8d92c0207f09 admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:00.398090 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1065/2106] 10.222.0.67 () {58 vars in 1121 bytes} [Wed May 25 14:43:00 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 25 14:43:00.402417 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d93fd0e-9a05-421a-b593-17ee1ee7ee5c admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:00.413508 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d93fd0e-9a05-421a-b593-17ee1ee7ee5c admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:00.419577 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6f1b50-198d-4f90-b1cc-22add1eeb9dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:00.423122 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6f1b50-198d-4f90-b1cc-22add1eeb9dc admin admin] REQUEST_METHOD: `PUT` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:00.423122 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6f1b50-198d-4f90-b1cc-22add1eeb9dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:00.423451 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6f1b50-198d-4f90-b1cc-22add1eeb9dc admin admin] PATH_INFO: `/v3/projects/b7dc96c6ce7649808f45a1f7cf5a0776/users/ccbf6271e9574a8585d322900eef8a3a/roles/399893e19eac4ab5a8e596f7c07be13c` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:00.455233 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6f1b50-198d-4f90-b1cc-22add1eeb9dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7dc96c6ce7649808f45a1f7cf5a0776, user_id=ccbf6271e9574a8585d322900eef8a3a, role_id=399893e19eac4ab5a8e596f7c07be13c)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:00.457984 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6f1b50-198d-4f90-b1cc-22add1eeb9dc admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:00.465824 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-67e7990b-8e0f-4114-ad74-8d92c0207f09 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd6b081b8dcf645819f0586cf97896121', 'request_id': 'req-67e7990b-8e0f-4114-ad74-8d92c0207f09'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:00.473293 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1066/2107] 10.222.0.67 () {60 vars in 1482 bytes} [Wed May 25 14:43:00 2022] PUT /identity/v3/projects/b7dc96c6ce7649808f45a1f7cf5a0776/users/ccbf6271e9574a8585d322900eef8a3a/roles/399893e19eac4ab5a8e596f7c07be13c => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 14:43:00.474873 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-67e7990b-8e0f-4114-ad74-8d92c0207f09 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd6b081b8dcf645819f0586cf97896121', 'request_id': 'req-67e7990b-8e0f-4114-ad74-8d92c0207f09'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:00.478162 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6f1b50-198d-4f90-b1cc-22add1eeb9dc admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:00.482695 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-67e7990b-8e0f-4114-ad74-8d92c0207f09 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd6b081b8dcf645819f0586cf97896121', 'request_id': 'req-67e7990b-8e0f-4114-ad74-8d92c0207f09'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:00.497704 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-67e7990b-8e0f-4114-ad74-8d92c0207f09 admin admin] The token cache is being invalidate because project d6b081b8dcf645819f0586cf97896121 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80474) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 14:43:00.498064 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-67e7990b-8e0f-4114-ad74-8d92c0207f09 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:00.498767 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-67e7990b-8e0f-4114-ad74-8d92c0207f09 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:00.500586 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1042/2108] 10.222.0.67 () {58 vars in 1232 bytes} [Wed May 25 14:43:00 2022] DELETE /identity/v3/projects/d6b081b8dcf645819f0586cf97896121 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:43:00.505578 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e7990b-8e0f-4114-ad74-8d92c0207f09 admin admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:00.507435 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-67e7990b-8e0f-4114-ad74-8d92c0207f09 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:43:00.513061 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:00.564084 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6f1b50-198d-4f90-b1cc-22add1eeb9dc admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:00.570218 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0770aff-4d3b-4f2a-890c-9dda22a9db13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:00.570905 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0770aff-4d3b-4f2a-890c-9dda22a9db13 admin admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:00.571298 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0770aff-4d3b-4f2a-890c-9dda22a9db13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:00.571578 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0770aff-4d3b-4f2a-890c-9dda22a9db13 admin admin] PATH_INFO: `/v3/roles` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:00.572497 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0770aff-4d3b-4f2a-890c-9dda22a9db13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:00.574117 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0770aff-4d3b-4f2a-890c-9dda22a9db13 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:00.586305 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e7990b-8e0f-4114-ad74-8d92c0207f09 admin admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:00.586822 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1067/2109] 10.222.0.67 () {58 vars in 1121 bytes} [Wed May 25 14:43:00 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 25 14:43:00.590779 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0770aff-4d3b-4f2a-890c-9dda22a9db13 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:00.593316 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-c0770aff-4d3b-4f2a-890c-9dda22a9db13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:43:00.596147 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590e9eb4-b585-45be-a4ec-e6cfb9cd9b1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:00.597284 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590e9eb4-b585-45be-a4ec-e6cfb9cd9b1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:00.597635 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590e9eb4-b585-45be-a4ec-e6cfb9cd9b1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:00.598156 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590e9eb4-b585-45be-a4ec-e6cfb9cd9b1b admin admin] PATH_INFO: `/v3/users/bdd07ea79dd7465fb2f67e532dbeeda7` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:00.599473 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590e9eb4-b585-45be-a4ec-e6cfb9cd9b1b admin admin] RBAC: Authorizing `identity:delete_user(user_id=bdd07ea79dd7465fb2f67e532dbeeda7)` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:00.601466 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590e9eb4-b585-45be-a4ec-e6cfb9cd9b1b admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:00.611913 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0770aff-4d3b-4f2a-890c-9dda22a9db13 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:00.621977 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbeaf43-5add-4b98-8ac8-ad08de4e9ee2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:00.623574 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbeaf43-5add-4b98-8ac8-ad08de4e9ee2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:00.623981 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbeaf43-5add-4b98-8ac8-ad08de4e9ee2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:00.624601 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbeaf43-5add-4b98-8ac8-ad08de4e9ee2 admin admin] PATH_INFO: `/v3/projects/b7dc96c6ce7649808f45a1f7cf5a0776/users/ccbf6271e9574a8585d322900eef8a3a/roles/399893e19eac4ab5a8e596f7c07be13c` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:00.627953 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbeaf43-5add-4b98-8ac8-ad08de4e9ee2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7dc96c6ce7649808f45a1f7cf5a0776, user_id=ccbf6271e9574a8585d322900eef8a3a, role_id=399893e19eac4ab5a8e596f7c07be13c)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:00.631046 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbeaf43-5add-4b98-8ac8-ad08de4e9ee2 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:00.647993 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1068/2110] 10.222.0.67 () {60 vars in 1482 bytes} [Wed May 25 14:43:00 2022] PUT /identity/v3/projects/b7dc96c6ce7649808f45a1f7cf5a0776/users/ccbf6271e9574a8585d322900eef8a3a/roles/399893e19eac4ab5a8e596f7c07be13c => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 14:43:00.667486 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bfd241-9862-460d-81d4-d5c0f6426762 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:00.667486 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bfd241-9862-460d-81d4-d5c0f6426762 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:00.667486 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bfd241-9862-460d-81d4-d5c0f6426762 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:00.677425 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-590e9eb4-b585-45be-a4ec-e6cfb9cd9b1b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bdd07ea79dd7465fb2f67e532dbeeda7'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:00.678707 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-590e9eb4-b585-45be-a4ec-e6cfb9cd9b1b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bdd07ea79dd7465fb2f67e532dbeeda7'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:00.679725 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-590e9eb4-b585-45be-a4ec-e6cfb9cd9b1b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bdd07ea79dd7465fb2f67e532dbeeda7'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:00.699630 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-590e9eb4-b585-45be-a4ec-e6cfb9cd9b1b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bdd07ea79dd7465fb2f67e532dbeeda7'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:00.702904 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-44bfd241-9862-460d-81d4-d5c0f6426762 None None] MFA Rules not processed for user `ccbf6271e9574a8585d322900eef8a3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:43:00.704500 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-44bfd241-9862-460d-81d4-d5c0f6426762 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:43:00.713238 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-590e9eb4-b585-45be-a4ec-e6cfb9cd9b1b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bdd07ea79dd7465fb2f67e532dbeeda7'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:00.734834 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1043/2111] 10.222.0.67 () {58 vars in 1223 bytes} [Wed May 25 14:43:00 2022] DELETE /identity/v3/users/bdd07ea79dd7465fb2f67e532dbeeda7 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:43:00.813740 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1069/2112] 10.222.0.67 () {58 vars in 957 bytes} [Wed May 25 14:43:00 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:43:00.829733 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590e9eb4-b585-45be-a4ec-e6cfb9cd9b1b admin admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:00.832323 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-590e9eb4-b585-45be-a4ec-e6cfb9cd9b1b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:43:00.929739 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590e9eb4-b585-45be-a4ec-e6cfb9cd9b1b admin admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:00.934258 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5262718-6b2c-4736-a160-a0b058582d36 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e462acc9da84a61bb23998dd54e1858', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfe93ee8d32a441295efc0b885de4bd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:00.934906 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5262718-6b2c-4736-a160-a0b058582d36 service cinder] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:00.935247 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5262718-6b2c-4736-a160-a0b058582d36 service cinder] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:00.935565 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5262718-6b2c-4736-a160-a0b058582d36 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:00.937759 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-e5262718-6b2c-4736-a160-a0b058582d36 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:43:00.999181 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:01.032949 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5262718-6b2c-4736-a160-a0b058582d36 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:01.034504 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5262718-6b2c-4736-a160-a0b058582d36 service cinder] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:01.045862 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1044/2113] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 14:43:00 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:43:01.183803 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bfd241-9862-460d-81d4-d5c0f6426762 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:01.185694 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-44bfd241-9862-460d-81d4-d5c0f6426762 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:43:01.267933 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:01.315362 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bfd241-9862-460d-81d4-d5c0f6426762 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:01.395801 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2343f5b0-beb3-4b6a-9a80-8e2b395cda43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:01.396917 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2343f5b0-beb3-4b6a-9a80-8e2b395cda43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:01.397216 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2343f5b0-beb3-4b6a-9a80-8e2b395cda43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:01.397501 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2343f5b0-beb3-4b6a-9a80-8e2b395cda43 admin admin] PATH_INFO: `/v3/projects/60eaf62ea64a4c1fbd5d231c53983f5b` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:01.400111 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2343f5b0-beb3-4b6a-9a80-8e2b395cda43 admin admin] RBAC: Authorizing `identity:delete_project(project_id=60eaf62ea64a4c1fbd5d231c53983f5b)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:01.402202 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2343f5b0-beb3-4b6a-9a80-8e2b395cda43 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:01.459362 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-2343f5b0-beb3-4b6a-9a80-8e2b395cda43 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '60eaf62ea64a4c1fbd5d231c53983f5b', 'request_id': 'req-2343f5b0-beb3-4b6a-9a80-8e2b395cda43'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:01.468814 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-2343f5b0-beb3-4b6a-9a80-8e2b395cda43 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '60eaf62ea64a4c1fbd5d231c53983f5b', 'request_id': 'req-2343f5b0-beb3-4b6a-9a80-8e2b395cda43'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:01.477326 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-2343f5b0-beb3-4b6a-9a80-8e2b395cda43 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '60eaf62ea64a4c1fbd5d231c53983f5b', 'request_id': 'req-2343f5b0-beb3-4b6a-9a80-8e2b395cda43'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:01.494475 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-2343f5b0-beb3-4b6a-9a80-8e2b395cda43 admin admin] The token cache is being invalidate because project 60eaf62ea64a4c1fbd5d231c53983f5b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80475) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 14:43:01.494862 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-2343f5b0-beb3-4b6a-9a80-8e2b395cda43 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:01.495730 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-2343f5b0-beb3-4b6a-9a80-8e2b395cda43 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:01.497873 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1070/2114] 10.222.0.67 () {58 vars in 1232 bytes} [Wed May 25 14:43:01 2022] DELETE /identity/v3/projects/60eaf62ea64a4c1fbd5d231c53983f5b => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:43:01.505494 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fddc953-4fdb-485c-b017-8a1d8960d333 None None] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:01.506558 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fddc953-4fdb-485c-b017-8a1d8960d333 None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:01.506558 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fddc953-4fdb-485c-b017-8a1d8960d333 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:01.526830 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.auth.core [None req-7fddc953-4fdb-485c-b017-8a1d8960d333 None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:43:01.528144 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-7fddc953-4fdb-485c-b017-8a1d8960d333 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:43:01.615024 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1045/2115] 10.222.0.67 () {58 vars in 957 bytes} [Wed May 25 14:43:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:43:01.624161 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea065c13-25ba-4c8a-a2a6-e276112da34c None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:01.624569 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea065c13-25ba-4c8a-a2a6-e276112da34c None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:01.624960 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea065c13-25ba-4c8a-a2a6-e276112da34c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:01.654463 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-ea065c13-25ba-4c8a-a2a6-e276112da34c None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:43:01.655944 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-ea065c13-25ba-4c8a-a2a6-e276112da34c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:43:01.666561 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1071/2116] 10.222.0.67 () {58 vars in 957 bytes} [Wed May 25 14:43:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:43:01.671283 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fddc953-4fdb-485c-b017-8a1d8960d333 None None] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:01.686163 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fddc953-4fdb-485c-b017-8a1d8960d333 None None] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:01.694045 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4e3f3c-7c46-4542-841e-66bfa759bc57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:01.694741 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4e3f3c-7c46-4542-841e-66bfa759bc57 admin admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:01.695414 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4e3f3c-7c46-4542-841e-66bfa759bc57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:01.695698 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4e3f3c-7c46-4542-841e-66bfa759bc57 admin admin] PATH_INFO: `/v3/domains` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:01.696720 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4e3f3c-7c46-4542-841e-66bfa759bc57 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:43:01.697321 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4e3f3c-7c46-4542-841e-66bfa759bc57 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:01.699612 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4e3f3c-7c46-4542-841e-66bfa759bc57 admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:01.716429 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1046/2117] 10.222.0.67 () {58 vars in 1152 bytes} [Wed May 25 14:43:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:43:01.726044 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea065c13-25ba-4c8a-a2a6-e276112da34c None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:01.736568 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea065c13-25ba-4c8a-a2a6-e276112da34c None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:01.741677 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe2c986-93ec-445a-88cb-8d4cc4774f8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:01.742369 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe2c986-93ec-445a-88cb-8d4cc4774f8e admin admin] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:01.742653 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe2c986-93ec-445a-88cb-8d4cc4774f8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:01.742932 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe2c986-93ec-445a-88cb-8d4cc4774f8e admin admin] PATH_INFO: `/v3/projects` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:01.743683 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe2c986-93ec-445a-88cb-8d4cc4774f8e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:01.745708 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe2c986-93ec-445a-88cb-8d4cc4774f8e admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:01.775696 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1072/2118] 10.222.0.67 () {60 vars in 1152 bytes} [Wed May 25 14:43:01 2022] POST /identity/v3/projects => generated 387 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:43:01.780216 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4e3f3c-7c46-4542-841e-66bfa759bc57 admin admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:01.792472 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4e3f3c-7c46-4542-841e-66bfa759bc57 admin admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:01.874471 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c311a626-110a-4678-9948-1c2166d81ca9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:01.875217 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c311a626-110a-4678-9948-1c2166d81ca9 admin admin] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:01.875547 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c311a626-110a-4678-9948-1c2166d81ca9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:01.876334 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c311a626-110a-4678-9948-1c2166d81ca9 admin admin] PATH_INFO: `/v3/users` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:01.876937 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c311a626-110a-4678-9948-1c2166d81ca9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:01.878954 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c311a626-110a-4678-9948-1c2166d81ca9 admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:01.902561 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1047/2119] 10.222.0.67 () {60 vars in 1143 bytes} [Wed May 25 14:43:01 2022] POST /identity/v3/users => generated 294 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 14:43:01.906248 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe2c986-93ec-445a-88cb-8d4cc4774f8e admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:01.918012 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe2c986-93ec-445a-88cb-8d4cc4774f8e admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:01.924097 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6878f86c-1857-4285-bc65-4e2563768e3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:01.924097 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6878f86c-1857-4285-bc65-4e2563768e3d admin admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:01.924358 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6878f86c-1857-4285-bc65-4e2563768e3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:01.924594 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6878f86c-1857-4285-bc65-4e2563768e3d admin admin] PATH_INFO: `/v3/roles` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:01.925336 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6878f86c-1857-4285-bc65-4e2563768e3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:01.926962 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6878f86c-1857-4285-bc65-4e2563768e3d admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:01.942570 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1073/2120] 10.222.0.67 () {58 vars in 1121 bytes} [Wed May 25 14:43:01 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:43:01.947105 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c311a626-110a-4678-9948-1c2166d81ca9 admin admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:01.963051 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c311a626-110a-4678-9948-1c2166d81ca9 admin admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:01.971115 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5673be07-3754-40fc-8a2f-b8267eafb506 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:01.971848 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5673be07-3754-40fc-8a2f-b8267eafb506 admin admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:01.972274 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5673be07-3754-40fc-8a2f-b8267eafb506 admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:01.972511 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5673be07-3754-40fc-8a2f-b8267eafb506 admin admin] PATH_INFO: `/v3/roles` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:01.973358 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5673be07-3754-40fc-8a2f-b8267eafb506 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:01.975527 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5673be07-3754-40fc-8a2f-b8267eafb506 admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:01.996862 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1048/2121] 10.222.0.67 () {58 vars in 1121 bytes} [Wed May 25 14:43:01 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:43:02.002896 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6878f86c-1857-4285-bc65-4e2563768e3d admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:02.019351 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6878f86c-1857-4285-bc65-4e2563768e3d admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:02.024187 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b887bd9-a0b6-44dc-9a83-c6e4f12c2cde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:02.025121 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b887bd9-a0b6-44dc-9a83-c6e4f12c2cde admin admin] REQUEST_METHOD: `PUT` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:02.025398 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b887bd9-a0b6-44dc-9a83-c6e4f12c2cde admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:02.025678 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b887bd9-a0b6-44dc-9a83-c6e4f12c2cde admin admin] PATH_INFO: `/v3/projects/d74f1b3dc98741ed9f026924f8ab4ef5/users/555ed4975f0e47ad8185956267743169/roles/48808901834b4d5eab2c7e6b5b03791e` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:02.049374 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b887bd9-a0b6-44dc-9a83-c6e4f12c2cde admin admin] RBAC: Authorizing `identity:create_grant(project_id=d74f1b3dc98741ed9f026924f8ab4ef5, user_id=555ed4975f0e47ad8185956267743169, role_id=48808901834b4d5eab2c7e6b5b03791e)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:02.052385 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b887bd9-a0b6-44dc-9a83-c6e4f12c2cde admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:02.063796 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:02.074106 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1074/2122] 10.222.0.67 () {60 vars in 1482 bytes} [Wed May 25 14:43:02 2022] PUT /identity/v3/projects/d74f1b3dc98741ed9f026924f8ab4ef5/users/555ed4975f0e47ad8185956267743169/roles/48808901834b4d5eab2c7e6b5b03791e => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:43:02.087154 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a48bc9e-64c4-475d-8d5b-0e335f53f0ea None None] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:02.087452 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a48bc9e-64c4-475d-8d5b-0e335f53f0ea None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:02.087738 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a48bc9e-64c4-475d-8d5b-0e335f53f0ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:02.121717 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.auth.core [None req-2a48bc9e-64c4-475d-8d5b-0e335f53f0ea None None] MFA Rules not processed for user `555ed4975f0e47ad8185956267743169`. Rule list: `[]` (Enabled: `True`). {{(pid=80474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:43:02.122941 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-2a48bc9e-64c4-475d-8d5b-0e335f53f0ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:43:02.169674 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:02.211925 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1049/2123] 10.222.0.67 () {58 vars in 957 bytes} [Wed May 25 14:43:02 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:43:02.216401 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b887bd9-a0b6-44dc-9a83-c6e4f12c2cde admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:02.307018 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b887bd9-a0b6-44dc-9a83-c6e4f12c2cde admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:02.315500 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49894b9b-d9fe-4ac7-846e-02b8495bc03c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:02.316437 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49894b9b-d9fe-4ac7-846e-02b8495bc03c admin admin] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:02.316680 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49894b9b-d9fe-4ac7-846e-02b8495bc03c admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:02.317171 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49894b9b-d9fe-4ac7-846e-02b8495bc03c admin admin] PATH_INFO: `/v3/projects` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:02.318416 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49894b9b-d9fe-4ac7-846e-02b8495bc03c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:02.321056 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49894b9b-d9fe-4ac7-846e-02b8495bc03c admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:02.364116 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1075/2124] 10.222.0.67 () {60 vars in 1152 bytes} [Wed May 25 14:43:02 2022] POST /identity/v3/projects => generated 385 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 14:43:02.373885 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a48bc9e-64c4-475d-8d5b-0e335f53f0ea None None] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:02.391818 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a48bc9e-64c4-475d-8d5b-0e335f53f0ea None None] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:02.490638 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31da8e27-2def-4585-bb8d-2df5efcca41e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:02.490918 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31da8e27-2def-4585-bb8d-2df5efcca41e admin admin] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:02.491230 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31da8e27-2def-4585-bb8d-2df5efcca41e admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:02.491766 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31da8e27-2def-4585-bb8d-2df5efcca41e admin admin] PATH_INFO: `/v3/users` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:02.492440 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31da8e27-2def-4585-bb8d-2df5efcca41e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:02.494412 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31da8e27-2def-4585-bb8d-2df5efcca41e admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:02.527549 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1050/2125] 10.222.0.67 () {60 vars in 1143 bytes} [Wed May 25 14:43:02 2022] POST /identity/v3/users => generated 299 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:43:02.532190 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49894b9b-d9fe-4ac7-846e-02b8495bc03c admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:02.553386 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49894b9b-d9fe-4ac7-846e-02b8495bc03c admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:02.561787 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3fb0b6-3956-4c4d-b2bb-5c36a25792b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:02.565221 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3fb0b6-3956-4c4d-b2bb-5c36a25792b4 admin admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:02.565722 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3fb0b6-3956-4c4d-b2bb-5c36a25792b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:02.566201 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3fb0b6-3956-4c4d-b2bb-5c36a25792b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:02.567604 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3fb0b6-3956-4c4d-b2bb-5c36a25792b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:02.570533 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3fb0b6-3956-4c4d-b2bb-5c36a25792b4 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:02.600671 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1076/2126] 10.222.0.67 () {58 vars in 1121 bytes} [Wed May 25 14:43:02 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:43:02.602607 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31da8e27-2def-4585-bb8d-2df5efcca41e admin admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:02.617620 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31da8e27-2def-4585-bb8d-2df5efcca41e admin admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:02.623542 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fd40fb-1307-45e4-8c65-3f9973629119 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:02.624682 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fd40fb-1307-45e4-8c65-3f9973629119 admin admin] REQUEST_METHOD: `PUT` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:02.624986 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fd40fb-1307-45e4-8c65-3f9973629119 admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:02.625238 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fd40fb-1307-45e4-8c65-3f9973629119 admin admin] PATH_INFO: `/v3/projects/c57b47aa6612437a95810fd45d2f39e2/users/be194f227ca84cb0abeaa128c305e6ef/roles/399893e19eac4ab5a8e596f7c07be13c` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:02.646508 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fd40fb-1307-45e4-8c65-3f9973629119 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c57b47aa6612437a95810fd45d2f39e2, user_id=be194f227ca84cb0abeaa128c305e6ef, role_id=399893e19eac4ab5a8e596f7c07be13c)` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:02.649356 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fd40fb-1307-45e4-8c65-3f9973629119 admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:02.677176 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1051/2127] 10.222.0.67 () {60 vars in 1482 bytes} [Wed May 25 14:43:02 2022] PUT /identity/v3/projects/c57b47aa6612437a95810fd45d2f39e2/users/be194f227ca84cb0abeaa128c305e6ef/roles/399893e19eac4ab5a8e596f7c07be13c => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:43:02.681202 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3fb0b6-3956-4c4d-b2bb-5c36a25792b4 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:02.702282 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3fb0b6-3956-4c4d-b2bb-5c36a25792b4 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:02.795975 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bfb706-a645-4b53-b3c7-32753d8b891b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:02.796694 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bfb706-a645-4b53-b3c7-32753d8b891b admin admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:02.803098 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bfb706-a645-4b53-b3c7-32753d8b891b admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:02.803098 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bfb706-a645-4b53-b3c7-32753d8b891b admin admin] PATH_INFO: `/v3/roles` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:02.803098 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5bfb706-a645-4b53-b3c7-32753d8b891b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:02.803098 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5bfb706-a645-4b53-b3c7-32753d8b891b admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:02.819035 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1077/2128] 10.222.0.67 () {58 vars in 1121 bytes} [Wed May 25 14:43:02 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:43:02.831130 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fd40fb-1307-45e4-8c65-3f9973629119 admin admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:02.837689 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fd40fb-1307-45e4-8c65-3f9973629119 admin admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:02.849152 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331a10c2-c45e-4916-9aca-51a608247d47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:02.850301 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331a10c2-c45e-4916-9aca-51a608247d47 admin admin] REQUEST_METHOD: `PUT` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:02.850674 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331a10c2-c45e-4916-9aca-51a608247d47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:02.850960 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331a10c2-c45e-4916-9aca-51a608247d47 admin admin] PATH_INFO: `/v3/projects/c57b47aa6612437a95810fd45d2f39e2/users/be194f227ca84cb0abeaa128c305e6ef/roles/399893e19eac4ab5a8e596f7c07be13c` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:02.852319 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bfb706-a645-4b53-b3c7-32753d8b891b admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:02.853288 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331a10c2-c45e-4916-9aca-51a608247d47 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c57b47aa6612437a95810fd45d2f39e2, user_id=be194f227ca84cb0abeaa128c305e6ef, role_id=399893e19eac4ab5a8e596f7c07be13c)` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:02.854932 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-a5bfb706-a645-4b53-b3c7-32753d8b891b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:43:02.856183 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331a10c2-c45e-4916-9aca-51a608247d47 admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:02.870117 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1052/2129] 10.222.0.67 () {60 vars in 1482 bytes} [Wed May 25 14:43:02 2022] PUT /identity/v3/projects/c57b47aa6612437a95810fd45d2f39e2/users/be194f227ca84cb0abeaa128c305e6ef/roles/399893e19eac4ab5a8e596f7c07be13c => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:43:02.880032 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd9ff35-d7e1-4a08-bcc7-8537973edb82 None None] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:02.880353 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd9ff35-d7e1-4a08-bcc7-8537973edb82 None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:02.880642 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd9ff35-d7e1-4a08-bcc7-8537973edb82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:02.909829 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.auth.core [None req-9cd9ff35-d7e1-4a08-bcc7-8537973edb82 None None] MFA Rules not processed for user `be194f227ca84cb0abeaa128c305e6ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:43:02.911162 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-9cd9ff35-d7e1-4a08-bcc7-8537973edb82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:43:02.943419 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bfb706-a645-4b53-b3c7-32753d8b891b admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:02.971804 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:03.017877 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1053/2130] 10.222.0.67 () {58 vars in 957 bytes} [Wed May 25 14:43:02 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 14:43:03.025912 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e74eda2-b894-4776-8ad9-aa19a00b7bab service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e462acc9da84a61bb23998dd54e1858', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfe93ee8d32a441295efc0b885de4bd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:03.026856 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e74eda2-b894-4776-8ad9-aa19a00b7bab service cinder] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:03.027396 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e74eda2-b894-4776-8ad9-aa19a00b7bab service cinder] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:03.027744 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e74eda2-b894-4776-8ad9-aa19a00b7bab service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:03.030816 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-1e74eda2-b894-4776-8ad9-aa19a00b7bab service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:43:03.031559 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd9ff35-d7e1-4a08-bcc7-8537973edb82 None None] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:03.034808 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-9cd9ff35-d7e1-4a08-bcc7-8537973edb82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:43:03.052337 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd9ff35-d7e1-4a08-bcc7-8537973edb82 None None] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:03.056005 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6109a1-1cd6-4e27-bd62-f415e35fdfc3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e462acc9da84a61bb23998dd54e1858', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfe93ee8d32a441295efc0b885de4bd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:03.056662 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6109a1-1cd6-4e27-bd62-f415e35fdfc3 service cinder] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:03.056949 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6109a1-1cd6-4e27-bd62-f415e35fdfc3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:03.057236 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6109a1-1cd6-4e27-bd62-f415e35fdfc3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:03.067269 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:03.070271 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6109a1-1cd6-4e27-bd62-f415e35fdfc3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:03.071814 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6109a1-1cd6-4e27-bd62-f415e35fdfc3 service cinder] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:03.085824 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1054/2131] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 14:43:03 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 14:43:03.119562 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e74eda2-b894-4776-8ad9-aa19a00b7bab service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:03.121339 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e74eda2-b894-4776-8ad9-aa19a00b7bab service cinder] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:03.132656 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6109a1-1cd6-4e27-bd62-f415e35fdfc3 service cinder] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:03.135524 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1078/2132] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 14:43:02 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 14:43:03.221728 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6109a1-1cd6-4e27-bd62-f415e35fdfc3 service cinder] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:03.229639 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fce2014-d395-42d1-a59f-132e1c1ea675 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:03.231134 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fce2014-d395-42d1-a59f-132e1c1ea675 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:03.231995 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fce2014-d395-42d1-a59f-132e1c1ea675 admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:03.232516 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fce2014-d395-42d1-a59f-132e1c1ea675 admin admin] PATH_INFO: `/v3/users/555ed4975f0e47ad8185956267743169` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:03.235062 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fce2014-d395-42d1-a59f-132e1c1ea675 admin admin] RBAC: Authorizing `identity:delete_user(user_id=555ed4975f0e47ad8185956267743169)` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:03.238946 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fce2014-d395-42d1-a59f-132e1c1ea675 admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:03.315102 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-5fce2014-d395-42d1-a59f-132e1c1ea675 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '555ed4975f0e47ad8185956267743169'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:03.316963 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-5fce2014-d395-42d1-a59f-132e1c1ea675 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '555ed4975f0e47ad8185956267743169'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:03.318279 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-5fce2014-d395-42d1-a59f-132e1c1ea675 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '555ed4975f0e47ad8185956267743169'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:03.350527 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-5fce2014-d395-42d1-a59f-132e1c1ea675 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '555ed4975f0e47ad8185956267743169'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:03.367379 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-5fce2014-d395-42d1-a59f-132e1c1ea675 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '555ed4975f0e47ad8185956267743169'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:03.396526 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1055/2133] 10.222.0.67 () {58 vars in 1223 bytes} [Wed May 25 14:43:03 2022] DELETE /identity/v3/users/555ed4975f0e47ad8185956267743169 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:43:03.399328 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1ccdde-151d-475a-88a7-15850e75a32e None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:03.400105 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1ccdde-151d-475a-88a7-15850e75a32e None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:03.400105 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1ccdde-151d-475a-88a7-15850e75a32e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:03.421750 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-5e1ccdde-151d-475a-88a7-15850e75a32e None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:43:03.423209 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-5e1ccdde-151d-475a-88a7-15850e75a32e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:43:03.524502 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1079/2134] 10.222.0.67 () {58 vars in 957 bytes} [Wed May 25 14:43:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:43:03.535249 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fce2014-d395-42d1-a59f-132e1c1ea675 admin admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:03.537330 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-5fce2014-d395-42d1-a59f-132e1c1ea675 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:43:03.642500 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fce2014-d395-42d1-a59f-132e1c1ea675 admin admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:03.647260 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456a62e1-a08d-438b-8b39-d02168433306 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b68eed985c7b49839bcdd173186ad4ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfe93ee8d32a441295efc0b885de4bd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:03.647943 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456a62e1-a08d-438b-8b39-d02168433306 service neutron] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:03.648384 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456a62e1-a08d-438b-8b39-d02168433306 service neutron] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:03.648593 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456a62e1-a08d-438b-8b39-d02168433306 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:03.660834 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456a62e1-a08d-438b-8b39-d02168433306 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:03.667790 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456a62e1-a08d-438b-8b39-d02168433306 service neutron] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:03.682970 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1056/2135] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 14:43:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:43:03.997352 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1ccdde-151d-475a-88a7-15850e75a32e None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:03.999370 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-5e1ccdde-151d-475a-88a7-15850e75a32e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:43:04.076029 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456a62e1-a08d-438b-8b39-d02168433306 service neutron] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:04.077709 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-456a62e1-a08d-438b-8b39-d02168433306 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:43:04.086479 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1ccdde-151d-475a-88a7-15850e75a32e None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:04.093728 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3970e2f5-c6f0-409e-b6fb-776bcb3d4761 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e462acc9da84a61bb23998dd54e1858', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfe93ee8d32a441295efc0b885de4bd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:04.094711 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3970e2f5-c6f0-409e-b6fb-776bcb3d4761 service cinder] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:04.095086 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3970e2f5-c6f0-409e-b6fb-776bcb3d4761 service cinder] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:04.095371 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3970e2f5-c6f0-409e-b6fb-776bcb3d4761 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:04.103654 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-3970e2f5-c6f0-409e-b6fb-776bcb3d4761 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:43:04.119766 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456a62e1-a08d-438b-8b39-d02168433306 service neutron] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:04.124115 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953c5d8a-18a0-46c0-89ff-50325169f4fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:04.125271 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953c5d8a-18a0-46c0-89ff-50325169f4fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:04.126171 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953c5d8a-18a0-46c0-89ff-50325169f4fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:04.128132 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953c5d8a-18a0-46c0-89ff-50325169f4fd admin admin] PATH_INFO: `/v3/projects/d74f1b3dc98741ed9f026924f8ab4ef5` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:04.130165 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953c5d8a-18a0-46c0-89ff-50325169f4fd admin admin] RBAC: Authorizing `identity:delete_project(project_id=d74f1b3dc98741ed9f026924f8ab4ef5)` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:04.132995 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953c5d8a-18a0-46c0-89ff-50325169f4fd admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:04.161888 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:04.175618 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:04.219666 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-953c5d8a-18a0-46c0-89ff-50325169f4fd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd74f1b3dc98741ed9f026924f8ab4ef5', 'request_id': 'req-953c5d8a-18a0-46c0-89ff-50325169f4fd'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:04.231554 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3970e2f5-c6f0-409e-b6fb-776bcb3d4761 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:04.233544 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3970e2f5-c6f0-409e-b6fb-776bcb3d4761 service cinder] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:04.238212 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-953c5d8a-18a0-46c0-89ff-50325169f4fd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd74f1b3dc98741ed9f026924f8ab4ef5', 'request_id': 'req-953c5d8a-18a0-46c0-89ff-50325169f4fd'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:04.247060 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1080/2136] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 14:43:03 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:43:04.249185 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-953c5d8a-18a0-46c0-89ff-50325169f4fd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd74f1b3dc98741ed9f026924f8ab4ef5', 'request_id': 'req-953c5d8a-18a0-46c0-89ff-50325169f4fd'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:04.263176 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-953c5d8a-18a0-46c0-89ff-50325169f4fd admin admin] The token cache is being invalidate because project d74f1b3dc98741ed9f026924f8ab4ef5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80474) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 14:43:04.263176 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-953c5d8a-18a0-46c0-89ff-50325169f4fd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:04.263732 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-953c5d8a-18a0-46c0-89ff-50325169f4fd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:04.267134 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1057/2137] 10.222.0.67 () {58 vars in 1232 bytes} [Wed May 25 14:43:04 2022] DELETE /identity/v3/projects/d74f1b3dc98741ed9f026924f8ab4ef5 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:43:04.271061 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3970e2f5-c6f0-409e-b6fb-776bcb3d4761 service cinder] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:04.284284 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3970e2f5-c6f0-409e-b6fb-776bcb3d4761 service cinder] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:04.375267 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c2cb9b-c470-4425-ae6f-cf8881a95356 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:04.376465 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c2cb9b-c470-4425-ae6f-cf8881a95356 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:04.378005 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c2cb9b-c470-4425-ae6f-cf8881a95356 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:04.378294 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c2cb9b-c470-4425-ae6f-cf8881a95356 admin admin] PATH_INFO: `/v3/users/be194f227ca84cb0abeaa128c305e6ef` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:04.380009 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c2cb9b-c470-4425-ae6f-cf8881a95356 admin admin] RBAC: Authorizing `identity:delete_user(user_id=be194f227ca84cb0abeaa128c305e6ef)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:04.384596 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c2cb9b-c470-4425-ae6f-cf8881a95356 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:04.441793 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-d7c2cb9b-c470-4425-ae6f-cf8881a95356 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'be194f227ca84cb0abeaa128c305e6ef'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:04.449817 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-d7c2cb9b-c470-4425-ae6f-cf8881a95356 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'be194f227ca84cb0abeaa128c305e6ef'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:04.450526 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-d7c2cb9b-c470-4425-ae6f-cf8881a95356 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'be194f227ca84cb0abeaa128c305e6ef'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:04.457961 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-d7c2cb9b-c470-4425-ae6f-cf8881a95356 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'be194f227ca84cb0abeaa128c305e6ef'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:04.474614 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-d7c2cb9b-c470-4425-ae6f-cf8881a95356 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'be194f227ca84cb0abeaa128c305e6ef'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:04.481670 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1081/2138] 10.222.0.67 () {58 vars in 1223 bytes} [Wed May 25 14:43:04 2022] DELETE /identity/v3/users/be194f227ca84cb0abeaa128c305e6ef => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:43:04.889387 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953c5d8a-18a0-46c0-89ff-50325169f4fd admin admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:04.891629 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-953c5d8a-18a0-46c0-89ff-50325169f4fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:43:04.924109 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953c5d8a-18a0-46c0-89ff-50325169f4fd admin admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:04.987051 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3912a626-b3c4-433f-9c81-647e1d727968 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:04.987936 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3912a626-b3c4-433f-9c81-647e1d727968 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:04.988225 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3912a626-b3c4-433f-9c81-647e1d727968 admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:04.988504 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3912a626-b3c4-433f-9c81-647e1d727968 admin admin] PATH_INFO: `/v3/projects/c57b47aa6612437a95810fd45d2f39e2` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:04.989697 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3912a626-b3c4-433f-9c81-647e1d727968 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c57b47aa6612437a95810fd45d2f39e2)` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:04.991653 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3912a626-b3c4-433f-9c81-647e1d727968 admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:05.038481 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-3912a626-b3c4-433f-9c81-647e1d727968 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c57b47aa6612437a95810fd45d2f39e2', 'request_id': 'req-3912a626-b3c4-433f-9c81-647e1d727968'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:05.046135 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-3912a626-b3c4-433f-9c81-647e1d727968 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c57b47aa6612437a95810fd45d2f39e2', 'request_id': 'req-3912a626-b3c4-433f-9c81-647e1d727968'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:05.053902 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-3912a626-b3c4-433f-9c81-647e1d727968 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c57b47aa6612437a95810fd45d2f39e2', 'request_id': 'req-3912a626-b3c4-433f-9c81-647e1d727968'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:05.064820 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-3912a626-b3c4-433f-9c81-647e1d727968 admin admin] The token cache is being invalidate because project c57b47aa6612437a95810fd45d2f39e2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80474) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 14:43:05.065108 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-3912a626-b3c4-433f-9c81-647e1d727968 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:05.065759 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-3912a626-b3c4-433f-9c81-647e1d727968 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:05.067346 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1058/2139] 10.222.0.67 () {58 vars in 1232 bytes} [Wed May 25 14:43:04 2022] DELETE /identity/v3/projects/c57b47aa6612437a95810fd45d2f39e2 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:43:05.072349 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd11d3c-2f63-431a-afa1-8f99184fdb05 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:05.072642 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd11d3c-2f63-431a-afa1-8f99184fdb05 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:05.072926 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd11d3c-2f63-431a-afa1-8f99184fdb05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:05.093545 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-bdd11d3c-2f63-431a-afa1-8f99184fdb05 None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:43:05.095484 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-bdd11d3c-2f63-431a-afa1-8f99184fdb05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:43:05.153648 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:05.174021 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1082/2140] 10.222.0.67 () {58 vars in 957 bytes} [Wed May 25 14:43:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:43:05.181657 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab75d65-b7d9-4ab7-8a77-b0c17cac59fd None None] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:05.182024 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab75d65-b7d9-4ab7-8a77-b0c17cac59fd None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:05.182414 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab75d65-b7d9-4ab7-8a77-b0c17cac59fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:05.203665 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.auth.core [None req-2ab75d65-b7d9-4ab7-8a77-b0c17cac59fd None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:43:05.204936 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-2ab75d65-b7d9-4ab7-8a77-b0c17cac59fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:43:05.213385 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1059/2141] 10.222.0.67 () {58 vars in 957 bytes} [Wed May 25 14:43:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:43:05.217878 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd11d3c-2f63-431a-afa1-8f99184fdb05 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:05.228935 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd11d3c-2f63-431a-afa1-8f99184fdb05 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:05.234420 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17285aa8-4485-4556-88b2-0a605d8b4041 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:05.235838 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17285aa8-4485-4556-88b2-0a605d8b4041 admin admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:05.236130 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17285aa8-4485-4556-88b2-0a605d8b4041 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:05.236413 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17285aa8-4485-4556-88b2-0a605d8b4041 admin admin] PATH_INFO: `/v3/domains` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:05.237153 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17285aa8-4485-4556-88b2-0a605d8b4041 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:43:05.237470 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17285aa8-4485-4556-88b2-0a605d8b4041 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:05.239132 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17285aa8-4485-4556-88b2-0a605d8b4041 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:05.256704 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1083/2142] 10.222.0.67 () {58 vars in 1152 bytes} [Wed May 25 14:43:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:43:05.257840 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab75d65-b7d9-4ab7-8a77-b0c17cac59fd None None] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:05.271518 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab75d65-b7d9-4ab7-8a77-b0c17cac59fd None None] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:05.276978 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76e7d5e-362e-4f27-b273-4a640eda0247 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:05.277730 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76e7d5e-362e-4f27-b273-4a640eda0247 admin admin] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:05.278123 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76e7d5e-362e-4f27-b273-4a640eda0247 admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:05.278534 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76e7d5e-362e-4f27-b273-4a640eda0247 admin admin] PATH_INFO: `/v3/projects` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:05.279281 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76e7d5e-362e-4f27-b273-4a640eda0247 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:05.281270 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76e7d5e-362e-4f27-b273-4a640eda0247 admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:05.309742 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1060/2143] 10.222.0.67 () {60 vars in 1152 bytes} [Wed May 25 14:43:05 2022] POST /identity/v3/projects => generated 407 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:43:05.314547 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17285aa8-4485-4556-88b2-0a605d8b4041 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:05.326187 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17285aa8-4485-4556-88b2-0a605d8b4041 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:05.385958 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8083bd17-0737-4b4d-98be-9b5bbada4f15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:05.386633 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8083bd17-0737-4b4d-98be-9b5bbada4f15 admin admin] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:05.386921 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8083bd17-0737-4b4d-98be-9b5bbada4f15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:05.387233 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8083bd17-0737-4b4d-98be-9b5bbada4f15 admin admin] PATH_INFO: `/v3/users` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:05.387995 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8083bd17-0737-4b4d-98be-9b5bbada4f15 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:05.389985 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8083bd17-0737-4b4d-98be-9b5bbada4f15 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:05.419928 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1084/2144] 10.222.0.67 () {60 vars in 1143 bytes} [Wed May 25 14:43:05 2022] POST /identity/v3/users => generated 304 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:43:05.421608 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76e7d5e-362e-4f27-b273-4a640eda0247 admin admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:05.427937 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:05.452140 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76e7d5e-362e-4f27-b273-4a640eda0247 admin admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:05.458857 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f628355a-1512-447f-b48a-ad12862b7ca0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:05.459575 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f628355a-1512-447f-b48a-ad12862b7ca0 admin admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:05.459859 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f628355a-1512-447f-b48a-ad12862b7ca0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:05.460159 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f628355a-1512-447f-b48a-ad12862b7ca0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:05.460890 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f628355a-1512-447f-b48a-ad12862b7ca0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:05.462503 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f628355a-1512-447f-b48a-ad12862b7ca0 admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:05.474647 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1061/2145] 10.222.0.67 () {58 vars in 1121 bytes} [Wed May 25 14:43:05 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:43:05.478681 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8083bd17-0737-4b4d-98be-9b5bbada4f15 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:05.491181 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8083bd17-0737-4b4d-98be-9b5bbada4f15 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:05.495933 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959fefa0-99a4-496a-85d2-153fea65ec72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:05.496610 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959fefa0-99a4-496a-85d2-153fea65ec72 admin admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:05.496900 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959fefa0-99a4-496a-85d2-153fea65ec72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:05.497196 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959fefa0-99a4-496a-85d2-153fea65ec72 admin admin] PATH_INFO: `/v3/roles` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:05.498021 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959fefa0-99a4-496a-85d2-153fea65ec72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:05.500055 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959fefa0-99a4-496a-85d2-153fea65ec72 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:05.512923 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1085/2146] 10.222.0.67 () {58 vars in 1121 bytes} [Wed May 25 14:43:05 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:43:05.517658 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f628355a-1512-447f-b48a-ad12862b7ca0 admin admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:05.528198 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f628355a-1512-447f-b48a-ad12862b7ca0 admin admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:05.533892 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69b5521-0354-476b-98e1-2bd8d7529145 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:05.534812 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69b5521-0354-476b-98e1-2bd8d7529145 admin admin] REQUEST_METHOD: `PUT` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:05.535133 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69b5521-0354-476b-98e1-2bd8d7529145 admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:05.535420 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69b5521-0354-476b-98e1-2bd8d7529145 admin admin] PATH_INFO: `/v3/projects/1e95eda1d5194dc78dc8f06648e9cb34/users/24ddc0f88c5549178a89d871f2f650c8/roles/48808901834b4d5eab2c7e6b5b03791e` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:05.552919 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69b5521-0354-476b-98e1-2bd8d7529145 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e95eda1d5194dc78dc8f06648e9cb34, user_id=24ddc0f88c5549178a89d871f2f650c8, role_id=48808901834b4d5eab2c7e6b5b03791e)` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:05.555926 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69b5521-0354-476b-98e1-2bd8d7529145 admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:05.572124 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1062/2147] 10.222.0.67 () {60 vars in 1482 bytes} [Wed May 25 14:43:05 2022] PUT /identity/v3/projects/1e95eda1d5194dc78dc8f06648e9cb34/users/24ddc0f88c5549178a89d871f2f650c8/roles/48808901834b4d5eab2c7e6b5b03791e => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:43:05.584432 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1582185-027e-4e8d-bb35-38a5dc3f939b None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:05.584991 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1582185-027e-4e8d-bb35-38a5dc3f939b None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:05.585325 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1582185-027e-4e8d-bb35-38a5dc3f939b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:05.614697 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-b1582185-027e-4e8d-bb35-38a5dc3f939b None None] MFA Rules not processed for user `24ddc0f88c5549178a89d871f2f650c8`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:43:05.616020 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-b1582185-027e-4e8d-bb35-38a5dc3f939b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:43:05.712727 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1086/2148] 10.222.0.67 () {58 vars in 957 bytes} [Wed May 25 14:43:05 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:43:05.713807 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69b5521-0354-476b-98e1-2bd8d7529145 admin admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:05.798192 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69b5521-0354-476b-98e1-2bd8d7529145 admin admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:05.805999 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a275fc-bae1-473a-bc4f-b07fe8f82006 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:05.806291 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a275fc-bae1-473a-bc4f-b07fe8f82006 admin admin] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:05.806642 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a275fc-bae1-473a-bc4f-b07fe8f82006 admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:05.808774 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a275fc-bae1-473a-bc4f-b07fe8f82006 admin admin] PATH_INFO: `/v3/projects` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:05.808774 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a275fc-bae1-473a-bc4f-b07fe8f82006 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:05.810358 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a275fc-bae1-473a-bc4f-b07fe8f82006 admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:05.851121 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1063/2149] 10.222.0.67 () {60 vars in 1152 bytes} [Wed May 25 14:43:05 2022] POST /identity/v3/projects => generated 409 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 14:43:05.854616 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1582185-027e-4e8d-bb35-38a5dc3f939b None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:05.867783 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1582185-027e-4e8d-bb35-38a5dc3f939b None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:05.916267 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:05.933820 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4b4c91-4558-4373-8c83-0e32efe090a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:05.934494 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4b4c91-4558-4373-8c83-0e32efe090a2 admin admin] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:05.934807 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4b4c91-4558-4373-8c83-0e32efe090a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:05.935123 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4b4c91-4558-4373-8c83-0e32efe090a2 admin admin] PATH_INFO: `/v3/users` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:05.935832 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4b4c91-4558-4373-8c83-0e32efe090a2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:05.937760 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4b4c91-4558-4373-8c83-0e32efe090a2 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:05.958156 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1087/2150] 10.222.0.67 () {60 vars in 1143 bytes} [Wed May 25 14:43:05 2022] POST /identity/v3/users => generated 311 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:43:05.962149 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a275fc-bae1-473a-bc4f-b07fe8f82006 admin admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:05.973886 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a275fc-bae1-473a-bc4f-b07fe8f82006 admin admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:05.978543 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef4bc70-d8f4-4ead-816b-dcbcf78afbe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:05.979258 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef4bc70-d8f4-4ead-816b-dcbcf78afbe1 admin admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:05.979548 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef4bc70-d8f4-4ead-816b-dcbcf78afbe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:05.979832 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef4bc70-d8f4-4ead-816b-dcbcf78afbe1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:05.980573 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef4bc70-d8f4-4ead-816b-dcbcf78afbe1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:05.982181 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef4bc70-d8f4-4ead-816b-dcbcf78afbe1 admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:05.995246 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1064/2151] 10.222.0.67 () {58 vars in 1121 bytes} [Wed May 25 14:43:05 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:43:05.999682 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4b4c91-4558-4373-8c83-0e32efe090a2 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:06.010388 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4b4c91-4558-4373-8c83-0e32efe090a2 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:06.015589 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df43618-7a39-4df3-8f47-2139de6ae8b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:06.016735 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df43618-7a39-4df3-8f47-2139de6ae8b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:06.017012 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df43618-7a39-4df3-8f47-2139de6ae8b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:06.017288 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df43618-7a39-4df3-8f47-2139de6ae8b2 admin admin] PATH_INFO: `/v3/projects/6bd4a139626c4431848165c5028f7700/users/1fc229b399ca491a9916baa62c01840c/roles/399893e19eac4ab5a8e596f7c07be13c` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:06.033286 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df43618-7a39-4df3-8f47-2139de6ae8b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6bd4a139626c4431848165c5028f7700, user_id=1fc229b399ca491a9916baa62c01840c, role_id=399893e19eac4ab5a8e596f7c07be13c)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:06.035992 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df43618-7a39-4df3-8f47-2139de6ae8b2 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:06.053612 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1088/2152] 10.222.0.67 () {60 vars in 1482 bytes} [Wed May 25 14:43:05 2022] PUT /identity/v3/projects/6bd4a139626c4431848165c5028f7700/users/1fc229b399ca491a9916baa62c01840c/roles/399893e19eac4ab5a8e596f7c07be13c => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 14:43:06.057378 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef4bc70-d8f4-4ead-816b-dcbcf78afbe1 admin admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:06.068230 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef4bc70-d8f4-4ead-816b-dcbcf78afbe1 admin admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:06.139785 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d069241b-e0aa-415d-81b4-c215ae1fd10c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:06.140464 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d069241b-e0aa-415d-81b4-c215ae1fd10c admin admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:06.140752 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d069241b-e0aa-415d-81b4-c215ae1fd10c admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:06.141668 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d069241b-e0aa-415d-81b4-c215ae1fd10c admin admin] PATH_INFO: `/v3/roles` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:06.142424 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d069241b-e0aa-415d-81b4-c215ae1fd10c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:06.144525 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d069241b-e0aa-415d-81b4-c215ae1fd10c admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:06.166391 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1065/2153] 10.222.0.67 () {58 vars in 1121 bytes} [Wed May 25 14:43:06 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:43:06.170532 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df43618-7a39-4df3-8f47-2139de6ae8b2 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:06.181322 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df43618-7a39-4df3-8f47-2139de6ae8b2 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:06.187214 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f2ac5b-fbc8-4174-bed9-23d477c61f35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:06.188302 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f2ac5b-fbc8-4174-bed9-23d477c61f35 admin admin] REQUEST_METHOD: `PUT` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:06.188545 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f2ac5b-fbc8-4174-bed9-23d477c61f35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:06.188849 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f2ac5b-fbc8-4174-bed9-23d477c61f35 admin admin] PATH_INFO: `/v3/projects/6bd4a139626c4431848165c5028f7700/users/1fc229b399ca491a9916baa62c01840c/roles/399893e19eac4ab5a8e596f7c07be13c` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:06.190914 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f2ac5b-fbc8-4174-bed9-23d477c61f35 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6bd4a139626c4431848165c5028f7700, user_id=1fc229b399ca491a9916baa62c01840c, role_id=399893e19eac4ab5a8e596f7c07be13c)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:06.193859 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f2ac5b-fbc8-4174-bed9-23d477c61f35 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:06.205509 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1089/2154] 10.222.0.67 () {60 vars in 1482 bytes} [Wed May 25 14:43:06 2022] PUT /identity/v3/projects/6bd4a139626c4431848165c5028f7700/users/1fc229b399ca491a9916baa62c01840c/roles/399893e19eac4ab5a8e596f7c07be13c => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:43:06.216034 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4610d5-b7ee-42e0-92a8-a53140fc9d06 None None] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:06.216331 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4610d5-b7ee-42e0-92a8-a53140fc9d06 None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:06.216620 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4610d5-b7ee-42e0-92a8-a53140fc9d06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:06.245373 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.auth.core [None req-bb4610d5-b7ee-42e0-92a8-a53140fc9d06 None None] MFA Rules not processed for user `1fc229b399ca491a9916baa62c01840c`. Rule list: `[]` (Enabled: `True`). {{(pid=80474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:43:06.246612 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-bb4610d5-b7ee-42e0-92a8-a53140fc9d06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:43:06.274272 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:06.320706 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1066/2155] 10.222.0.67 () {58 vars in 957 bytes} [Wed May 25 14:43:06 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:43:06.332888 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f2ac5b-fbc8-4174-bed9-23d477c61f35 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:06.334286 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-93f2ac5b-fbc8-4174-bed9-23d477c61f35 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:43:06.398136 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f2ac5b-fbc8-4174-bed9-23d477c61f35 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:06.402406 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb0439a-d895-4961-8ea8-a3480a9d54f5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e462acc9da84a61bb23998dd54e1858', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfe93ee8d32a441295efc0b885de4bd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:06.403090 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb0439a-d895-4961-8ea8-a3480a9d54f5 service cinder] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:06.403382 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb0439a-d895-4961-8ea8-a3480a9d54f5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:06.403682 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb0439a-d895-4961-8ea8-a3480a9d54f5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:06.414764 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb0439a-d895-4961-8ea8-a3480a9d54f5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:06.416143 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb0439a-d895-4961-8ea8-a3480a9d54f5 service cinder] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:06.427758 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1090/2156] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 14:43:06 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:43:06.585751 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4610d5-b7ee-42e0-92a8-a53140fc9d06 None None] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:06.587203 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-bb4610d5-b7ee-42e0-92a8-a53140fc9d06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:43:06.599560 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4610d5-b7ee-42e0-92a8-a53140fc9d06 None None] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:06.603276 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf8414e-ef82-4d96-81ec-b76e6372016d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e462acc9da84a61bb23998dd54e1858', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfe93ee8d32a441295efc0b885de4bd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:06.603934 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf8414e-ef82-4d96-81ec-b76e6372016d service cinder] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:06.604223 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf8414e-ef82-4d96-81ec-b76e6372016d service cinder] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:06.604510 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf8414e-ef82-4d96-81ec-b76e6372016d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:06.665995 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf8414e-ef82-4d96-81ec-b76e6372016d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:06.667695 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf8414e-ef82-4d96-81ec-b76e6372016d service cinder] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:06.676969 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1067/2157] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 14:43:06 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:43:09.526297 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb0439a-d895-4961-8ea8-a3480a9d54f5 service cinder] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:09.528013 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-5fb0439a-d895-4961-8ea8-a3480a9d54f5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:43:09.630436 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb0439a-d895-4961-8ea8-a3480a9d54f5 service cinder] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:09.637858 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632757fa-bdf5-4c94-abad-cded4a48eb20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:09.639801 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632757fa-bdf5-4c94-abad-cded4a48eb20 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:09.640316 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632757fa-bdf5-4c94-abad-cded4a48eb20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:09.640774 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632757fa-bdf5-4c94-abad-cded4a48eb20 admin admin] PATH_INFO: `/v3/users/fddf70d1221742f4b532d54000b1ccdb` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:09.643578 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632757fa-bdf5-4c94-abad-cded4a48eb20 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fddf70d1221742f4b532d54000b1ccdb)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:09.646549 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632757fa-bdf5-4c94-abad-cded4a48eb20 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:09.720407 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=89,keystone:INSERT=5,keystone:DELETE=6 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:09.729811 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-632757fa-bdf5-4c94-abad-cded4a48eb20 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fddf70d1221742f4b532d54000b1ccdb'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:09.741894 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-632757fa-bdf5-4c94-abad-cded4a48eb20 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fddf70d1221742f4b532d54000b1ccdb'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:09.744804 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-632757fa-bdf5-4c94-abad-cded4a48eb20 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fddf70d1221742f4b532d54000b1ccdb'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:09.765093 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-632757fa-bdf5-4c94-abad-cded4a48eb20 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fddf70d1221742f4b532d54000b1ccdb'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:09.780762 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-632757fa-bdf5-4c94-abad-cded4a48eb20 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fddf70d1221742f4b532d54000b1ccdb'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:09.791036 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1091/2158] 10.222.0.67 () {58 vars in 1223 bytes} [Wed May 25 14:43:09 2022] DELETE /identity/v3/users/fddf70d1221742f4b532d54000b1ccdb => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:43:09.799422 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8ad6d0-8fff-44e9-b36b-eb56fbc30c66 None None] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:09.800009 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8ad6d0-8fff-44e9-b36b-eb56fbc30c66 None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:09.800847 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8ad6d0-8fff-44e9-b36b-eb56fbc30c66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:09.843801 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.auth.core [None req-bb8ad6d0-8fff-44e9-b36b-eb56fbc30c66 None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:43:09.848999 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-bb8ad6d0-8fff-44e9-b36b-eb56fbc30c66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:43:09.957795 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1068/2159] 10.222.0.67 () {58 vars in 957 bytes} [Wed May 25 14:43:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:43:09.970799 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632757fa-bdf5-4c94-abad-cded4a48eb20 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:09.972810 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-632757fa-bdf5-4c94-abad-cded4a48eb20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:43:10.066667 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632757fa-bdf5-4c94-abad-cded4a48eb20 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:10.070554 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4921142-b713-4766-8e42-50df3ef4756e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b68eed985c7b49839bcdd173186ad4ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfe93ee8d32a441295efc0b885de4bd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:10.071292 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4921142-b713-4766-8e42-50df3ef4756e service neutron] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:10.071583 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4921142-b713-4766-8e42-50df3ef4756e service neutron] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:10.071864 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4921142-b713-4766-8e42-50df3ef4756e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:10.082751 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4921142-b713-4766-8e42-50df3ef4756e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:10.084294 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4921142-b713-4766-8e42-50df3ef4756e service neutron] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:10.095481 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1092/2160] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 14:43:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:43:10.424474 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8ad6d0-8fff-44e9-b36b-eb56fbc30c66 None None] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:10.424474 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-bb8ad6d0-8fff-44e9-b36b-eb56fbc30c66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:43:10.441496 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8ad6d0-8fff-44e9-b36b-eb56fbc30c66 None None] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:10.455065 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e198ea5-b9c6-4232-87c8-bf511e27f7c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:10.456106 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e198ea5-b9c6-4232-87c8-bf511e27f7c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:10.456461 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e198ea5-b9c6-4232-87c8-bf511e27f7c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:10.456757 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e198ea5-b9c6-4232-87c8-bf511e27f7c8 admin admin] PATH_INFO: `/v3/projects/0c6c97438ddf484e80972750c6e05899` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:10.457956 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e198ea5-b9c6-4232-87c8-bf511e27f7c8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0c6c97438ddf484e80972750c6e05899)` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:10.459967 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e198ea5-b9c6-4232-87c8-bf511e27f7c8 admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:10.531234 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-8e198ea5-b9c6-4232-87c8-bf511e27f7c8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0c6c97438ddf484e80972750c6e05899', 'request_id': 'req-8e198ea5-b9c6-4232-87c8-bf511e27f7c8'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:10.541923 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-8e198ea5-b9c6-4232-87c8-bf511e27f7c8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0c6c97438ddf484e80972750c6e05899', 'request_id': 'req-8e198ea5-b9c6-4232-87c8-bf511e27f7c8'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:10.543602 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:10.556002 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-8e198ea5-b9c6-4232-87c8-bf511e27f7c8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0c6c97438ddf484e80972750c6e05899', 'request_id': 'req-8e198ea5-b9c6-4232-87c8-bf511e27f7c8'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:10.569520 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-8e198ea5-b9c6-4232-87c8-bf511e27f7c8 admin admin] The token cache is being invalidate because project 0c6c97438ddf484e80972750c6e05899 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80474) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 14:43:10.569798 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-8e198ea5-b9c6-4232-87c8-bf511e27f7c8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:10.570519 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-8e198ea5-b9c6-4232-87c8-bf511e27f7c8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:10.572326 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1069/2161] 10.222.0.67 () {58 vars in 1232 bytes} [Wed May 25 14:43:10 2022] DELETE /identity/v3/projects/0c6c97438ddf484e80972750c6e05899 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:43:10.576755 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4921142-b713-4766-8e42-50df3ef4756e service neutron] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:10.588064 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4921142-b713-4766-8e42-50df3ef4756e service neutron] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:10.658909 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b856c5-3ff0-45a5-bf14-a4d89fd0b1ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:10.659781 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b856c5-3ff0-45a5-bf14-a4d89fd0b1ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:10.660071 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b856c5-3ff0-45a5-bf14-a4d89fd0b1ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:10.660352 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b856c5-3ff0-45a5-bf14-a4d89fd0b1ba admin admin] PATH_INFO: `/v3/users/5cae755e99c04962a24bd34bcde1f485` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:10.661611 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b856c5-3ff0-45a5-bf14-a4d89fd0b1ba admin admin] RBAC: Authorizing `identity:delete_user(user_id=5cae755e99c04962a24bd34bcde1f485)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:10.663709 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b856c5-3ff0-45a5-bf14-a4d89fd0b1ba admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:10.715418 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-80b856c5-3ff0-45a5-bf14-a4d89fd0b1ba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5cae755e99c04962a24bd34bcde1f485'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:10.723977 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-80b856c5-3ff0-45a5-bf14-a4d89fd0b1ba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5cae755e99c04962a24bd34bcde1f485'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:10.724718 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-80b856c5-3ff0-45a5-bf14-a4d89fd0b1ba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5cae755e99c04962a24bd34bcde1f485'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:10.731998 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-80b856c5-3ff0-45a5-bf14-a4d89fd0b1ba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5cae755e99c04962a24bd34bcde1f485'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:10.733241 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:10.747432 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-80b856c5-3ff0-45a5-bf14-a4d89fd0b1ba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5cae755e99c04962a24bd34bcde1f485'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:10.755348 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1093/2162] 10.222.0.67 () {58 vars in 1223 bytes} [Wed May 25 14:43:10 2022] DELETE /identity/v3/users/5cae755e99c04962a24bd34bcde1f485 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:43:11.058832 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e198ea5-b9c6-4232-87c8-bf511e27f7c8 admin admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:11.064422 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-8e198ea5-b9c6-4232-87c8-bf511e27f7c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:43:11.090671 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e198ea5-b9c6-4232-87c8-bf511e27f7c8 admin admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:11.100361 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b856c5-3ff0-45a5-bf14-a4d89fd0b1ba admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:11.104115 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-80b856c5-3ff0-45a5-bf14-a4d89fd0b1ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:43:11.182223 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89780b5-3d47-4569-9f68-237fe3dd66c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:11.183269 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89780b5-3d47-4569-9f68-237fe3dd66c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:11.183602 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89780b5-3d47-4569-9f68-237fe3dd66c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:11.183947 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89780b5-3d47-4569-9f68-237fe3dd66c4 admin admin] PATH_INFO: `/v3/users/57b13c7f91e742e684b3f2d9bd3ee736` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:11.185609 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89780b5-3d47-4569-9f68-237fe3dd66c4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=57b13c7f91e742e684b3f2d9bd3ee736)` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:11.188084 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89780b5-3d47-4569-9f68-237fe3dd66c4 admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:11.284241 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b856c5-3ff0-45a5-bf14-a4d89fd0b1ba admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:11.290515 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2656656e-fd0a-49a1-8aae-615aabceb732 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:11.291567 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2656656e-fd0a-49a1-8aae-615aabceb732 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:11.291913 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2656656e-fd0a-49a1-8aae-615aabceb732 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:11.292138 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2656656e-fd0a-49a1-8aae-615aabceb732 admin admin] PATH_INFO: `/v3/projects/04cd77002454493a932e9023746d5f2f` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:11.293783 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2656656e-fd0a-49a1-8aae-615aabceb732 admin admin] RBAC: Authorizing `identity:delete_project(project_id=04cd77002454493a932e9023746d5f2f)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:11.295777 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2656656e-fd0a-49a1-8aae-615aabceb732 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:11.298658 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-b89780b5-3d47-4569-9f68-237fe3dd66c4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '57b13c7f91e742e684b3f2d9bd3ee736'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:11.299559 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-b89780b5-3d47-4569-9f68-237fe3dd66c4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '57b13c7f91e742e684b3f2d9bd3ee736'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:11.300331 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-b89780b5-3d47-4569-9f68-237fe3dd66c4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '57b13c7f91e742e684b3f2d9bd3ee736'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:11.315881 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-b89780b5-3d47-4569-9f68-237fe3dd66c4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '57b13c7f91e742e684b3f2d9bd3ee736'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:11.326048 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-b89780b5-3d47-4569-9f68-237fe3dd66c4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '57b13c7f91e742e684b3f2d9bd3ee736'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:11.341865 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1070/2163] 10.222.0.67 () {58 vars in 1223 bytes} [Wed May 25 14:43:11 2022] DELETE /identity/v3/users/57b13c7f91e742e684b3f2d9bd3ee736 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:43:11.347514 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a401cee5-6416-4bb4-9fa0-e58abed839a6 None None] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:11.347802 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a401cee5-6416-4bb4-9fa0-e58abed839a6 None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:11.348086 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a401cee5-6416-4bb4-9fa0-e58abed839a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:11.353466 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-2656656e-fd0a-49a1-8aae-615aabceb732 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '04cd77002454493a932e9023746d5f2f', 'request_id': 'req-2656656e-fd0a-49a1-8aae-615aabceb732'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:11.361389 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-2656656e-fd0a-49a1-8aae-615aabceb732 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '04cd77002454493a932e9023746d5f2f', 'request_id': 'req-2656656e-fd0a-49a1-8aae-615aabceb732'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:11.369624 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-2656656e-fd0a-49a1-8aae-615aabceb732 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '04cd77002454493a932e9023746d5f2f', 'request_id': 'req-2656656e-fd0a-49a1-8aae-615aabceb732'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:11.379648 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.auth.core [None req-a401cee5-6416-4bb4-9fa0-e58abed839a6 None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:43:11.381898 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-a401cee5-6416-4bb4-9fa0-e58abed839a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:43:11.386007 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-2656656e-fd0a-49a1-8aae-615aabceb732 admin admin] The token cache is being invalidate because project 04cd77002454493a932e9023746d5f2f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80475) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 14:43:11.386470 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-2656656e-fd0a-49a1-8aae-615aabceb732 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:11.387306 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-2656656e-fd0a-49a1-8aae-615aabceb732 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:11.389066 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1094/2164] 10.222.0.67 () {58 vars in 1232 bytes} [Wed May 25 14:43:11 2022] DELETE /identity/v3/projects/04cd77002454493a932e9023746d5f2f => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:43:11.394198 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2656656e-fd0a-49a1-8aae-615aabceb732 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:11.395922 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-2656656e-fd0a-49a1-8aae-615aabceb732 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:43:11.458633 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1071/2165] 10.222.0.67 () {58 vars in 957 bytes} [Wed May 25 14:43:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:43:11.470244 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a401cee5-6416-4bb4-9fa0-e58abed839a6 None None] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:11.471688 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-a401cee5-6416-4bb4-9fa0-e58abed839a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:43:11.473207 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2656656e-fd0a-49a1-8aae-615aabceb732 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:11.478154 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257cfc4a-5f28-4d0c-80f3-a2c0c49cf143 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:11.479239 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257cfc4a-5f28-4d0c-80f3-a2c0c49cf143 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:11.479526 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257cfc4a-5f28-4d0c-80f3-a2c0c49cf143 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:11.479785 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:11.479936 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257cfc4a-5f28-4d0c-80f3-a2c0c49cf143 admin admin] PATH_INFO: `/v3/users/ccbf6271e9574a8585d322900eef8a3a` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:11.481491 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257cfc4a-5f28-4d0c-80f3-a2c0c49cf143 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ccbf6271e9574a8585d322900eef8a3a)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:11.483807 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257cfc4a-5f28-4d0c-80f3-a2c0c49cf143 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:11.499405 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:11.542488 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a401cee5-6416-4bb4-9fa0-e58abed839a6 None None] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:11.543196 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-257cfc4a-5f28-4d0c-80f3-a2c0c49cf143 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ccbf6271e9574a8585d322900eef8a3a'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:11.546645 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73236384-9861-4725-8f46-26d5dbae2f7f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b68eed985c7b49839bcdd173186ad4ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfe93ee8d32a441295efc0b885de4bd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:11.547474 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73236384-9861-4725-8f46-26d5dbae2f7f service neutron] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:11.548130 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73236384-9861-4725-8f46-26d5dbae2f7f service neutron] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:11.548720 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73236384-9861-4725-8f46-26d5dbae2f7f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:11.552066 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-257cfc4a-5f28-4d0c-80f3-a2c0c49cf143 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ccbf6271e9574a8585d322900eef8a3a'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:11.552727 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-257cfc4a-5f28-4d0c-80f3-a2c0c49cf143 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ccbf6271e9574a8585d322900eef8a3a'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:11.561482 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73236384-9861-4725-8f46-26d5dbae2f7f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:11.563072 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73236384-9861-4725-8f46-26d5dbae2f7f service neutron] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:11.565532 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-257cfc4a-5f28-4d0c-80f3-a2c0c49cf143 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ccbf6271e9574a8585d322900eef8a3a'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:11.575715 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1072/2166] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 14:43:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 14:43:11.584122 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-257cfc4a-5f28-4d0c-80f3-a2c0c49cf143 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ccbf6271e9574a8585d322900eef8a3a'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:11.592317 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1095/2167] 10.222.0.67 () {58 vars in 1223 bytes} [Wed May 25 14:43:11 2022] DELETE /identity/v3/users/ccbf6271e9574a8585d322900eef8a3a => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 14:43:11.960441 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73236384-9861-4725-8f46-26d5dbae2f7f service neutron] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:11.963180 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-73236384-9861-4725-8f46-26d5dbae2f7f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:43:11.979712 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73236384-9861-4725-8f46-26d5dbae2f7f service neutron] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:12.060430 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257cfc4a-5f28-4d0c-80f3-a2c0c49cf143 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:12.062214 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-257cfc4a-5f28-4d0c-80f3-a2c0c49cf143 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:43:12.069394 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b045660-4f42-493a-b326-bf2ffa84b18a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:12.070378 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b045660-4f42-493a-b326-bf2ffa84b18a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:12.070668 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b045660-4f42-493a-b326-bf2ffa84b18a admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:12.071097 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b045660-4f42-493a-b326-bf2ffa84b18a admin admin] PATH_INFO: `/v3/projects/798c254db1c341d981f90f8e0e3fcd5f` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:12.072265 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b045660-4f42-493a-b326-bf2ffa84b18a admin admin] RBAC: Authorizing `identity:delete_project(project_id=798c254db1c341d981f90f8e0e3fcd5f)` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:12.074370 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b045660-4f42-493a-b326-bf2ffa84b18a admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:12.085908 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257cfc4a-5f28-4d0c-80f3-a2c0c49cf143 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:12.091949 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a74f297-82eb-4493-be7c-e06cd68fd8ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:12.093378 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a74f297-82eb-4493-be7c-e06cd68fd8ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:12.093744 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a74f297-82eb-4493-be7c-e06cd68fd8ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:12.094605 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a74f297-82eb-4493-be7c-e06cd68fd8ba admin admin] PATH_INFO: `/v3/projects/b7dc96c6ce7649808f45a1f7cf5a0776` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:12.096278 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a74f297-82eb-4493-be7c-e06cd68fd8ba admin admin] RBAC: Authorizing `identity:delete_project(project_id=b7dc96c6ce7649808f45a1f7cf5a0776)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:12.098624 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a74f297-82eb-4493-be7c-e06cd68fd8ba admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:12.148349 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-3b045660-4f42-493a-b326-bf2ffa84b18a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '798c254db1c341d981f90f8e0e3fcd5f', 'request_id': 'req-3b045660-4f42-493a-b326-bf2ffa84b18a'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:12.158218 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-3b045660-4f42-493a-b326-bf2ffa84b18a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '798c254db1c341d981f90f8e0e3fcd5f', 'request_id': 'req-3b045660-4f42-493a-b326-bf2ffa84b18a'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:12.158635 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-3a74f297-82eb-4493-be7c-e06cd68fd8ba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b7dc96c6ce7649808f45a1f7cf5a0776', 'request_id': 'req-3a74f297-82eb-4493-be7c-e06cd68fd8ba'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:12.165207 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-3a74f297-82eb-4493-be7c-e06cd68fd8ba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b7dc96c6ce7649808f45a1f7cf5a0776', 'request_id': 'req-3a74f297-82eb-4493-be7c-e06cd68fd8ba'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:12.166482 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-3b045660-4f42-493a-b326-bf2ffa84b18a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '798c254db1c341d981f90f8e0e3fcd5f', 'request_id': 'req-3b045660-4f42-493a-b326-bf2ffa84b18a'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:12.173697 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-3a74f297-82eb-4493-be7c-e06cd68fd8ba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b7dc96c6ce7649808f45a1f7cf5a0776', 'request_id': 'req-3a74f297-82eb-4493-be7c-e06cd68fd8ba'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:12.181074 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-3b045660-4f42-493a-b326-bf2ffa84b18a admin admin] The token cache is being invalidate because project 798c254db1c341d981f90f8e0e3fcd5f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80474) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 14:43:12.181385 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-3b045660-4f42-493a-b326-bf2ffa84b18a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:12.182121 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-3b045660-4f42-493a-b326-bf2ffa84b18a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:12.184109 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1073/2168] 10.222.0.67 () {58 vars in 1232 bytes} [Wed May 25 14:43:11 2022] DELETE /identity/v3/projects/798c254db1c341d981f90f8e0e3fcd5f => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:43:12.187936 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-3a74f297-82eb-4493-be7c-e06cd68fd8ba admin admin] The token cache is being invalidate because project b7dc96c6ce7649808f45a1f7cf5a0776 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80475) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 14:43:12.188754 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-3a74f297-82eb-4493-be7c-e06cd68fd8ba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:12.189427 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-3a74f297-82eb-4493-be7c-e06cd68fd8ba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:12.191046 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1096/2169] 10.222.0.67 () {58 vars in 1232 bytes} [Wed May 25 14:43:12 2022] DELETE /identity/v3/projects/b7dc96c6ce7649808f45a1f7cf5a0776 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:43:12.191158 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed771b14-e642-42af-995b-a3300bed48b2 None None] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:12.192075 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed771b14-e642-42af-995b-a3300bed48b2 None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:12.192075 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed771b14-e642-42af-995b-a3300bed48b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:12.213844 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.auth.core [None req-ed771b14-e642-42af-995b-a3300bed48b2 None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:43:12.215147 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-ed771b14-e642-42af-995b-a3300bed48b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:43:12.262044 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:12.304659 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1074/2170] 10.222.0.67 () {58 vars in 957 bytes} [Wed May 25 14:43:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:43:12.317440 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e7d24a-7d78-4faf-8f98-75587fc2bf93 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:12.319080 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e7d24a-7d78-4faf-8f98-75587fc2bf93 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:12.320849 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e7d24a-7d78-4faf-8f98-75587fc2bf93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:12.361675 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-40e7d24a-7d78-4faf-8f98-75587fc2bf93 None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:43:12.363485 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-40e7d24a-7d78-4faf-8f98-75587fc2bf93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:43:12.379438 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1097/2171] 10.222.0.67 () {58 vars in 957 bytes} [Wed May 25 14:43:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:43:12.385119 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed771b14-e642-42af-995b-a3300bed48b2 None None] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:12.398881 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed771b14-e642-42af-995b-a3300bed48b2 None None] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:12.410884 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc782361-c967-49e0-9bf5-bc438a859bf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:12.411639 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc782361-c967-49e0-9bf5-bc438a859bf2 admin admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:12.411929 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc782361-c967-49e0-9bf5-bc438a859bf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:12.412209 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc782361-c967-49e0-9bf5-bc438a859bf2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:12.413063 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc782361-c967-49e0-9bf5-bc438a859bf2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:43:12.413379 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc782361-c967-49e0-9bf5-bc438a859bf2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:12.415337 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc782361-c967-49e0-9bf5-bc438a859bf2 admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:12.436283 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1075/2172] 10.222.0.67 () {58 vars in 1152 bytes} [Wed May 25 14:43:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:43:12.443911 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e7d24a-7d78-4faf-8f98-75587fc2bf93 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:12.454317 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e7d24a-7d78-4faf-8f98-75587fc2bf93 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:12.467253 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca50753-3ceb-432d-8364-2411d684f3f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:12.468985 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca50753-3ceb-432d-8364-2411d684f3f4 admin admin] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:12.469327 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca50753-3ceb-432d-8364-2411d684f3f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:12.470398 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca50753-3ceb-432d-8364-2411d684f3f4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:12.471379 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca50753-3ceb-432d-8364-2411d684f3f4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:12.473714 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca50753-3ceb-432d-8364-2411d684f3f4 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:12.511414 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1098/2173] 10.222.0.67 () {60 vars in 1152 bytes} [Wed May 25 14:43:12 2022] POST /identity/v3/projects => generated 399 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:43:12.518417 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc782361-c967-49e0-9bf5-bc438a859bf2 admin admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:12.533581 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc782361-c967-49e0-9bf5-bc438a859bf2 admin admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:12.573492 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca50753-3ceb-432d-8364-2411d684f3f4 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:12.576684 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-eca50753-3ceb-432d-8364-2411d684f3f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:43:12.641764 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabbc075-82fc-4f8b-838f-37f75251cc73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:12.643102 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabbc075-82fc-4f8b-838f-37f75251cc73 admin admin] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:12.643508 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabbc075-82fc-4f8b-838f-37f75251cc73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:12.644000 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabbc075-82fc-4f8b-838f-37f75251cc73 admin admin] PATH_INFO: `/v3/users` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:12.645231 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabbc075-82fc-4f8b-838f-37f75251cc73 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:12.648223 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=81,keystone:DELETE=16,keystone:INSERT=3 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:12.648817 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabbc075-82fc-4f8b-838f-37f75251cc73 admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:12.673960 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca50753-3ceb-432d-8364-2411d684f3f4 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:12.677033 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1076/2174] 10.222.0.67 () {60 vars in 1143 bytes} [Wed May 25 14:43:12 2022] POST /identity/v3/users => generated 300 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:43:12.680391 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639f0e1b-2bbe-4b9a-9dca-e4ecd98e140c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:12.681353 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabbc075-82fc-4f8b-838f-37f75251cc73 admin admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:12.681564 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639f0e1b-2bbe-4b9a-9dca-e4ecd98e140c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:12.681881 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639f0e1b-2bbe-4b9a-9dca-e4ecd98e140c admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:12.682251 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639f0e1b-2bbe-4b9a-9dca-e4ecd98e140c admin admin] PATH_INFO: `/v3/users/24ddc0f88c5549178a89d871f2f650c8` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:12.683573 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639f0e1b-2bbe-4b9a-9dca-e4ecd98e140c admin admin] RBAC: Authorizing `identity:delete_user(user_id=24ddc0f88c5549178a89d871f2f650c8)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:12.685665 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639f0e1b-2bbe-4b9a-9dca-e4ecd98e140c admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:12.692851 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabbc075-82fc-4f8b-838f-37f75251cc73 admin admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:12.698881 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47c391b-1dff-4f65-99b8-a3ff87d97090 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:12.699642 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47c391b-1dff-4f65-99b8-a3ff87d97090 admin admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:12.699934 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47c391b-1dff-4f65-99b8-a3ff87d97090 admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:12.700228 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47c391b-1dff-4f65-99b8-a3ff87d97090 admin admin] PATH_INFO: `/v3/roles` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:12.701007 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47c391b-1dff-4f65-99b8-a3ff87d97090 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:12.702773 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47c391b-1dff-4f65-99b8-a3ff87d97090 admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:12.723524 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1077/2175] 10.222.0.67 () {58 vars in 1121 bytes} [Wed May 25 14:43:12 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 25 14:43:12.727656 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47c391b-1dff-4f65-99b8-a3ff87d97090 admin admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:12.740225 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47c391b-1dff-4f65-99b8-a3ff87d97090 admin admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:12.745480 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0c966b-579e-4976-b4d2-ae66caf581b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:12.746282 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0c966b-579e-4976-b4d2-ae66caf581b2 admin admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:12.746491 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0c966b-579e-4976-b4d2-ae66caf581b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:12.746847 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0c966b-579e-4976-b4d2-ae66caf581b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:12.747757 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0c966b-579e-4976-b4d2-ae66caf581b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:12.749530 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0c966b-579e-4976-b4d2-ae66caf581b2 admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:12.752887 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-639f0e1b-2bbe-4b9a-9dca-e4ecd98e140c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '24ddc0f88c5549178a89d871f2f650c8'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:12.763006 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-639f0e1b-2bbe-4b9a-9dca-e4ecd98e140c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '24ddc0f88c5549178a89d871f2f650c8'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:12.763900 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-639f0e1b-2bbe-4b9a-9dca-e4ecd98e140c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '24ddc0f88c5549178a89d871f2f650c8'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:12.768795 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1078/2176] 10.222.0.67 () {58 vars in 1121 bytes} [Wed May 25 14:43:12 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 25 14:43:12.770090 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0c966b-579e-4976-b4d2-ae66caf581b2 admin admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:12.772307 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-5d0c966b-579e-4976-b4d2-ae66caf581b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:43:12.775481 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-639f0e1b-2bbe-4b9a-9dca-e4ecd98e140c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '24ddc0f88c5549178a89d871f2f650c8'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:12.786762 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0c966b-579e-4976-b4d2-ae66caf581b2 admin admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:12.791742 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-639f0e1b-2bbe-4b9a-9dca-e4ecd98e140c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '24ddc0f88c5549178a89d871f2f650c8'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:12.792632 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502ad1b4-b562-493e-85ed-59757a6ed614 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:12.793721 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502ad1b4-b562-493e-85ed-59757a6ed614 admin admin] REQUEST_METHOD: `PUT` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:12.794052 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502ad1b4-b562-493e-85ed-59757a6ed614 admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:12.794344 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502ad1b4-b562-493e-85ed-59757a6ed614 admin admin] PATH_INFO: `/v3/projects/3296b25f4e7c4f96b6219294549c6cf6/users/fe7852c66fe44e1cb3526ba29979e06f/roles/48808901834b4d5eab2c7e6b5b03791e` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:12.801076 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1099/2177] 10.222.0.67 () {58 vars in 1223 bytes} [Wed May 25 14:43:12 2022] DELETE /identity/v3/users/24ddc0f88c5549178a89d871f2f650c8 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:43:12.806014 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcd3977-a2f3-443d-a085-3f2091a82df9 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:12.806307 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcd3977-a2f3-443d-a085-3f2091a82df9 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:12.806643 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcd3977-a2f3-443d-a085-3f2091a82df9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:12.813653 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502ad1b4-b562-493e-85ed-59757a6ed614 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3296b25f4e7c4f96b6219294549c6cf6, user_id=fe7852c66fe44e1cb3526ba29979e06f, role_id=48808901834b4d5eab2c7e6b5b03791e)` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:12.816540 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502ad1b4-b562-493e-85ed-59757a6ed614 admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:12.828904 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-8dcd3977-a2f3-443d-a085-3f2091a82df9 None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:43:12.830854 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-8dcd3977-a2f3-443d-a085-3f2091a82df9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:43:12.837402 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1079/2178] 10.222.0.67 () {60 vars in 1482 bytes} [Wed May 25 14:43:12 2022] PUT /identity/v3/projects/3296b25f4e7c4f96b6219294549c6cf6/users/fe7852c66fe44e1cb3526ba29979e06f/roles/48808901834b4d5eab2c7e6b5b03791e => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 14:43:12.856016 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434ce0e4-73dd-48e2-a94e-91b2031f8672 None None] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:12.856538 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434ce0e4-73dd-48e2-a94e-91b2031f8672 None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:12.857063 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434ce0e4-73dd-48e2-a94e-91b2031f8672 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:12.900316 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.auth.core [None req-434ce0e4-73dd-48e2-a94e-91b2031f8672 None None] MFA Rules not processed for user `fe7852c66fe44e1cb3526ba29979e06f`. Rule list: `[]` (Enabled: `True`). {{(pid=80474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:43:12.901641 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-434ce0e4-73dd-48e2-a94e-91b2031f8672 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:43:12.926219 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1100/2179] 10.222.0.67 () {58 vars in 957 bytes} [Wed May 25 14:43:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 14:43:12.940194 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcd3977-a2f3-443d-a085-3f2091a82df9 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:12.941950 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-8dcd3977-a2f3-443d-a085-3f2091a82df9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:43:13.014632 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:13.022913 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1080/2180] 10.222.0.67 () {58 vars in 957 bytes} [Wed May 25 14:43:12 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:43:13.039888 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434ce0e4-73dd-48e2-a94e-91b2031f8672 None None] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:13.042326 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcd3977-a2f3-443d-a085-3f2091a82df9 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:13.042920 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-434ce0e4-73dd-48e2-a94e-91b2031f8672 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:43:13.048456 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028539f1-fb23-4f62-8410-f4afb02afe7c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b68eed985c7b49839bcdd173186ad4ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfe93ee8d32a441295efc0b885de4bd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:13.049428 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028539f1-fb23-4f62-8410-f4afb02afe7c service neutron] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:13.049807 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028539f1-fb23-4f62-8410-f4afb02afe7c service neutron] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:13.050193 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028539f1-fb23-4f62-8410-f4afb02afe7c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:13.062762 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028539f1-fb23-4f62-8410-f4afb02afe7c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:13.064956 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028539f1-fb23-4f62-8410-f4afb02afe7c service neutron] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:13.076004 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1101/2181] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 14:43:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:43:13.126471 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434ce0e4-73dd-48e2-a94e-91b2031f8672 None None] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:13.133457 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fca2a29-03fd-42de-a6c7-6426bdfef16e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e462acc9da84a61bb23998dd54e1858', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfe93ee8d32a441295efc0b885de4bd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:13.134602 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fca2a29-03fd-42de-a6c7-6426bdfef16e service cinder] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:13.135282 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fca2a29-03fd-42de-a6c7-6426bdfef16e service cinder] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:13.136317 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fca2a29-03fd-42de-a6c7-6426bdfef16e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:13.159394 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fca2a29-03fd-42de-a6c7-6426bdfef16e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:13.161112 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fca2a29-03fd-42de-a6c7-6426bdfef16e service cinder] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:13.173514 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1081/2182] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 14:43:13 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:43:13.461220 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028539f1-fb23-4f62-8410-f4afb02afe7c service neutron] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:13.462766 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-028539f1-fb23-4f62-8410-f4afb02afe7c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:43:13.485569 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028539f1-fb23-4f62-8410-f4afb02afe7c service neutron] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:13.492192 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d99225c-988a-4ffd-b97f-098a25be1878 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:13.493703 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d99225c-988a-4ffd-b97f-098a25be1878 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:13.495340 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d99225c-988a-4ffd-b97f-098a25be1878 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:13.497805 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d99225c-988a-4ffd-b97f-098a25be1878 admin admin] PATH_INFO: `/v3/projects/1e95eda1d5194dc78dc8f06648e9cb34` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:13.506202 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d99225c-988a-4ffd-b97f-098a25be1878 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1e95eda1d5194dc78dc8f06648e9cb34)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:13.509104 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d99225c-988a-4ffd-b97f-098a25be1878 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:13.510547 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:13.586932 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-8d99225c-988a-4ffd-b97f-098a25be1878 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e95eda1d5194dc78dc8f06648e9cb34', 'request_id': 'req-8d99225c-988a-4ffd-b97f-098a25be1878'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:13.593263 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-8d99225c-988a-4ffd-b97f-098a25be1878 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e95eda1d5194dc78dc8f06648e9cb34', 'request_id': 'req-8d99225c-988a-4ffd-b97f-098a25be1878'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:13.601721 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-8d99225c-988a-4ffd-b97f-098a25be1878 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e95eda1d5194dc78dc8f06648e9cb34', 'request_id': 'req-8d99225c-988a-4ffd-b97f-098a25be1878'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:13.618250 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-8d99225c-988a-4ffd-b97f-098a25be1878 admin admin] The token cache is being invalidate because project 1e95eda1d5194dc78dc8f06648e9cb34 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80475) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 14:43:13.618544 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-8d99225c-988a-4ffd-b97f-098a25be1878 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:13.619305 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-8d99225c-988a-4ffd-b97f-098a25be1878 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:13.621369 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1102/2183] 10.222.0.67 () {58 vars in 1232 bytes} [Wed May 25 14:43:13 2022] DELETE /identity/v3/projects/1e95eda1d5194dc78dc8f06648e9cb34 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:43:13.625444 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fca2a29-03fd-42de-a6c7-6426bdfef16e service cinder] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:13.637148 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fca2a29-03fd-42de-a6c7-6426bdfef16e service cinder] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:13.737769 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17db7b24-3170-4046-b9fe-dfa7837d163d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:13.738736 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17db7b24-3170-4046-b9fe-dfa7837d163d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:13.739088 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17db7b24-3170-4046-b9fe-dfa7837d163d admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:13.739394 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17db7b24-3170-4046-b9fe-dfa7837d163d admin admin] PATH_INFO: `/v3/users/1fc229b399ca491a9916baa62c01840c` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:13.740843 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17db7b24-3170-4046-b9fe-dfa7837d163d admin admin] RBAC: Authorizing `identity:delete_user(user_id=1fc229b399ca491a9916baa62c01840c)` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:13.743025 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17db7b24-3170-4046-b9fe-dfa7837d163d admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:13.819194 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-17db7b24-3170-4046-b9fe-dfa7837d163d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1fc229b399ca491a9916baa62c01840c'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:13.820132 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-17db7b24-3170-4046-b9fe-dfa7837d163d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1fc229b399ca491a9916baa62c01840c'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:13.820728 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-17db7b24-3170-4046-b9fe-dfa7837d163d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1fc229b399ca491a9916baa62c01840c'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:13.850292 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-17db7b24-3170-4046-b9fe-dfa7837d163d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1fc229b399ca491a9916baa62c01840c'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:13.861388 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-17db7b24-3170-4046-b9fe-dfa7837d163d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1fc229b399ca491a9916baa62c01840c'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:13.878597 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1082/2184] 10.222.0.67 () {58 vars in 1223 bytes} [Wed May 25 14:43:13 2022] DELETE /identity/v3/users/1fc229b399ca491a9916baa62c01840c => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:43:14.483402 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d99225c-988a-4ffd-b97f-098a25be1878 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:14.485490 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-8d99225c-988a-4ffd-b97f-098a25be1878 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:43:14.577956 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d99225c-988a-4ffd-b97f-098a25be1878 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:14.638853 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799a552b-3d0d-46ab-9743-cf43b4bfe8e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:14.639755 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799a552b-3d0d-46ab-9743-cf43b4bfe8e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:14.640253 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799a552b-3d0d-46ab-9743-cf43b4bfe8e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:14.640750 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799a552b-3d0d-46ab-9743-cf43b4bfe8e7 admin admin] PATH_INFO: `/v3/projects/6bd4a139626c4431848165c5028f7700` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:14.643489 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799a552b-3d0d-46ab-9743-cf43b4bfe8e7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6bd4a139626c4431848165c5028f7700)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:14.647112 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799a552b-3d0d-46ab-9743-cf43b4bfe8e7 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:14.708385 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:14.730119 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-799a552b-3d0d-46ab-9743-cf43b4bfe8e7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6bd4a139626c4431848165c5028f7700', 'request_id': 'req-799a552b-3d0d-46ab-9743-cf43b4bfe8e7'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:14.738507 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-799a552b-3d0d-46ab-9743-cf43b4bfe8e7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6bd4a139626c4431848165c5028f7700', 'request_id': 'req-799a552b-3d0d-46ab-9743-cf43b4bfe8e7'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:14.748372 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-799a552b-3d0d-46ab-9743-cf43b4bfe8e7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6bd4a139626c4431848165c5028f7700', 'request_id': 'req-799a552b-3d0d-46ab-9743-cf43b4bfe8e7'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:14.763481 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-799a552b-3d0d-46ab-9743-cf43b4bfe8e7 admin admin] The token cache is being invalidate because project 6bd4a139626c4431848165c5028f7700 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80475) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 14:43:14.763769 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-799a552b-3d0d-46ab-9743-cf43b4bfe8e7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:14.764502 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-799a552b-3d0d-46ab-9743-cf43b4bfe8e7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:14.766524 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1103/2185] 10.222.0.67 () {58 vars in 1232 bytes} [Wed May 25 14:43:14 2022] DELETE /identity/v3/projects/6bd4a139626c4431848165c5028f7700 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:43:14.772124 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d160e4e-6db2-4e30-b6a3-4b8e2095e437 None None] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:14.772658 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d160e4e-6db2-4e30-b6a3-4b8e2095e437 None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:14.773191 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d160e4e-6db2-4e30-b6a3-4b8e2095e437 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:14.815963 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:14.840693 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.auth.core [None req-6d160e4e-6db2-4e30-b6a3-4b8e2095e437 None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:43:14.842041 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-6d160e4e-6db2-4e30-b6a3-4b8e2095e437 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:43:14.913774 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1083/2186] 10.222.0.67 () {58 vars in 957 bytes} [Wed May 25 14:43:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:43:14.924585 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa3dc54-4083-4011-86aa-94d93f6897c6 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:14.925014 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa3dc54-4083-4011-86aa-94d93f6897c6 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:14.925357 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa3dc54-4083-4011-86aa-94d93f6897c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:14.946414 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-6fa3dc54-4083-4011-86aa-94d93f6897c6 None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:43:14.947683 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-6fa3dc54-4083-4011-86aa-94d93f6897c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:43:14.963166 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1104/2187] 10.222.0.67 () {58 vars in 957 bytes} [Wed May 25 14:43:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:43:14.967560 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d160e4e-6db2-4e30-b6a3-4b8e2095e437 None None] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:14.978335 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d160e4e-6db2-4e30-b6a3-4b8e2095e437 None None] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:14.983490 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de50416-6bf7-438e-a253-fdfbca484f4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:14.984158 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de50416-6bf7-438e-a253-fdfbca484f4a admin admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:14.984454 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de50416-6bf7-438e-a253-fdfbca484f4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:14.985362 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de50416-6bf7-438e-a253-fdfbca484f4a admin admin] PATH_INFO: `/v3/domains` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:14.986372 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de50416-6bf7-438e-a253-fdfbca484f4a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:43:14.986742 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de50416-6bf7-438e-a253-fdfbca484f4a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:14.988497 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de50416-6bf7-438e-a253-fdfbca484f4a admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:15.002464 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1084/2188] 10.222.0.67 () {58 vars in 1152 bytes} [Wed May 25 14:43:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:43:15.007780 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa3dc54-4083-4011-86aa-94d93f6897c6 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:15.027037 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa3dc54-4083-4011-86aa-94d93f6897c6 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:15.036406 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c42bd1a-0b5d-426f-b728-66144596d564 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:15.037432 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c42bd1a-0b5d-426f-b728-66144596d564 admin admin] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:15.037800 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c42bd1a-0b5d-426f-b728-66144596d564 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:15.038161 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c42bd1a-0b5d-426f-b728-66144596d564 admin admin] PATH_INFO: `/v3/projects` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:15.039563 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c42bd1a-0b5d-426f-b728-66144596d564 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:15.041660 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c42bd1a-0b5d-426f-b728-66144596d564 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:15.079698 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1105/2189] 10.222.0.67 () {60 vars in 1152 bytes} [Wed May 25 14:43:15 2022] POST /identity/v3/projects => generated 359 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 14:43:15.084805 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de50416-6bf7-438e-a253-fdfbca484f4a admin admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:15.096942 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de50416-6bf7-438e-a253-fdfbca484f4a admin admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:15.168956 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4738d647-efa3-4ece-802f-1a303355db89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:15.169558 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4738d647-efa3-4ece-802f-1a303355db89 admin admin] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:15.169847 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4738d647-efa3-4ece-802f-1a303355db89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:15.170126 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4738d647-efa3-4ece-802f-1a303355db89 admin admin] PATH_INFO: `/v3/users` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:15.170925 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4738d647-efa3-4ece-802f-1a303355db89 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:15.173472 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4738d647-efa3-4ece-802f-1a303355db89 admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:15.203039 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1085/2190] 10.222.0.67 () {60 vars in 1143 bytes} [Wed May 25 14:43:15 2022] POST /identity/v3/users => generated 280 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:43:15.205171 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c42bd1a-0b5d-426f-b728-66144596d564 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:15.217330 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c42bd1a-0b5d-426f-b728-66144596d564 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:15.223471 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34aa910-05ee-4047-b39f-f87dbb68313a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:15.224561 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34aa910-05ee-4047-b39f-f87dbb68313a admin admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:15.224876 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34aa910-05ee-4047-b39f-f87dbb68313a admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:15.225156 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34aa910-05ee-4047-b39f-f87dbb68313a admin admin] PATH_INFO: `/v3/roles` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:15.226208 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34aa910-05ee-4047-b39f-f87dbb68313a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:15.227882 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34aa910-05ee-4047-b39f-f87dbb68313a admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:15.241529 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1106/2191] 10.222.0.67 () {58 vars in 1121 bytes} [Wed May 25 14:43:15 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:43:15.245435 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4738d647-efa3-4ece-802f-1a303355db89 admin admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:15.258486 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4738d647-efa3-4ece-802f-1a303355db89 admin admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:15.263261 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8293d29c-2404-44ef-8df4-7515d23c357a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:15.263931 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8293d29c-2404-44ef-8df4-7515d23c357a admin admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:15.264220 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8293d29c-2404-44ef-8df4-7515d23c357a admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:15.264526 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8293d29c-2404-44ef-8df4-7515d23c357a admin admin] PATH_INFO: `/v3/roles` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:15.265391 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8293d29c-2404-44ef-8df4-7515d23c357a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:15.268109 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8293d29c-2404-44ef-8df4-7515d23c357a admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:15.283217 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1086/2192] 10.222.0.67 () {58 vars in 1121 bytes} [Wed May 25 14:43:15 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:43:15.284839 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34aa910-05ee-4047-b39f-f87dbb68313a admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:15.295460 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34aa910-05ee-4047-b39f-f87dbb68313a admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:15.301471 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264f3320-b0d9-4c2c-bdfd-52ec78917a4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:15.302492 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264f3320-b0d9-4c2c-bdfd-52ec78917a4c admin admin] REQUEST_METHOD: `PUT` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:15.302786 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264f3320-b0d9-4c2c-bdfd-52ec78917a4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:15.303099 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264f3320-b0d9-4c2c-bdfd-52ec78917a4c admin admin] PATH_INFO: `/v3/projects/fa316413893b403f8972cead6bf522ee/users/0e466472bdee4b76bd352d5be9fa537e/roles/48808901834b4d5eab2c7e6b5b03791e` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:15.323691 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264f3320-b0d9-4c2c-bdfd-52ec78917a4c admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa316413893b403f8972cead6bf522ee, user_id=0e466472bdee4b76bd352d5be9fa537e, role_id=48808901834b4d5eab2c7e6b5b03791e)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:15.326428 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264f3320-b0d9-4c2c-bdfd-52ec78917a4c admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:15.346396 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1107/2193] 10.222.0.67 () {60 vars in 1482 bytes} [Wed May 25 14:43:15 2022] PUT /identity/v3/projects/fa316413893b403f8972cead6bf522ee/users/0e466472bdee4b76bd352d5be9fa537e/roles/48808901834b4d5eab2c7e6b5b03791e => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:43:15.358856 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175c99c3-56e0-4a78-bc3c-6a5908c77f61 None None] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:15.359202 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175c99c3-56e0-4a78-bc3c-6a5908c77f61 None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:15.359496 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175c99c3-56e0-4a78-bc3c-6a5908c77f61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:15.396008 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.auth.core [None req-175c99c3-56e0-4a78-bc3c-6a5908c77f61 None None] MFA Rules not processed for user `0e466472bdee4b76bd352d5be9fa537e`. Rule list: `[]` (Enabled: `True`). {{(pid=80474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:43:15.397297 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-175c99c3-56e0-4a78-bc3c-6a5908c77f61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:43:15.466942 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:15.480258 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1087/2194] 10.222.0.67 () {58 vars in 957 bytes} [Wed May 25 14:43:15 2022] POST /identity/v3/auth/tokens => generated 3226 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:43:15.518699 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264f3320-b0d9-4c2c-bdfd-52ec78917a4c admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:15.520846 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-264f3320-b0d9-4c2c-bdfd-52ec78917a4c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:43:15.629433 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264f3320-b0d9-4c2c-bdfd-52ec78917a4c admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:15.634071 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43eb34a-8b8b-4058-8350-4ecb2988ad21 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e462acc9da84a61bb23998dd54e1858', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfe93ee8d32a441295efc0b885de4bd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:15.634818 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43eb34a-8b8b-4058-8350-4ecb2988ad21 service cinder] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:15.635151 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43eb34a-8b8b-4058-8350-4ecb2988ad21 service cinder] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:15.635439 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43eb34a-8b8b-4058-8350-4ecb2988ad21 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:15.645925 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43eb34a-8b8b-4058-8350-4ecb2988ad21 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:15.647618 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43eb34a-8b8b-4058-8350-4ecb2988ad21 service cinder] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:15.659311 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1108/2195] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 14:43:15 2022] GET /identity/v3/auth/tokens => generated 3226 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:43:15.677274 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175c99c3-56e0-4a78-bc3c-6a5908c77f61 None None] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:15.752578 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175c99c3-56e0-4a78-bc3c-6a5908c77f61 None None] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:15.758353 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d6761c-7284-4f6d-8421-31188f1c28fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:15.759332 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d6761c-7284-4f6d-8421-31188f1c28fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:15.759646 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d6761c-7284-4f6d-8421-31188f1c28fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:15.759946 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d6761c-7284-4f6d-8421-31188f1c28fa admin admin] PATH_INFO: `/v3/users/0e466472bdee4b76bd352d5be9fa537e` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:15.761232 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d6761c-7284-4f6d-8421-31188f1c28fa admin admin] RBAC: Authorizing `identity:delete_user(user_id=0e466472bdee4b76bd352d5be9fa537e)` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:15.763456 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d6761c-7284-4f6d-8421-31188f1c28fa admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:15.834884 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-a6d6761c-7284-4f6d-8421-31188f1c28fa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0e466472bdee4b76bd352d5be9fa537e'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:15.836620 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-a6d6761c-7284-4f6d-8421-31188f1c28fa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0e466472bdee4b76bd352d5be9fa537e'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:15.837535 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-a6d6761c-7284-4f6d-8421-31188f1c28fa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0e466472bdee4b76bd352d5be9fa537e'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:15.860605 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-a6d6761c-7284-4f6d-8421-31188f1c28fa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0e466472bdee4b76bd352d5be9fa537e'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:15.871057 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-a6d6761c-7284-4f6d-8421-31188f1c28fa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0e466472bdee4b76bd352d5be9fa537e'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:15.892174 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1088/2196] 10.222.0.67 () {58 vars in 1223 bytes} [Wed May 25 14:43:15 2022] DELETE /identity/v3/users/0e466472bdee4b76bd352d5be9fa537e => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 14:43:15.898031 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11eb258f-7d94-4635-962f-39c6459caf3e None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:15.898339 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11eb258f-7d94-4635-962f-39c6459caf3e None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:15.898615 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11eb258f-7d94-4635-962f-39c6459caf3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:15.927225 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-11eb258f-7d94-4635-962f-39c6459caf3e None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:43:15.928743 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-11eb258f-7d94-4635-962f-39c6459caf3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:43:15.986926 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:16.015709 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1109/2197] 10.222.0.67 () {58 vars in 957 bytes} [Wed May 25 14:43:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:43:16.025661 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d6761c-7284-4f6d-8421-31188f1c28fa admin admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:16.027165 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-a6d6761c-7284-4f6d-8421-31188f1c28fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:43:16.128553 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d6761c-7284-4f6d-8421-31188f1c28fa admin admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:16.132620 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a91ab5b-0210-413c-9edc-70928b3d753a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b68eed985c7b49839bcdd173186ad4ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfe93ee8d32a441295efc0b885de4bd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:16.133281 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a91ab5b-0210-413c-9edc-70928b3d753a service neutron] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:16.133563 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a91ab5b-0210-413c-9edc-70928b3d753a service neutron] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:16.133843 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a91ab5b-0210-413c-9edc-70928b3d753a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:16.142269 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:16.145541 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a91ab5b-0210-413c-9edc-70928b3d753a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:16.151875 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a91ab5b-0210-413c-9edc-70928b3d753a service neutron] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:16.166837 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1089/2198] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 14:43:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:43:16.474435 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11eb258f-7d94-4635-962f-39c6459caf3e None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:16.476466 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-11eb258f-7d94-4635-962f-39c6459caf3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:43:16.490907 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11eb258f-7d94-4635-962f-39c6459caf3e None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:16.497410 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609b93bb-7190-4e67-8fb3-a286dc4ecae5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:16.498331 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609b93bb-7190-4e67-8fb3-a286dc4ecae5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:16.499365 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609b93bb-7190-4e67-8fb3-a286dc4ecae5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:16.499872 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609b93bb-7190-4e67-8fb3-a286dc4ecae5 admin admin] PATH_INFO: `/v3/projects/fa316413893b403f8972cead6bf522ee` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:16.502045 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609b93bb-7190-4e67-8fb3-a286dc4ecae5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fa316413893b403f8972cead6bf522ee)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:16.504117 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609b93bb-7190-4e67-8fb3-a286dc4ecae5 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:16.558954 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-609b93bb-7190-4e67-8fb3-a286dc4ecae5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fa316413893b403f8972cead6bf522ee', 'request_id': 'req-609b93bb-7190-4e67-8fb3-a286dc4ecae5'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:16.565914 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-609b93bb-7190-4e67-8fb3-a286dc4ecae5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fa316413893b403f8972cead6bf522ee', 'request_id': 'req-609b93bb-7190-4e67-8fb3-a286dc4ecae5'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:16.572930 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-609b93bb-7190-4e67-8fb3-a286dc4ecae5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fa316413893b403f8972cead6bf522ee', 'request_id': 'req-609b93bb-7190-4e67-8fb3-a286dc4ecae5'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:16.587881 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-609b93bb-7190-4e67-8fb3-a286dc4ecae5 admin admin] The token cache is being invalidate because project fa316413893b403f8972cead6bf522ee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80475) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 14:43:16.588379 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-609b93bb-7190-4e67-8fb3-a286dc4ecae5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:16.589232 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-609b93bb-7190-4e67-8fb3-a286dc4ecae5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:16.591113 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1110/2199] 10.222.0.67 () {58 vars in 1232 bytes} [Wed May 25 14:43:16 2022] DELETE /identity/v3/projects/fa316413893b403f8972cead6bf522ee => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:43:16.596524 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fc53a9-2272-4afc-a8e2-d6af1ba695a4 None None] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:16.596956 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fc53a9-2272-4afc-a8e2-d6af1ba695a4 None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:16.597490 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fc53a9-2272-4afc-a8e2-d6af1ba695a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:16.620166 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.auth.core [None req-a6fc53a9-2272-4afc-a8e2-d6af1ba695a4 None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:43:16.621482 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-a6fc53a9-2272-4afc-a8e2-d6af1ba695a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:43:16.713374 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1090/2200] 10.222.0.67 () {58 vars in 957 bytes} [Wed May 25 14:43:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:43:16.724896 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb432b9-f051-4810-80f8-3f242130b15a None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:16.725440 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb432b9-f051-4810-80f8-3f242130b15a None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:16.725935 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb432b9-f051-4810-80f8-3f242130b15a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:16.755323 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-bcb432b9-f051-4810-80f8-3f242130b15a None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:43:16.757030 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-bcb432b9-f051-4810-80f8-3f242130b15a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:43:16.768215 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1111/2201] 10.222.0.67 () {58 vars in 957 bytes} [Wed May 25 14:43:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:43:16.774705 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fc53a9-2272-4afc-a8e2-d6af1ba695a4 None None] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:16.790245 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fc53a9-2272-4afc-a8e2-d6af1ba695a4 None None] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:16.800202 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb25e9b2-3ab7-4611-9637-6cad2f28aee4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:16.801578 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb25e9b2-3ab7-4611-9637-6cad2f28aee4 admin admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:16.802490 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb25e9b2-3ab7-4611-9637-6cad2f28aee4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:16.803161 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb25e9b2-3ab7-4611-9637-6cad2f28aee4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:16.804221 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb25e9b2-3ab7-4611-9637-6cad2f28aee4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:43:16.804682 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb25e9b2-3ab7-4611-9637-6cad2f28aee4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:16.806732 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb25e9b2-3ab7-4611-9637-6cad2f28aee4 admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:16.830974 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1091/2202] 10.222.0.67 () {58 vars in 1152 bytes} [Wed May 25 14:43:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:43:16.832289 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb432b9-f051-4810-80f8-3f242130b15a None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:16.843939 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb432b9-f051-4810-80f8-3f242130b15a None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:16.854425 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbe0b8c-6cd6-45ce-a6ce-be9196f6b9eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:16.855322 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbe0b8c-6cd6-45ce-a6ce-be9196f6b9eb admin admin] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:16.855722 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbe0b8c-6cd6-45ce-a6ce-be9196f6b9eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:16.856721 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbe0b8c-6cd6-45ce-a6ce-be9196f6b9eb admin admin] PATH_INFO: `/v3/projects` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:16.857802 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbe0b8c-6cd6-45ce-a6ce-be9196f6b9eb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:16.861164 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbe0b8c-6cd6-45ce-a6ce-be9196f6b9eb admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:16.891308 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1112/2203] 10.222.0.67 () {60 vars in 1152 bytes} [Wed May 25 14:43:16 2022] POST /identity/v3/projects => generated 377 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:43:16.895655 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb25e9b2-3ab7-4611-9637-6cad2f28aee4 admin admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:16.914577 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb25e9b2-3ab7-4611-9637-6cad2f28aee4 admin admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:16.983551 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23496ece-e046-49df-9c41-792ba3d13355 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:16.984431 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23496ece-e046-49df-9c41-792ba3d13355 admin admin] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:16.985548 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23496ece-e046-49df-9c41-792ba3d13355 admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:16.985777 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23496ece-e046-49df-9c41-792ba3d13355 admin admin] PATH_INFO: `/v3/users` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:16.986734 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23496ece-e046-49df-9c41-792ba3d13355 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:16.989508 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23496ece-e046-49df-9c41-792ba3d13355 admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:17.013200 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1092/2204] 10.222.0.67 () {60 vars in 1143 bytes} [Wed May 25 14:43:16 2022] POST /identity/v3/users => generated 289 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:43:17.017828 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbe0b8c-6cd6-45ce-a6ce-be9196f6b9eb admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:17.029601 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbe0b8c-6cd6-45ce-a6ce-be9196f6b9eb admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:17.035538 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c7db04-cb56-4e60-898c-edc4b101b0f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:17.036293 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c7db04-cb56-4e60-898c-edc4b101b0f8 admin admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:17.036634 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c7db04-cb56-4e60-898c-edc4b101b0f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:17.036942 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c7db04-cb56-4e60-898c-edc4b101b0f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:17.037732 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c7db04-cb56-4e60-898c-edc4b101b0f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:17.039562 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c7db04-cb56-4e60-898c-edc4b101b0f8 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:17.051984 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1113/2205] 10.222.0.67 () {58 vars in 1121 bytes} [Wed May 25 14:43:17 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:43:17.056438 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23496ece-e046-49df-9c41-792ba3d13355 admin admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:17.068772 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23496ece-e046-49df-9c41-792ba3d13355 admin admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:17.073888 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1755d7-389a-4870-a313-3b0a38f4042a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:17.074609 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1755d7-389a-4870-a313-3b0a38f4042a admin admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:17.075081 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1755d7-389a-4870-a313-3b0a38f4042a admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:17.075363 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1755d7-389a-4870-a313-3b0a38f4042a admin admin] PATH_INFO: `/v3/roles` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:17.076229 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1755d7-389a-4870-a313-3b0a38f4042a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:17.078049 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1755d7-389a-4870-a313-3b0a38f4042a admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:17.090511 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1093/2206] 10.222.0.67 () {58 vars in 1121 bytes} [Wed May 25 14:43:17 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:43:17.095532 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c7db04-cb56-4e60-898c-edc4b101b0f8 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:17.107281 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c7db04-cb56-4e60-898c-edc4b101b0f8 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:17.113218 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441b9a67-7f0e-467a-8c83-a7ab69febf94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:17.114157 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441b9a67-7f0e-467a-8c83-a7ab69febf94 admin admin] REQUEST_METHOD: `PUT` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:17.114444 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441b9a67-7f0e-467a-8c83-a7ab69febf94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:17.114777 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441b9a67-7f0e-467a-8c83-a7ab69febf94 admin admin] PATH_INFO: `/v3/projects/1aab34685fe841fbb89d73ca035168ae/users/6312dfa9e2ca4d6bbcccb83cd18cf06a/roles/48808901834b4d5eab2c7e6b5b03791e` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:17.131790 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441b9a67-7f0e-467a-8c83-a7ab69febf94 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1aab34685fe841fbb89d73ca035168ae, user_id=6312dfa9e2ca4d6bbcccb83cd18cf06a, role_id=48808901834b4d5eab2c7e6b5b03791e)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:17.134719 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441b9a67-7f0e-467a-8c83-a7ab69febf94 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:17.149178 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1114/2207] 10.222.0.67 () {60 vars in 1482 bytes} [Wed May 25 14:43:17 2022] PUT /identity/v3/projects/1aab34685fe841fbb89d73ca035168ae/users/6312dfa9e2ca4d6bbcccb83cd18cf06a/roles/48808901834b4d5eab2c7e6b5b03791e => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:43:17.165508 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b49b664-dee9-4866-935e-226566e2c7c4 None None] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:17.165886 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b49b664-dee9-4866-935e-226566e2c7c4 None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:17.166232 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b49b664-dee9-4866-935e-226566e2c7c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:17.198265 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.auth.core [None req-1b49b664-dee9-4866-935e-226566e2c7c4 None None] MFA Rules not processed for user `6312dfa9e2ca4d6bbcccb83cd18cf06a`. Rule list: `[]` (Enabled: `True`). {{(pid=80474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:43:17.199629 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-1b49b664-dee9-4866-935e-226566e2c7c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:43:17.252739 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:17.279243 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1094/2208] 10.222.0.67 () {58 vars in 957 bytes} [Wed May 25 14:43:17 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 14:43:17.289416 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441b9a67-7f0e-467a-8c83-a7ab69febf94 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:17.295986 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-441b9a67-7f0e-467a-8c83-a7ab69febf94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:43:17.371598 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441b9a67-7f0e-467a-8c83-a7ab69febf94 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:17.376947 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d395d7-7629-4aeb-9354-be47f2d0f486 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e462acc9da84a61bb23998dd54e1858', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfe93ee8d32a441295efc0b885de4bd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:17.377638 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d395d7-7629-4aeb-9354-be47f2d0f486 service cinder] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:17.377927 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d395d7-7629-4aeb-9354-be47f2d0f486 service cinder] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:17.378207 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d395d7-7629-4aeb-9354-be47f2d0f486 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:17.391593 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d395d7-7629-4aeb-9354-be47f2d0f486 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:17.393390 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d395d7-7629-4aeb-9354-be47f2d0f486 service cinder] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:17.404436 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1115/2209] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 14:43:17 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:43:18.458225 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b49b664-dee9-4866-935e-226566e2c7c4 None None] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:18.460193 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-1b49b664-dee9-4866-935e-226566e2c7c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:43:18.541187 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b49b664-dee9-4866-935e-226566e2c7c4 None None] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:18.547910 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dadf45e-bef2-4c19-bfb2-a6336b60bfa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:18.549044 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dadf45e-bef2-4c19-bfb2-a6336b60bfa6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:18.549430 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dadf45e-bef2-4c19-bfb2-a6336b60bfa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:18.549825 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dadf45e-bef2-4c19-bfb2-a6336b60bfa6 admin admin] PATH_INFO: `/v3/users/fe7852c66fe44e1cb3526ba29979e06f` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:18.552733 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dadf45e-bef2-4c19-bfb2-a6336b60bfa6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fe7852c66fe44e1cb3526ba29979e06f)` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:18.556578 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dadf45e-bef2-4c19-bfb2-a6336b60bfa6 admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:18.614557 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-3dadf45e-bef2-4c19-bfb2-a6336b60bfa6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fe7852c66fe44e1cb3526ba29979e06f'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:18.615264 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-3dadf45e-bef2-4c19-bfb2-a6336b60bfa6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fe7852c66fe44e1cb3526ba29979e06f'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:18.615908 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-3dadf45e-bef2-4c19-bfb2-a6336b60bfa6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fe7852c66fe44e1cb3526ba29979e06f'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:18.630781 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-3dadf45e-bef2-4c19-bfb2-a6336b60bfa6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fe7852c66fe44e1cb3526ba29979e06f'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:18.639091 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-3dadf45e-bef2-4c19-bfb2-a6336b60bfa6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fe7852c66fe44e1cb3526ba29979e06f'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:18.656254 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1095/2210] 10.222.0.67 () {58 vars in 1223 bytes} [Wed May 25 14:43:18 2022] DELETE /identity/v3/users/fe7852c66fe44e1cb3526ba29979e06f => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 14:43:18.663114 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6232d4d-5d01-4440-85ec-a668acc21b51 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:18.663578 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6232d4d-5d01-4440-85ec-a668acc21b51 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:18.663804 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6232d4d-5d01-4440-85ec-a668acc21b51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:18.672027 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:18.689011 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-b6232d4d-5d01-4440-85ec-a668acc21b51 None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:43:18.690826 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-b6232d4d-5d01-4440-85ec-a668acc21b51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:43:18.768276 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1116/2211] 10.222.0.67 () {58 vars in 957 bytes} [Wed May 25 14:43:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:43:18.780126 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dadf45e-bef2-4c19-bfb2-a6336b60bfa6 admin admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:18.782328 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-3dadf45e-bef2-4c19-bfb2-a6336b60bfa6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:43:18.861377 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dadf45e-bef2-4c19-bfb2-a6336b60bfa6 admin admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:18.865195 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf1ad01-636a-46bb-85d3-895fc1b48b44 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b68eed985c7b49839bcdd173186ad4ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfe93ee8d32a441295efc0b885de4bd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:18.865856 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf1ad01-636a-46bb-85d3-895fc1b48b44 service neutron] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:18.866142 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf1ad01-636a-46bb-85d3-895fc1b48b44 service neutron] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:18.866427 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf1ad01-636a-46bb-85d3-895fc1b48b44 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:18.877358 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf1ad01-636a-46bb-85d3-895fc1b48b44 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:18.879588 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf1ad01-636a-46bb-85d3-895fc1b48b44 service neutron] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:18.898286 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1096/2212] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 14:43:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:43:19.350475 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6232d4d-5d01-4440-85ec-a668acc21b51 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:19.352380 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-b6232d4d-5d01-4440-85ec-a668acc21b51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:43:19.375353 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6232d4d-5d01-4440-85ec-a668acc21b51 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:19.381819 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a52c961-cb64-4bb7-a130-93b40d2ddcfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:19.382965 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a52c961-cb64-4bb7-a130-93b40d2ddcfd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:19.383422 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a52c961-cb64-4bb7-a130-93b40d2ddcfd admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:19.383939 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a52c961-cb64-4bb7-a130-93b40d2ddcfd admin admin] PATH_INFO: `/v3/projects/3296b25f4e7c4f96b6219294549c6cf6` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:19.385994 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a52c961-cb64-4bb7-a130-93b40d2ddcfd admin admin] RBAC: Authorizing `identity:delete_project(project_id=3296b25f4e7c4f96b6219294549c6cf6)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:19.388084 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a52c961-cb64-4bb7-a130-93b40d2ddcfd admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:19.465645 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-2a52c961-cb64-4bb7-a130-93b40d2ddcfd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3296b25f4e7c4f96b6219294549c6cf6', 'request_id': 'req-2a52c961-cb64-4bb7-a130-93b40d2ddcfd'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:19.475860 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-2a52c961-cb64-4bb7-a130-93b40d2ddcfd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3296b25f4e7c4f96b6219294549c6cf6', 'request_id': 'req-2a52c961-cb64-4bb7-a130-93b40d2ddcfd'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:19.486872 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-2a52c961-cb64-4bb7-a130-93b40d2ddcfd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3296b25f4e7c4f96b6219294549c6cf6', 'request_id': 'req-2a52c961-cb64-4bb7-a130-93b40d2ddcfd'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:19.507514 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-2a52c961-cb64-4bb7-a130-93b40d2ddcfd admin admin] The token cache is being invalidate because project 3296b25f4e7c4f96b6219294549c6cf6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80475) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 14:43:19.508088 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-2a52c961-cb64-4bb7-a130-93b40d2ddcfd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:19.509124 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-2a52c961-cb64-4bb7-a130-93b40d2ddcfd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:19.511308 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1117/2213] 10.222.0.67 () {58 vars in 1232 bytes} [Wed May 25 14:43:19 2022] DELETE /identity/v3/projects/3296b25f4e7c4f96b6219294549c6cf6 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:43:19.520107 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18461720-0f11-49c5-b90f-7d362bb5d0f8 None None] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:19.521739 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18461720-0f11-49c5-b90f-7d362bb5d0f8 None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:19.522911 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18461720-0f11-49c5-b90f-7d362bb5d0f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:19.548093 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.auth.core [None req-18461720-0f11-49c5-b90f-7d362bb5d0f8 None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:43:19.549436 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-18461720-0f11-49c5-b90f-7d362bb5d0f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:43:19.559835 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:19.627318 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1097/2214] 10.222.0.67 () {58 vars in 957 bytes} [Wed May 25 14:43:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:43:19.638470 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806a58ec-2e7d-4782-8410-5442c64cdfc6 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:19.638808 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806a58ec-2e7d-4782-8410-5442c64cdfc6 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:19.639158 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806a58ec-2e7d-4782-8410-5442c64cdfc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:19.662565 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-806a58ec-2e7d-4782-8410-5442c64cdfc6 None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:43:19.663957 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-806a58ec-2e7d-4782-8410-5442c64cdfc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:43:19.672800 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1118/2215] 10.222.0.67 () {58 vars in 957 bytes} [Wed May 25 14:43:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:43:19.677302 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18461720-0f11-49c5-b90f-7d362bb5d0f8 None None] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:19.687434 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18461720-0f11-49c5-b90f-7d362bb5d0f8 None None] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:19.692331 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b75017-3e40-4b95-a6a7-bc7b24dc77ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:19.692983 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b75017-3e40-4b95-a6a7-bc7b24dc77ba admin admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:19.693271 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b75017-3e40-4b95-a6a7-bc7b24dc77ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:19.693553 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b75017-3e40-4b95-a6a7-bc7b24dc77ba admin admin] PATH_INFO: `/v3/domains` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:19.694297 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b75017-3e40-4b95-a6a7-bc7b24dc77ba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:43:19.694608 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b75017-3e40-4b95-a6a7-bc7b24dc77ba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:19.696258 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b75017-3e40-4b95-a6a7-bc7b24dc77ba admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:19.710776 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1098/2216] 10.222.0.67 () {58 vars in 1152 bytes} [Wed May 25 14:43:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:43:19.715685 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806a58ec-2e7d-4782-8410-5442c64cdfc6 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:19.726133 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806a58ec-2e7d-4782-8410-5442c64cdfc6 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:19.730848 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fc546f-28dc-4975-91ba-7103378e2f50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:19.731541 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fc546f-28dc-4975-91ba-7103378e2f50 admin admin] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:19.731825 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fc546f-28dc-4975-91ba-7103378e2f50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:19.732102 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fc546f-28dc-4975-91ba-7103378e2f50 admin admin] PATH_INFO: `/v3/projects` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:19.732796 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fc546f-28dc-4975-91ba-7103378e2f50 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:19.734754 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fc546f-28dc-4975-91ba-7103378e2f50 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:19.760631 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1119/2217] 10.222.0.67 () {60 vars in 1152 bytes} [Wed May 25 14:43:19 2022] POST /identity/v3/projects => generated 385 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:43:19.765071 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b75017-3e40-4b95-a6a7-bc7b24dc77ba admin admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:19.776469 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b75017-3e40-4b95-a6a7-bc7b24dc77ba admin admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:19.848724 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c6900b-e9db-4a6e-927f-38c54f144afd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:19.849407 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c6900b-e9db-4a6e-927f-38c54f144afd admin admin] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:19.849692 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c6900b-e9db-4a6e-927f-38c54f144afd admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:19.849973 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c6900b-e9db-4a6e-927f-38c54f144afd admin admin] PATH_INFO: `/v3/users` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:19.850786 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c6900b-e9db-4a6e-927f-38c54f144afd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:19.853098 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c6900b-e9db-4a6e-927f-38c54f144afd admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:19.875781 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1099/2218] 10.222.0.67 () {60 vars in 1143 bytes} [Wed May 25 14:43:19 2022] POST /identity/v3/users => generated 293 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:43:19.880303 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fc546f-28dc-4975-91ba-7103378e2f50 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:19.892396 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fc546f-28dc-4975-91ba-7103378e2f50 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:19.897252 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afb0958-3ece-49ff-af5d-c94d12bb346f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:19.897922 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afb0958-3ece-49ff-af5d-c94d12bb346f admin admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:19.898294 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afb0958-3ece-49ff-af5d-c94d12bb346f admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:19.898484 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afb0958-3ece-49ff-af5d-c94d12bb346f admin admin] PATH_INFO: `/v3/roles` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:19.899280 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afb0958-3ece-49ff-af5d-c94d12bb346f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:19.901058 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afb0958-3ece-49ff-af5d-c94d12bb346f admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:19.912987 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1120/2219] 10.222.0.67 () {58 vars in 1121 bytes} [Wed May 25 14:43:19 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:43:19.917627 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c6900b-e9db-4a6e-927f-38c54f144afd admin admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:19.928000 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c6900b-e9db-4a6e-927f-38c54f144afd admin admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:19.932883 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ae1195-79ed-439e-af44-fbed5d983886 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:19.933554 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ae1195-79ed-439e-af44-fbed5d983886 admin admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:19.933902 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ae1195-79ed-439e-af44-fbed5d983886 admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:19.934189 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ae1195-79ed-439e-af44-fbed5d983886 admin admin] PATH_INFO: `/v3/roles` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:19.934980 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ae1195-79ed-439e-af44-fbed5d983886 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:19.936711 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ae1195-79ed-439e-af44-fbed5d983886 admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:19.948578 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1100/2220] 10.222.0.67 () {58 vars in 1121 bytes} [Wed May 25 14:43:19 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:43:19.952878 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afb0958-3ece-49ff-af5d-c94d12bb346f admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:19.964528 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afb0958-3ece-49ff-af5d-c94d12bb346f admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:19.971251 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e456b698-7bd3-4cba-bf25-3e77ca2d32bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:19.972753 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e456b698-7bd3-4cba-bf25-3e77ca2d32bd admin admin] REQUEST_METHOD: `PUT` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:19.973112 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e456b698-7bd3-4cba-bf25-3e77ca2d32bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:19.973410 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e456b698-7bd3-4cba-bf25-3e77ca2d32bd admin admin] PATH_INFO: `/v3/projects/af7847039e574008a372279c28d9200f/users/1cdbd342d59548118ade365d352d2eaa/roles/48808901834b4d5eab2c7e6b5b03791e` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:19.990566 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e456b698-7bd3-4cba-bf25-3e77ca2d32bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=af7847039e574008a372279c28d9200f, user_id=1cdbd342d59548118ade365d352d2eaa, role_id=48808901834b4d5eab2c7e6b5b03791e)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:19.993491 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e456b698-7bd3-4cba-bf25-3e77ca2d32bd admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:20.011215 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1121/2221] 10.222.0.67 () {60 vars in 1482 bytes} [Wed May 25 14:43:19 2022] PUT /identity/v3/projects/af7847039e574008a372279c28d9200f/users/1cdbd342d59548118ade365d352d2eaa/roles/48808901834b4d5eab2c7e6b5b03791e => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:43:20.018361 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f961793-fd1b-4780-9b8c-16d3abe9d939 None None] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:20.018734 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f961793-fd1b-4780-9b8c-16d3abe9d939 None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:20.019174 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f961793-fd1b-4780-9b8c-16d3abe9d939 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:20.045515 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.auth.core [None req-9f961793-fd1b-4780-9b8c-16d3abe9d939 None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:43:20.047162 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-9f961793-fd1b-4780-9b8c-16d3abe9d939 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:43:20.127312 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1101/2222] 10.222.0.67 () {58 vars in 957 bytes} [Wed May 25 14:43:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:43:20.140062 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e456b698-7bd3-4cba-bf25-3e77ca2d32bd admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:20.142539 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-e456b698-7bd3-4cba-bf25-3e77ca2d32bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:43:20.179916 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:20.238217 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e456b698-7bd3-4cba-bf25-3e77ca2d32bd admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:20.242775 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcb3f10-5256-4271-9f9c-bf656dc17d64 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b68eed985c7b49839bcdd173186ad4ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfe93ee8d32a441295efc0b885de4bd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:20.243529 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcb3f10-5256-4271-9f9c-bf656dc17d64 service neutron] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:20.243815 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcb3f10-5256-4271-9f9c-bf656dc17d64 service neutron] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:20.244046 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcb3f10-5256-4271-9f9c-bf656dc17d64 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:20.256121 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcb3f10-5256-4271-9f9c-bf656dc17d64 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:20.258130 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcb3f10-5256-4271-9f9c-bf656dc17d64 service neutron] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:20.269313 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1122/2223] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 14:43:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 14:43:26.319392 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c4bc7b-e5a0-476b-ae80-720a46e03a61 None None] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:26.320297 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c4bc7b-e5a0-476b-ae80-720a46e03a61 None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:26.320663 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c4bc7b-e5a0-476b-ae80-720a46e03a61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:26.361753 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.auth.core [None req-25c4bc7b-e5a0-476b-ae80-720a46e03a61 None None] MFA Rules not processed for user `1cdbd342d59548118ade365d352d2eaa`. Rule list: `[]` (Enabled: `True`). {{(pid=80474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:43:26.363251 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-25c4bc7b-e5a0-476b-ae80-720a46e03a61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:43:26.378575 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:26.477099 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1102/2224] 10.222.0.67 () {58 vars in 957 bytes} [Wed May 25 14:43:26 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 14:43:26.484276 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcb3f10-5256-4271-9f9c-bf656dc17d64 service neutron] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:26.499214 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcb3f10-5256-4271-9f9c-bf656dc17d64 service neutron] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:26.507451 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba041696-c465-4387-8c18-8376b0784874 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:26.508776 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba041696-c465-4387-8c18-8376b0784874 admin admin] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:26.509577 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba041696-c465-4387-8c18-8376b0784874 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:26.510402 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba041696-c465-4387-8c18-8376b0784874 admin admin] PATH_INFO: `/v3/projects` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:26.513035 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba041696-c465-4387-8c18-8376b0784874 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:26.519188 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba041696-c465-4387-8c18-8376b0784874 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:26.564358 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1123/2225] 10.222.0.67 () {60 vars in 1152 bytes} [Wed May 25 14:43:26 2022] POST /identity/v3/projects => generated 385 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:43:26.569005 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c4bc7b-e5a0-476b-ae80-720a46e03a61 None None] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:26.595092 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c4bc7b-e5a0-476b-ae80-720a46e03a61 None None] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:26.755031 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214a4fdd-0a84-4908-8c4d-4abdbd01a745 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:26.755813 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214a4fdd-0a84-4908-8c4d-4abdbd01a745 admin admin] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:26.756125 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214a4fdd-0a84-4908-8c4d-4abdbd01a745 admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:26.756448 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214a4fdd-0a84-4908-8c4d-4abdbd01a745 admin admin] PATH_INFO: `/v3/users` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:26.757501 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214a4fdd-0a84-4908-8c4d-4abdbd01a745 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:26.759732 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214a4fdd-0a84-4908-8c4d-4abdbd01a745 admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:26.849169 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba041696-c465-4387-8c18-8376b0784874 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:26.851618 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-ba041696-c465-4387-8c18-8376b0784874 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:43:26.856867 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1103/2226] 10.222.0.67 () {60 vars in 1143 bytes} [Wed May 25 14:43:26 2022] POST /identity/v3/users => generated 299 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:43:26.868227 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214a4fdd-0a84-4908-8c4d-4abdbd01a745 admin admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:26.894521 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba041696-c465-4387-8c18-8376b0784874 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:26.896405 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214a4fdd-0a84-4908-8c4d-4abdbd01a745 admin admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:26.902730 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee99def-7e63-4735-bfd1-b1d2f2fcb5ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:26.904292 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee99def-7e63-4735-bfd1-b1d2f2fcb5ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:26.904829 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee99def-7e63-4735-bfd1-b1d2f2fcb5ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:26.905369 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee99def-7e63-4735-bfd1-b1d2f2fcb5ec admin admin] PATH_INFO: `/v3/users/a410509c46324181afa917494917c850` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:26.907135 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee99def-7e63-4735-bfd1-b1d2f2fcb5ec admin admin] RBAC: Authorizing `identity:delete_user(user_id=a410509c46324181afa917494917c850)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:26.908794 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a645312f-56a1-4952-829c-190dd96cd34a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:26.909932 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a645312f-56a1-4952-829c-190dd96cd34a admin admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:26.910287 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee99def-7e63-4735-bfd1-b1d2f2fcb5ec admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:26.910398 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a645312f-56a1-4952-829c-190dd96cd34a admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:26.910814 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a645312f-56a1-4952-829c-190dd96cd34a admin admin] PATH_INFO: `/v3/roles` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:26.912119 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a645312f-56a1-4952-829c-190dd96cd34a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:26.915712 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a645312f-56a1-4952-829c-190dd96cd34a admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:26.933327 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1104/2227] 10.222.0.67 () {58 vars in 1121 bytes} [Wed May 25 14:43:26 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:43:26.939923 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a645312f-56a1-4952-829c-190dd96cd34a admin admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:26.956273 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a645312f-56a1-4952-829c-190dd96cd34a admin admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:26.963402 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db85030-fe36-4503-a219-af6f6aeb7b4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:26.964553 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db85030-fe36-4503-a219-af6f6aeb7b4c admin admin] REQUEST_METHOD: `PUT` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:26.965072 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db85030-fe36-4503-a219-af6f6aeb7b4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:26.965702 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db85030-fe36-4503-a219-af6f6aeb7b4c admin admin] PATH_INFO: `/v3/projects/59a4afdc9aa14cea895992e027b80c86/users/5b6fbc2e38034543aae97b06854f5042/roles/399893e19eac4ab5a8e596f7c07be13c` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:26.989821 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db85030-fe36-4503-a219-af6f6aeb7b4c admin admin] RBAC: Authorizing `identity:create_grant(project_id=59a4afdc9aa14cea895992e027b80c86, user_id=5b6fbc2e38034543aae97b06854f5042, role_id=399893e19eac4ab5a8e596f7c07be13c)` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:26.993615 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db85030-fe36-4503-a219-af6f6aeb7b4c admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:27.002339 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-9ee99def-7e63-4735-bfd1-b1d2f2fcb5ec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a410509c46324181afa917494917c850'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:27.013409 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-9ee99def-7e63-4735-bfd1-b1d2f2fcb5ec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a410509c46324181afa917494917c850'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:27.013748 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1105/2228] 10.222.0.67 () {60 vars in 1482 bytes} [Wed May 25 14:43:26 2022] PUT /identity/v3/projects/59a4afdc9aa14cea895992e027b80c86/users/5b6fbc2e38034543aae97b06854f5042/roles/399893e19eac4ab5a8e596f7c07be13c => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:43:27.018198 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-9ee99def-7e63-4735-bfd1-b1d2f2fcb5ec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a410509c46324181afa917494917c850'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:27.020710 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db85030-fe36-4503-a219-af6f6aeb7b4c admin admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:27.026071 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-0db85030-fe36-4503-a219-af6f6aeb7b4c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:43:27.031768 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-9ee99def-7e63-4735-bfd1-b1d2f2fcb5ec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a410509c46324181afa917494917c850'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:27.055046 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-9ee99def-7e63-4735-bfd1-b1d2f2fcb5ec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a410509c46324181afa917494917c850'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:27.069719 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1124/2229] 10.222.0.67 () {58 vars in 1223 bytes} [Wed May 25 14:43:26 2022] DELETE /identity/v3/users/a410509c46324181afa917494917c850 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:43:27.157636 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db85030-fe36-4503-a219-af6f6aeb7b4c admin admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:27.179845 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:27.308476 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57e42d7-c153-41a9-96fb-81c3928a7920 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:27.310045 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57e42d7-c153-41a9-96fb-81c3928a7920 admin admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:27.310647 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57e42d7-c153-41a9-96fb-81c3928a7920 admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:27.315065 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57e42d7-c153-41a9-96fb-81c3928a7920 admin admin] PATH_INFO: `/v3/roles` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:27.315065 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57e42d7-c153-41a9-96fb-81c3928a7920 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:27.315065 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57e42d7-c153-41a9-96fb-81c3928a7920 admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:27.333577 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1106/2230] 10.222.0.67 () {58 vars in 1121 bytes} [Wed May 25 14:43:27 2022] GET /identity/v3/roles => generated 1420 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:43:27.334408 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee99def-7e63-4735-bfd1-b1d2f2fcb5ec admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:27.355780 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee99def-7e63-4735-bfd1-b1d2f2fcb5ec admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:27.368315 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2465a856-92bc-4db6-8a3f-f463ffe89c79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:27.369360 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2465a856-92bc-4db6-8a3f-f463ffe89c79 admin admin] REQUEST_METHOD: `PUT` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:27.369660 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2465a856-92bc-4db6-8a3f-f463ffe89c79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:27.370002 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2465a856-92bc-4db6-8a3f-f463ffe89c79 admin admin] PATH_INFO: `/v3/projects/59a4afdc9aa14cea895992e027b80c86/users/5b6fbc2e38034543aae97b06854f5042/roles/399893e19eac4ab5a8e596f7c07be13c` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:27.374279 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2465a856-92bc-4db6-8a3f-f463ffe89c79 admin admin] RBAC: Authorizing `identity:create_grant(project_id=59a4afdc9aa14cea895992e027b80c86, user_id=5b6fbc2e38034543aae97b06854f5042, role_id=399893e19eac4ab5a8e596f7c07be13c)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:27.385176 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2465a856-92bc-4db6-8a3f-f463ffe89c79 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:27.414782 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1125/2231] 10.222.0.67 () {60 vars in 1482 bytes} [Wed May 25 14:43:27 2022] PUT /identity/v3/projects/59a4afdc9aa14cea895992e027b80c86/users/5b6fbc2e38034543aae97b06854f5042/roles/399893e19eac4ab5a8e596f7c07be13c => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:43:27.534166 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57e42d7-c153-41a9-96fb-81c3928a7920 admin admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:27.535938 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-f57e42d7-c153-41a9-96fb-81c3928a7920 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:43:27.575254 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57e42d7-c153-41a9-96fb-81c3928a7920 admin admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:27.702513 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d51e54-560f-4bb8-aa15-bc204627b2dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:27.703996 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d51e54-560f-4bb8-aa15-bc204627b2dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:27.704286 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d51e54-560f-4bb8-aa15-bc204627b2dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:27.704838 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d51e54-560f-4bb8-aa15-bc204627b2dd admin admin] PATH_INFO: `/v3/projects/c2e80dd462234856a31ad57c6e8c27b7` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:27.706526 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d51e54-560f-4bb8-aa15-bc204627b2dd admin admin] RBAC: Authorizing `identity:delete_project(project_id=c2e80dd462234856a31ad57c6e8c27b7)` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:27.708929 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d51e54-560f-4bb8-aa15-bc204627b2dd admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:27.798314 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-66d51e54-560f-4bb8-aa15-bc204627b2dd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c2e80dd462234856a31ad57c6e8c27b7', 'request_id': 'req-66d51e54-560f-4bb8-aa15-bc204627b2dd'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:27.809220 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-66d51e54-560f-4bb8-aa15-bc204627b2dd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c2e80dd462234856a31ad57c6e8c27b7', 'request_id': 'req-66d51e54-560f-4bb8-aa15-bc204627b2dd'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:27.821155 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-66d51e54-560f-4bb8-aa15-bc204627b2dd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c2e80dd462234856a31ad57c6e8c27b7', 'request_id': 'req-66d51e54-560f-4bb8-aa15-bc204627b2dd'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:27.842330 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-66d51e54-560f-4bb8-aa15-bc204627b2dd admin admin] The token cache is being invalidate because project c2e80dd462234856a31ad57c6e8c27b7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80474) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 14:43:27.842721 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-66d51e54-560f-4bb8-aa15-bc204627b2dd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:27.843769 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-66d51e54-560f-4bb8-aa15-bc204627b2dd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:27.846154 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1107/2232] 10.222.0.67 () {58 vars in 1232 bytes} [Wed May 25 14:43:27 2022] DELETE /identity/v3/projects/c2e80dd462234856a31ad57c6e8c27b7 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:43:27.850229 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2465a856-92bc-4db6-8a3f-f463ffe89c79 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:27.852393 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-2465a856-92bc-4db6-8a3f-f463ffe89c79 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:43:27.873711 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2465a856-92bc-4db6-8a3f-f463ffe89c79 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:27.963587 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4215c1-6b5e-4fe9-ae07-0f96bf6484fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:27.964720 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4215c1-6b5e-4fe9-ae07-0f96bf6484fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:27.965122 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4215c1-6b5e-4fe9-ae07-0f96bf6484fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:27.965486 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4215c1-6b5e-4fe9-ae07-0f96bf6484fc admin admin] PATH_INFO: `/v3/users/12a6c9016d874523a1f2885d46756763` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:27.967730 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4215c1-6b5e-4fe9-ae07-0f96bf6484fc admin admin] RBAC: Authorizing `identity:delete_user(user_id=12a6c9016d874523a1f2885d46756763)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:27.970362 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4215c1-6b5e-4fe9-ae07-0f96bf6484fc admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:27.976812 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:28.045738 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-5d4215c1-6b5e-4fe9-ae07-0f96bf6484fc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '12a6c9016d874523a1f2885d46756763'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:28.057572 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-5d4215c1-6b5e-4fe9-ae07-0f96bf6484fc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '12a6c9016d874523a1f2885d46756763'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:28.058898 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-5d4215c1-6b5e-4fe9-ae07-0f96bf6484fc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '12a6c9016d874523a1f2885d46756763'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:28.076032 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-5d4215c1-6b5e-4fe9-ae07-0f96bf6484fc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '12a6c9016d874523a1f2885d46756763'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:28.100869 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-5d4215c1-6b5e-4fe9-ae07-0f96bf6484fc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '12a6c9016d874523a1f2885d46756763'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:28.112986 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1126/2233] 10.222.0.67 () {58 vars in 1223 bytes} [Wed May 25 14:43:27 2022] DELETE /identity/v3/users/12a6c9016d874523a1f2885d46756763 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 14:43:28.345836 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d51e54-560f-4bb8-aa15-bc204627b2dd admin admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:28.365159 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d51e54-560f-4bb8-aa15-bc204627b2dd admin admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:28.428861 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:28.486392 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41571560-8005-4b8a-9986-e3b04f476dc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:28.487077 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41571560-8005-4b8a-9986-e3b04f476dc9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:28.487397 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41571560-8005-4b8a-9986-e3b04f476dc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:28.487859 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41571560-8005-4b8a-9986-e3b04f476dc9 admin admin] PATH_INFO: `/v3/projects/b0f47d81a5b14df7909cd8d606ccc277` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:28.490149 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41571560-8005-4b8a-9986-e3b04f476dc9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b0f47d81a5b14df7909cd8d606ccc277)` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:28.496391 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41571560-8005-4b8a-9986-e3b04f476dc9 admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:28.635559 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-41571560-8005-4b8a-9986-e3b04f476dc9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b0f47d81a5b14df7909cd8d606ccc277', 'request_id': 'req-41571560-8005-4b8a-9986-e3b04f476dc9'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:28.650893 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-41571560-8005-4b8a-9986-e3b04f476dc9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b0f47d81a5b14df7909cd8d606ccc277', 'request_id': 'req-41571560-8005-4b8a-9986-e3b04f476dc9'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:28.677671 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-41571560-8005-4b8a-9986-e3b04f476dc9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b0f47d81a5b14df7909cd8d606ccc277', 'request_id': 'req-41571560-8005-4b8a-9986-e3b04f476dc9'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:28.704662 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-41571560-8005-4b8a-9986-e3b04f476dc9 admin admin] The token cache is being invalidate because project b0f47d81a5b14df7909cd8d606ccc277 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80474) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 14:43:28.704946 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-41571560-8005-4b8a-9986-e3b04f476dc9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:28.705962 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-41571560-8005-4b8a-9986-e3b04f476dc9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:28.710162 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1108/2234] 10.222.0.67 () {58 vars in 1232 bytes} [Wed May 25 14:43:28 2022] DELETE /identity/v3/projects/b0f47d81a5b14df7909cd8d606ccc277 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:43:28.714091 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa74fa1-45aa-475a-825c-c3aeea403db2 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:28.714400 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa74fa1-45aa-475a-825c-c3aeea403db2 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:28.714857 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa74fa1-45aa-475a-825c-c3aeea403db2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:28.771374 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-3fa74fa1-45aa-475a-825c-c3aeea403db2 None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:43:28.773929 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-3fa74fa1-45aa-475a-825c-c3aeea403db2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:43:28.905312 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1127/2235] 10.222.0.67 () {58 vars in 957 bytes} [Wed May 25 14:43:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:43:28.914724 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cb999d-026b-431b-8f67-cce610468779 None None] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:28.915720 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cb999d-026b-431b-8f67-cce610468779 None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:28.915720 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cb999d-026b-431b-8f67-cce610468779 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:28.942226 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.auth.core [None req-98cb999d-026b-431b-8f67-cce610468779 None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:43:28.943511 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-98cb999d-026b-431b-8f67-cce610468779 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:43:28.957650 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1109/2236] 10.222.0.67 () {58 vars in 957 bytes} [Wed May 25 14:43:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:43:28.958842 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa74fa1-45aa-475a-825c-c3aeea403db2 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:28.972355 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa74fa1-45aa-475a-825c-c3aeea403db2 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:28.979853 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d016b0-0aa3-4d0d-9507-31b20b21cd79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:28.980827 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d016b0-0aa3-4d0d-9507-31b20b21cd79 admin admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:28.981193 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d016b0-0aa3-4d0d-9507-31b20b21cd79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:28.981481 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d016b0-0aa3-4d0d-9507-31b20b21cd79 admin admin] PATH_INFO: `/v3/domains` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:28.982611 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d016b0-0aa3-4d0d-9507-31b20b21cd79 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:43:28.982611 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d016b0-0aa3-4d0d-9507-31b20b21cd79 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:28.984522 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d016b0-0aa3-4d0d-9507-31b20b21cd79 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:29.001750 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1128/2237] 10.222.0.67 () {58 vars in 1152 bytes} [Wed May 25 14:43:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:43:29.005305 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cb999d-026b-431b-8f67-cce610468779 None None] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:29.020455 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cb999d-026b-431b-8f67-cce610468779 None None] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:29.028516 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6259806-9173-4090-a7d9-1230338cc1a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:29.030240 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6259806-9173-4090-a7d9-1230338cc1a5 admin admin] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:29.030700 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6259806-9173-4090-a7d9-1230338cc1a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:29.030985 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6259806-9173-4090-a7d9-1230338cc1a5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:29.032479 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6259806-9173-4090-a7d9-1230338cc1a5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:29.034445 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6259806-9173-4090-a7d9-1230338cc1a5 admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:29.072727 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1110/2238] 10.222.0.67 () {60 vars in 1152 bytes} [Wed May 25 14:43:29 2022] POST /identity/v3/projects => generated 367 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 14:43:29.076565 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d016b0-0aa3-4d0d-9507-31b20b21cd79 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:29.090291 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d016b0-0aa3-4d0d-9507-31b20b21cd79 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:29.213000 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70efe27-45cc-45ef-99d3-b68c6482dff0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:29.215684 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70efe27-45cc-45ef-99d3-b68c6482dff0 admin admin] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:29.216571 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70efe27-45cc-45ef-99d3-b68c6482dff0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:29.217441 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70efe27-45cc-45ef-99d3-b68c6482dff0 admin admin] PATH_INFO: `/v3/users` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:29.219758 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70efe27-45cc-45ef-99d3-b68c6482dff0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:29.224644 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70efe27-45cc-45ef-99d3-b68c6482dff0 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:29.243182 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:29.276549 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1129/2239] 10.222.0.67 () {60 vars in 1143 bytes} [Wed May 25 14:43:29 2022] POST /identity/v3/users => generated 284 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:43:29.279297 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6259806-9173-4090-a7d9-1230338cc1a5 admin admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:29.311127 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6259806-9173-4090-a7d9-1230338cc1a5 admin admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:29.330824 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df088785-5628-4f78-ae25-e8d9f80c69eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:29.331705 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df088785-5628-4f78-ae25-e8d9f80c69eb admin admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:29.331978 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df088785-5628-4f78-ae25-e8d9f80c69eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:29.332263 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df088785-5628-4f78-ae25-e8d9f80c69eb admin admin] PATH_INFO: `/v3/roles` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:29.333097 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df088785-5628-4f78-ae25-e8d9f80c69eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:29.334840 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df088785-5628-4f78-ae25-e8d9f80c69eb admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:29.362950 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1111/2240] 10.222.0.67 () {58 vars in 1121 bytes} [Wed May 25 14:43:29 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:43:29.370305 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70efe27-45cc-45ef-99d3-b68c6482dff0 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:29.399295 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70efe27-45cc-45ef-99d3-b68c6482dff0 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:29.415159 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73e6d19-4a0e-439c-9395-1f29c7efd8c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:29.415760 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73e6d19-4a0e-439c-9395-1f29c7efd8c9 admin admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:29.416070 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73e6d19-4a0e-439c-9395-1f29c7efd8c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:29.416377 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73e6d19-4a0e-439c-9395-1f29c7efd8c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:29.417161 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73e6d19-4a0e-439c-9395-1f29c7efd8c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:29.418854 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73e6d19-4a0e-439c-9395-1f29c7efd8c9 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:29.439056 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1130/2241] 10.222.0.67 () {58 vars in 1121 bytes} [Wed May 25 14:43:29 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:43:29.444640 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df088785-5628-4f78-ae25-e8d9f80c69eb admin admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:29.457665 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df088785-5628-4f78-ae25-e8d9f80c69eb admin admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:29.466038 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17236959-5ac5-458b-b2f1-d45c5ec771ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:29.468130 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17236959-5ac5-458b-b2f1-d45c5ec771ce admin admin] REQUEST_METHOD: `PUT` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:29.468530 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17236959-5ac5-458b-b2f1-d45c5ec771ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:29.469158 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17236959-5ac5-458b-b2f1-d45c5ec771ce admin admin] PATH_INFO: `/v3/projects/c38c399c26e24429a427bfa21b85c898/users/a0057404b54d4b63b4fe99acbde34588/roles/48808901834b4d5eab2c7e6b5b03791e` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:29.491851 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17236959-5ac5-458b-b2f1-d45c5ec771ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=c38c399c26e24429a427bfa21b85c898, user_id=a0057404b54d4b63b4fe99acbde34588, role_id=48808901834b4d5eab2c7e6b5b03791e)` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:29.495273 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17236959-5ac5-458b-b2f1-d45c5ec771ce admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:29.514827 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1112/2242] 10.222.0.67 () {60 vars in 1482 bytes} [Wed May 25 14:43:29 2022] PUT /identity/v3/projects/c38c399c26e24429a427bfa21b85c898/users/a0057404b54d4b63b4fe99acbde34588/roles/48808901834b4d5eab2c7e6b5b03791e => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:43:29.526226 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94048b5-2310-4160-9db3-b2874f8cdd11 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:29.527221 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94048b5-2310-4160-9db3-b2874f8cdd11 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:29.528270 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94048b5-2310-4160-9db3-b2874f8cdd11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:29.574869 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-d94048b5-2310-4160-9db3-b2874f8cdd11 None None] MFA Rules not processed for user `a0057404b54d4b63b4fe99acbde34588`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:43:29.576603 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-d94048b5-2310-4160-9db3-b2874f8cdd11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:43:29.708427 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1131/2243] 10.222.0.67 () {58 vars in 957 bytes} [Wed May 25 14:43:29 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:43:29.718328 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17236959-5ac5-458b-b2f1-d45c5ec771ce admin admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:29.722015 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-17236959-5ac5-458b-b2f1-d45c5ec771ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:43:29.845624 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17236959-5ac5-458b-b2f1-d45c5ec771ce admin admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:29.860671 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6cc8ab-9560-4843-9548-566ee66c2d87 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5e4d67668ce40509e057f4f4c994521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfe93ee8d32a441295efc0b885de4bd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:29.860671 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6cc8ab-9560-4843-9548-566ee66c2d87 service glance] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:29.860671 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6cc8ab-9560-4843-9548-566ee66c2d87 service glance] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:29.860671 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6cc8ab-9560-4843-9548-566ee66c2d87 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:29.877170 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6cc8ab-9560-4843-9548-566ee66c2d87 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:29.879274 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6cc8ab-9560-4843-9548-566ee66c2d87 service glance] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:29.900814 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1113/2244] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 14:43:29 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:43:31.647194 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94048b5-2310-4160-9db3-b2874f8cdd11 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:31.649197 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-d94048b5-2310-4160-9db3-b2874f8cdd11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:43:31.793730 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94048b5-2310-4160-9db3-b2874f8cdd11 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:31.803941 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c90632-7059-436d-a52e-c7a057614e57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:31.804958 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c90632-7059-436d-a52e-c7a057614e57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:31.805353 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c90632-7059-436d-a52e-c7a057614e57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:31.805740 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c90632-7059-436d-a52e-c7a057614e57 admin admin] PATH_INFO: `/v3/users/6312dfa9e2ca4d6bbcccb83cd18cf06a` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:31.807491 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c90632-7059-436d-a52e-c7a057614e57 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6312dfa9e2ca4d6bbcccb83cd18cf06a)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:31.811277 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c90632-7059-436d-a52e-c7a057614e57 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:31.932429 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-64c90632-7059-436d-a52e-c7a057614e57 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6312dfa9e2ca4d6bbcccb83cd18cf06a'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:31.952780 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-64c90632-7059-436d-a52e-c7a057614e57 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6312dfa9e2ca4d6bbcccb83cd18cf06a'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:31.954471 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-64c90632-7059-436d-a52e-c7a057614e57 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6312dfa9e2ca4d6bbcccb83cd18cf06a'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:31.973495 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-64c90632-7059-436d-a52e-c7a057614e57 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6312dfa9e2ca4d6bbcccb83cd18cf06a'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:31.989586 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:INSERT=3,keystone:SELECT=88,keystone:DELETE=9 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:32.015027 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-64c90632-7059-436d-a52e-c7a057614e57 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6312dfa9e2ca4d6bbcccb83cd18cf06a'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:32.044964 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1132/2245] 10.222.0.67 () {58 vars in 1223 bytes} [Wed May 25 14:43:31 2022] DELETE /identity/v3/users/6312dfa9e2ca4d6bbcccb83cd18cf06a => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:43:32.047777 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd28c50-02db-4e65-afdf-9012c86be25b None None] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:32.048862 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd28c50-02db-4e65-afdf-9012c86be25b None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:32.048862 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd28c50-02db-4e65-afdf-9012c86be25b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:32.065639 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:32.085466 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.auth.core [None req-ffd28c50-02db-4e65-afdf-9012c86be25b None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:43:32.086883 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-ffd28c50-02db-4e65-afdf-9012c86be25b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:43:32.219582 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1114/2246] 10.222.0.67 () {58 vars in 957 bytes} [Wed May 25 14:43:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:43:32.237752 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c90632-7059-436d-a52e-c7a057614e57 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:32.239351 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-64c90632-7059-436d-a52e-c7a057614e57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:43:32.364879 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c90632-7059-436d-a52e-c7a057614e57 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:32.379582 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb236e01-e376-4f1c-ab33-f0a8f122030e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b68eed985c7b49839bcdd173186ad4ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfe93ee8d32a441295efc0b885de4bd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:32.380186 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb236e01-e376-4f1c-ab33-f0a8f122030e service neutron] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:32.380471 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb236e01-e376-4f1c-ab33-f0a8f122030e service neutron] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:32.380746 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb236e01-e376-4f1c-ab33-f0a8f122030e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:32.402045 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb236e01-e376-4f1c-ab33-f0a8f122030e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:32.402045 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb236e01-e376-4f1c-ab33-f0a8f122030e service neutron] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:32.426524 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1133/2247] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 14:43:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 14:43:33.795608 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd28c50-02db-4e65-afdf-9012c86be25b None None] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:33.800739 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-ffd28c50-02db-4e65-afdf-9012c86be25b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:43:33.842323 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd28c50-02db-4e65-afdf-9012c86be25b None None] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:33.869203 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1065b505-caf9-4e9f-afd2-27d05ee9fb79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:33.870979 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1065b505-caf9-4e9f-afd2-27d05ee9fb79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:33.871243 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1065b505-caf9-4e9f-afd2-27d05ee9fb79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:33.871798 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1065b505-caf9-4e9f-afd2-27d05ee9fb79 admin admin] PATH_INFO: `/v3/projects/1aab34685fe841fbb89d73ca035168ae` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:33.873995 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1065b505-caf9-4e9f-afd2-27d05ee9fb79 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1aab34685fe841fbb89d73ca035168ae)` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:33.879330 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1065b505-caf9-4e9f-afd2-27d05ee9fb79 admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:34.076902 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-1065b505-caf9-4e9f-afd2-27d05ee9fb79 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1aab34685fe841fbb89d73ca035168ae', 'request_id': 'req-1065b505-caf9-4e9f-afd2-27d05ee9fb79'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:34.117222 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-1065b505-caf9-4e9f-afd2-27d05ee9fb79 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1aab34685fe841fbb89d73ca035168ae', 'request_id': 'req-1065b505-caf9-4e9f-afd2-27d05ee9fb79'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:34.203285 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-1065b505-caf9-4e9f-afd2-27d05ee9fb79 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1aab34685fe841fbb89d73ca035168ae', 'request_id': 'req-1065b505-caf9-4e9f-afd2-27d05ee9fb79'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:34.232116 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-1065b505-caf9-4e9f-afd2-27d05ee9fb79 admin admin] The token cache is being invalidate because project 1aab34685fe841fbb89d73ca035168ae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80474) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 14:43:34.232116 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-1065b505-caf9-4e9f-afd2-27d05ee9fb79 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:34.235918 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-1065b505-caf9-4e9f-afd2-27d05ee9fb79 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:34.240920 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1115/2248] 10.222.0.67 () {58 vars in 1232 bytes} [Wed May 25 14:43:33 2022] DELETE /identity/v3/projects/1aab34685fe841fbb89d73ca035168ae => generated 0 bytes in 445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:43:34.247184 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805114e7-666d-4222-aa55-d51b80495e38 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:34.248015 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805114e7-666d-4222-aa55-d51b80495e38 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:34.248015 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805114e7-666d-4222-aa55-d51b80495e38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:34.304178 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-805114e7-666d-4222-aa55-d51b80495e38 None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:43:34.313260 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-805114e7-666d-4222-aa55-d51b80495e38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:43:34.495683 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1134/2249] 10.222.0.67 () {58 vars in 957 bytes} [Wed May 25 14:43:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:43:34.504188 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3f5bd4-be87-43ad-bc3a-29555f605cb8 None None] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:34.504805 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3f5bd4-be87-43ad-bc3a-29555f605cb8 None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:34.505477 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3f5bd4-be87-43ad-bc3a-29555f605cb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:34.563671 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.auth.core [None req-2d3f5bd4-be87-43ad-bc3a-29555f605cb8 None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:43:34.566267 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-2d3f5bd4-be87-43ad-bc3a-29555f605cb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:43:34.580351 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1116/2250] 10.222.0.67 () {58 vars in 957 bytes} [Wed May 25 14:43:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:43:34.584464 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805114e7-666d-4222-aa55-d51b80495e38 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:34.606537 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805114e7-666d-4222-aa55-d51b80495e38 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:34.628475 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf90f85-d51a-4c18-b784-18c5792d8ab0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:34.630364 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf90f85-d51a-4c18-b784-18c5792d8ab0 admin admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:34.630876 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf90f85-d51a-4c18-b784-18c5792d8ab0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:34.631549 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf90f85-d51a-4c18-b784-18c5792d8ab0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:34.634236 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf90f85-d51a-4c18-b784-18c5792d8ab0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:43:34.635976 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf90f85-d51a-4c18-b784-18c5792d8ab0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:34.641572 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf90f85-d51a-4c18-b784-18c5792d8ab0 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:34.667607 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1135/2251] 10.222.0.67 () {58 vars in 1152 bytes} [Wed May 25 14:43:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:43:34.673108 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3f5bd4-be87-43ad-bc3a-29555f605cb8 None None] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:34.693365 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3f5bd4-be87-43ad-bc3a-29555f605cb8 None None] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:34.716451 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd443629-ef9c-4f41-aa09-798dc508bb27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:34.717930 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd443629-ef9c-4f41-aa09-798dc508bb27 admin admin] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:34.718967 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd443629-ef9c-4f41-aa09-798dc508bb27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:34.719678 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd443629-ef9c-4f41-aa09-798dc508bb27 admin admin] PATH_INFO: `/v3/projects` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:34.728638 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd443629-ef9c-4f41-aa09-798dc508bb27 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:34.741101 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd443629-ef9c-4f41-aa09-798dc508bb27 admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:34.803764 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1117/2252] 10.222.0.67 () {60 vars in 1152 bytes} [Wed May 25 14:43:34 2022] POST /identity/v3/projects => generated 381 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 14:43:34.805744 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf90f85-d51a-4c18-b784-18c5792d8ab0 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:34.818892 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf90f85-d51a-4c18-b784-18c5792d8ab0 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:34.940632 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39bbefe-4e55-45d0-b985-167857502d00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:34.941689 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39bbefe-4e55-45d0-b985-167857502d00 admin admin] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:34.942178 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39bbefe-4e55-45d0-b985-167857502d00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:34.942666 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39bbefe-4e55-45d0-b985-167857502d00 admin admin] PATH_INFO: `/v3/users` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:34.943611 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39bbefe-4e55-45d0-b985-167857502d00 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:34.946294 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39bbefe-4e55-45d0-b985-167857502d00 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:34.993802 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1136/2253] 10.222.0.67 () {60 vars in 1143 bytes} [Wed May 25 14:43:34 2022] POST /identity/v3/users => generated 291 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:43:35.001271 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd443629-ef9c-4f41-aa09-798dc508bb27 admin admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:35.028526 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd443629-ef9c-4f41-aa09-798dc508bb27 admin admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:35.038890 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ee98a3-934a-4c0d-9fba-4dda9b75f3c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:35.039901 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ee98a3-934a-4c0d-9fba-4dda9b75f3c4 admin admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:35.040406 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ee98a3-934a-4c0d-9fba-4dda9b75f3c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:35.040766 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ee98a3-934a-4c0d-9fba-4dda9b75f3c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:35.042082 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ee98a3-934a-4c0d-9fba-4dda9b75f3c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:35.044623 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ee98a3-934a-4c0d-9fba-4dda9b75f3c4 admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:35.060939 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1118/2254] 10.222.0.67 () {58 vars in 1121 bytes} [Wed May 25 14:43:34 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:43:35.068498 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39bbefe-4e55-45d0-b985-167857502d00 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:35.104908 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39bbefe-4e55-45d0-b985-167857502d00 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:35.136307 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c0808e-4f60-4291-ae5e-8647ca687a14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:35.139370 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c0808e-4f60-4291-ae5e-8647ca687a14 admin admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:35.141186 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c0808e-4f60-4291-ae5e-8647ca687a14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:35.141589 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c0808e-4f60-4291-ae5e-8647ca687a14 admin admin] PATH_INFO: `/v3/roles` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:35.142293 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c0808e-4f60-4291-ae5e-8647ca687a14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:35.144016 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c0808e-4f60-4291-ae5e-8647ca687a14 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:35.158327 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:35.173892 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1137/2255] 10.222.0.67 () {58 vars in 1121 bytes} [Wed May 25 14:43:35 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:43:35.179191 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ee98a3-934a-4c0d-9fba-4dda9b75f3c4 admin admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:35.199417 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ee98a3-934a-4c0d-9fba-4dda9b75f3c4 admin admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:35.224458 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5635a44-60da-4a6d-b3e9-6de981bf50c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:35.225652 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5635a44-60da-4a6d-b3e9-6de981bf50c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:35.226127 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5635a44-60da-4a6d-b3e9-6de981bf50c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:35.226486 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5635a44-60da-4a6d-b3e9-6de981bf50c1 admin admin] PATH_INFO: `/v3/projects/e98b5f547ab04825a70e0125c8e44d28/users/2aacb4ee87124e21ba9f2f811f3c65a4/roles/48808901834b4d5eab2c7e6b5b03791e` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:35.300090 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5635a44-60da-4a6d-b3e9-6de981bf50c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e98b5f547ab04825a70e0125c8e44d28, user_id=2aacb4ee87124e21ba9f2f811f3c65a4, role_id=48808901834b4d5eab2c7e6b5b03791e)` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:35.303299 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5635a44-60da-4a6d-b3e9-6de981bf50c1 admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:35.360604 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1119/2256] 10.222.0.67 () {60 vars in 1482 bytes} [Wed May 25 14:43:35 2022] PUT /identity/v3/projects/e98b5f547ab04825a70e0125c8e44d28/users/2aacb4ee87124e21ba9f2f811f3c65a4/roles/48808901834b4d5eab2c7e6b5b03791e => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:43:35.362280 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f699d523-6352-4434-87be-8cea69b50c4a None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:35.363604 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f699d523-6352-4434-87be-8cea69b50c4a None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:35.364216 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f699d523-6352-4434-87be-8cea69b50c4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:35.410292 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-f699d523-6352-4434-87be-8cea69b50c4a None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:43:35.413510 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-f699d523-6352-4434-87be-8cea69b50c4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:43:35.625272 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1138/2257] 10.222.0.67 () {58 vars in 957 bytes} [Wed May 25 14:43:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 14:43:35.654792 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7559456-5965-49ba-8f17-1a08777a68d7 None None] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:35.655209 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7559456-5965-49ba-8f17-1a08777a68d7 None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:35.656925 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7559456-5965-49ba-8f17-1a08777a68d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:35.680940 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f699d523-6352-4434-87be-8cea69b50c4a None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:35.683062 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-f699d523-6352-4434-87be-8cea69b50c4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:43:35.709862 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.auth.core [None req-c7559456-5965-49ba-8f17-1a08777a68d7 None None] MFA Rules not processed for user `5b6fbc2e38034543aae97b06854f5042`. Rule list: `[]` (Enabled: `True`). {{(pid=80474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:43:35.715463 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-c7559456-5965-49ba-8f17-1a08777a68d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:43:35.750233 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:35.843100 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f699d523-6352-4434-87be-8cea69b50c4a None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:35.858513 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a435ffce-b091-4aef-88ea-40ace5e7a6d1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b68eed985c7b49839bcdd173186ad4ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfe93ee8d32a441295efc0b885de4bd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:35.858513 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a435ffce-b091-4aef-88ea-40ace5e7a6d1 service neutron] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:35.858804 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a435ffce-b091-4aef-88ea-40ace5e7a6d1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:35.861249 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a435ffce-b091-4aef-88ea-40ace5e7a6d1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:35.895480 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a435ffce-b091-4aef-88ea-40ace5e7a6d1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:35.897024 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a435ffce-b091-4aef-88ea-40ace5e7a6d1 service neutron] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:35.913386 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1139/2258] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 14:43:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:43:35.933041 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1120/2259] 10.222.0.67 () {58 vars in 957 bytes} [Wed May 25 14:43:35 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:43:35.942307 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a435ffce-b091-4aef-88ea-40ace5e7a6d1 service neutron] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:35.944923 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-a435ffce-b091-4aef-88ea-40ace5e7a6d1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:43:36.148842 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a435ffce-b091-4aef-88ea-40ace5e7a6d1 service neutron] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:36.162947 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c2a192-0fe4-4145-8686-77b8b9db5a58 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5e4d67668ce40509e057f4f4c994521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfe93ee8d32a441295efc0b885de4bd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:36.163693 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c2a192-0fe4-4145-8686-77b8b9db5a58 service glance] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:36.164009 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c2a192-0fe4-4145-8686-77b8b9db5a58 service glance] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:36.164338 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c2a192-0fe4-4145-8686-77b8b9db5a58 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:36.166794 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-a6c2a192-0fe4-4145-8686-77b8b9db5a58 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:43:36.197006 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57044c6a-6df0-4957-a4a2-2ea251dc548b None None] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:36.197309 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57044c6a-6df0-4957-a4a2-2ea251dc548b None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:36.197598 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57044c6a-6df0-4957-a4a2-2ea251dc548b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:36.253695 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.auth.core [None req-57044c6a-6df0-4957-a4a2-2ea251dc548b None None] MFA Rules not processed for user `54a9a5bdd9674c1f9700800609062675`. Rule list: `[]` (Enabled: `True`). {{(pid=80474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:43:36.259190 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-57044c6a-6df0-4957-a4a2-2ea251dc548b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:43:36.339451 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:36.343138 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c2a192-0fe4-4145-8686-77b8b9db5a58 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:36.345142 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c2a192-0fe4-4145-8686-77b8b9db5a58 service glance] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:36.357641 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1140/2260] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 14:43:35 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:43:36.383209 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1121/2261] 10.222.0.67 () {58 vars in 957 bytes} [Wed May 25 14:43:36 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 14:43:36.547953 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a12b25-ac85-4757-8539-3db071d9d265 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:36.548604 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a12b25-ac85-4757-8539-3db071d9d265 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:36.549156 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a12b25-ac85-4757-8539-3db071d9d265 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:36.620774 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-e6a12b25-ac85-4757-8539-3db071d9d265 None None] MFA Rules not processed for user `e03f5bb82ffb41a1b1dde935d093e6f4`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:43:36.622596 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-e6a12b25-ac85-4757-8539-3db071d9d265 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:43:36.721362 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1141/2262] 10.222.0.67 () {58 vars in 1009 bytes} [Wed May 25 14:43:36 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:43:36.775985 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57044c6a-6df0-4957-a4a2-2ea251dc548b None None] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:36.778549 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-57044c6a-6df0-4957-a4a2-2ea251dc548b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:43:36.903474 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57044c6a-6df0-4957-a4a2-2ea251dc548b None None] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:36.909861 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baaf3ccd-493e-4f32-b778-50dbad796845 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbe9e38881834198842a476889678096', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfe93ee8d32a441295efc0b885de4bd7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:36.910677 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaf3ccd-493e-4f32-b778-50dbad796845 service swift] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:36.911123 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaf3ccd-493e-4f32-b778-50dbad796845 service swift] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:36.911487 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaf3ccd-493e-4f32-b778-50dbad796845 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:36.921290 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baaf3ccd-493e-4f32-b778-50dbad796845 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:36.923937 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baaf3ccd-493e-4f32-b778-50dbad796845 service swift] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:36.934746 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1122/2263] 10.222.0.67 () {60 vars in 1384 bytes} [Wed May 25 14:43:36 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 25 14:43:37.042373 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da87eb1-c67c-4028-8c11-364596abea4e None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:37.043059 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da87eb1-c67c-4028-8c11-364596abea4e None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:37.043480 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da87eb1-c67c-4028-8c11-364596abea4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:37.089795 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-1da87eb1-c67c-4028-8c11-364596abea4e None None] MFA Rules not processed for user `2aacb4ee87124e21ba9f2f811f3c65a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:43:37.091377 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-1da87eb1-c67c-4028-8c11-364596abea4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:43:37.202202 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1142/2264] 10.222.0.67 () {58 vars in 957 bytes} [Wed May 25 14:43:37 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:43:37.233433 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baaf3ccd-493e-4f32-b778-50dbad796845 service swift] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:37.237086 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-baaf3ccd-493e-4f32-b778-50dbad796845 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:43:37.423909 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:37.435774 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baaf3ccd-493e-4f32-b778-50dbad796845 service swift] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:37.440414 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242bb83a-25d1-4878-8d1d-221d7e177968 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e462acc9da84a61bb23998dd54e1858', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfe93ee8d32a441295efc0b885de4bd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:37.444518 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242bb83a-25d1-4878-8d1d-221d7e177968 service cinder] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:37.444850 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242bb83a-25d1-4878-8d1d-221d7e177968 service cinder] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:37.445130 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242bb83a-25d1-4878-8d1d-221d7e177968 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:37.465360 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242bb83a-25d1-4878-8d1d-221d7e177968 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:37.466789 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242bb83a-25d1-4878-8d1d-221d7e177968 service cinder] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:37.502073 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1123/2265] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 14:43:37 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 269 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:43:39.133756 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91799c26-0658-4ddc-9ca1-f61bf5eace68 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:39.134632 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91799c26-0658-4ddc-9ca1-f61bf5eace68 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:39.134632 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91799c26-0658-4ddc-9ca1-f61bf5eace68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:39.183037 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-91799c26-0658-4ddc-9ca1-f61bf5eace68 None None] MFA Rules not processed for user `2aacb4ee87124e21ba9f2f811f3c65a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:43:39.187010 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-91799c26-0658-4ddc-9ca1-f61bf5eace68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:43:39.218097 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1143/2266] 10.222.0.67 () {58 vars in 957 bytes} [Wed May 25 14:43:39 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) May 25 14:43:47.493030 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=5 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:47.787581 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f0bfad-8003-4d1a-9f9d-40db6f2e9000 None None] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:47.788900 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f0bfad-8003-4d1a-9f9d-40db6f2e9000 None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:47.789190 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f0bfad-8003-4d1a-9f9d-40db6f2e9000 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:47.841782 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.auth.core [None req-57f0bfad-8003-4d1a-9f9d-40db6f2e9000 None None] MFA Rules not processed for user `1cdbd342d59548118ade365d352d2eaa`. Rule list: `[]` (Enabled: `True`). {{(pid=80474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:43:47.843332 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-57f0bfad-8003-4d1a-9f9d-40db6f2e9000 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:43:47.869522 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1124/2267] 10.222.0.67 () {58 vars in 957 bytes} [Wed May 25 14:43:47 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:43:49.157172 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=66 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:52.028932 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e5801b-c4d5-44dd-9dd0-572659cf541c None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:52.029996 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e5801b-c4d5-44dd-9dd0-572659cf541c None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:52.030436 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e5801b-c4d5-44dd-9dd0-572659cf541c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:52.063287 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-b6e5801b-c4d5-44dd-9dd0-572659cf541c None None] MFA Rules not processed for user `e03f5bb82ffb41a1b1dde935d093e6f4`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:43:52.064381 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-b6e5801b-c4d5-44dd-9dd0-572659cf541c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:43:52.106687 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1144/2268] 10.222.0.67 () {58 vars in 1009 bytes} [Wed May 25 14:43:52 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:43:52.123985 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f0bfad-8003-4d1a-9f9d-40db6f2e9000 None None] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:52.155073 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f0bfad-8003-4d1a-9f9d-40db6f2e9000 None None] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:52.164666 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0000b0e-c526-4b73-b1df-d4ca86433523 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbe9e38881834198842a476889678096', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfe93ee8d32a441295efc0b885de4bd7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:52.165274 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0000b0e-c526-4b73-b1df-d4ca86433523 service swift] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:52.165842 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0000b0e-c526-4b73-b1df-d4ca86433523 service swift] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:52.166414 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0000b0e-c526-4b73-b1df-d4ca86433523 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:52.179207 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0000b0e-c526-4b73-b1df-d4ca86433523 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:52.182753 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0000b0e-c526-4b73-b1df-d4ca86433523 service swift] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:52.198737 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1125/2269] 10.222.0.67 () {60 vars in 1384 bytes} [Wed May 25 14:43:52 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 25 14:44:02.084000 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=6 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:44:02.193939 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=9 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:44:02.538214 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e5801b-c4d5-44dd-9dd0-572659cf541c None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:44:02.539676 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-b6e5801b-c4d5-44dd-9dd0-572659cf541c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:44:02.554949 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e5801b-c4d5-44dd-9dd0-572659cf541c None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:44:02.559482 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c2cb23-8645-4df1-8bd4-323fe1a48d15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:44:02.560681 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c2cb23-8645-4df1-8bd4-323fe1a48d15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:02.561201 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c2cb23-8645-4df1-8bd4-323fe1a48d15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:02.561722 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c2cb23-8645-4df1-8bd4-323fe1a48d15 admin admin] PATH_INFO: `/v3/users/a0057404b54d4b63b4fe99acbde34588` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:02.564115 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c2cb23-8645-4df1-8bd4-323fe1a48d15 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a0057404b54d4b63b4fe99acbde34588)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:44:02.566173 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c2cb23-8645-4df1-8bd4-323fe1a48d15 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:44:02.616239 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-15c2cb23-8645-4df1-8bd4-323fe1a48d15 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a0057404b54d4b63b4fe99acbde34588'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:44:02.623836 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-15c2cb23-8645-4df1-8bd4-323fe1a48d15 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a0057404b54d4b63b4fe99acbde34588'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:44:02.625237 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-15c2cb23-8645-4df1-8bd4-323fe1a48d15 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a0057404b54d4b63b4fe99acbde34588'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:44:02.633442 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-15c2cb23-8645-4df1-8bd4-323fe1a48d15 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a0057404b54d4b63b4fe99acbde34588'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:44:02.646307 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-15c2cb23-8645-4df1-8bd4-323fe1a48d15 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a0057404b54d4b63b4fe99acbde34588'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:44:02.652457 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1145/2270] 10.222.0.67 () {58 vars in 1223 bytes} [Wed May 25 14:44:02 2022] DELETE /identity/v3/users/a0057404b54d4b63b4fe99acbde34588 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:44:02.658141 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e087e5ed-6c2e-4aad-8ab9-8af8e0834059 None None] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:02.658505 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e087e5ed-6c2e-4aad-8ab9-8af8e0834059 None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:02.659609 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e087e5ed-6c2e-4aad-8ab9-8af8e0834059 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:02.681376 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.auth.core [None req-e087e5ed-6c2e-4aad-8ab9-8af8e0834059 None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:44:02.682591 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-e087e5ed-6c2e-4aad-8ab9-8af8e0834059 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:44:02.754030 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1126/2271] 10.222.0.67 () {58 vars in 957 bytes} [Wed May 25 14:44:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:44:02.766547 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c2cb23-8645-4df1-8bd4-323fe1a48d15 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:44:02.768313 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-15c2cb23-8645-4df1-8bd4-323fe1a48d15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:44:02.834316 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c2cb23-8645-4df1-8bd4-323fe1a48d15 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:44:02.838946 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a095ed88-8f6c-47a9-b87e-78fb91b33c85 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b68eed985c7b49839bcdd173186ad4ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfe93ee8d32a441295efc0b885de4bd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:44:02.840557 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a095ed88-8f6c-47a9-b87e-78fb91b33c85 service neutron] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:02.840557 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a095ed88-8f6c-47a9-b87e-78fb91b33c85 service neutron] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:02.841079 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a095ed88-8f6c-47a9-b87e-78fb91b33c85 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:02.854068 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a095ed88-8f6c-47a9-b87e-78fb91b33c85 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:44:02.855552 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a095ed88-8f6c-47a9-b87e-78fb91b33c85 service neutron] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:44:02.868530 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1146/2272] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 14:44:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:44:03.384697 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e087e5ed-6c2e-4aad-8ab9-8af8e0834059 None None] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:44:03.384697 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-e087e5ed-6c2e-4aad-8ab9-8af8e0834059 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:44:03.396593 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e087e5ed-6c2e-4aad-8ab9-8af8e0834059 None None] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:44:03.401420 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5b1106-b993-441b-a604-438b4c22a612 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:44:03.402624 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5b1106-b993-441b-a604-438b4c22a612 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:03.403118 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5b1106-b993-441b-a604-438b4c22a612 admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:03.403584 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5b1106-b993-441b-a604-438b4c22a612 admin admin] PATH_INFO: `/v3/projects/c38c399c26e24429a427bfa21b85c898` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:03.404858 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5b1106-b993-441b-a604-438b4c22a612 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c38c399c26e24429a427bfa21b85c898)` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:44:03.407433 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5b1106-b993-441b-a604-438b4c22a612 admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:44:03.484324 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-0c5b1106-b993-441b-a604-438b4c22a612 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c38c399c26e24429a427bfa21b85c898', 'request_id': 'req-0c5b1106-b993-441b-a604-438b4c22a612'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:44:03.493261 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-0c5b1106-b993-441b-a604-438b4c22a612 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c38c399c26e24429a427bfa21b85c898', 'request_id': 'req-0c5b1106-b993-441b-a604-438b4c22a612'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:44:03.503426 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-0c5b1106-b993-441b-a604-438b4c22a612 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c38c399c26e24429a427bfa21b85c898', 'request_id': 'req-0c5b1106-b993-441b-a604-438b4c22a612'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:44:03.518164 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-0c5b1106-b993-441b-a604-438b4c22a612 admin admin] The token cache is being invalidate because project c38c399c26e24429a427bfa21b85c898 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80474) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 14:44:03.518718 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-0c5b1106-b993-441b-a604-438b4c22a612 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:44:03.519418 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-0c5b1106-b993-441b-a604-438b4c22a612 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:44:03.525048 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1127/2273] 10.222.0.67 () {58 vars in 1232 bytes} [Wed May 25 14:44:03 2022] DELETE /identity/v3/projects/c38c399c26e24429a427bfa21b85c898 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:44:03.526684 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db8db73-499e-46c3-8877-2f5ddacf33a1 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:03.527664 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db8db73-499e-46c3-8877-2f5ddacf33a1 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:03.528699 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db8db73-499e-46c3-8877-2f5ddacf33a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:03.553246 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-0db8db73-499e-46c3-8877-2f5ddacf33a1 None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:44:03.554786 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-0db8db73-499e-46c3-8877-2f5ddacf33a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:44:03.636200 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1147/2274] 10.222.0.67 () {58 vars in 957 bytes} [Wed May 25 14:44:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 14:44:03.646686 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7248b879-6df3-4e8f-a4ea-afe96b745170 None None] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:03.647293 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7248b879-6df3-4e8f-a4ea-afe96b745170 None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:03.647994 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7248b879-6df3-4e8f-a4ea-afe96b745170 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:03.675803 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.auth.core [None req-7248b879-6df3-4e8f-a4ea-afe96b745170 None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:44:03.677259 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-7248b879-6df3-4e8f-a4ea-afe96b745170 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:44:03.692413 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1128/2275] 10.222.0.67 () {58 vars in 957 bytes} [Wed May 25 14:44:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:44:03.694265 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db8db73-499e-46c3-8877-2f5ddacf33a1 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:44:03.709839 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db8db73-499e-46c3-8877-2f5ddacf33a1 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:44:03.717428 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8aa7357-04de-4892-80b3-f2fb894b8674 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:44:03.719135 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8aa7357-04de-4892-80b3-f2fb894b8674 admin admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:03.719279 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8aa7357-04de-4892-80b3-f2fb894b8674 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:03.719654 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8aa7357-04de-4892-80b3-f2fb894b8674 admin admin] PATH_INFO: `/v3/domains` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:03.720654 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8aa7357-04de-4892-80b3-f2fb894b8674 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:44:03.721307 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8aa7357-04de-4892-80b3-f2fb894b8674 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:44:03.723824 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8aa7357-04de-4892-80b3-f2fb894b8674 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:44:03.750962 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1148/2276] 10.222.0.67 () {58 vars in 1152 bytes} [Wed May 25 14:44:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:44:03.753808 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7248b879-6df3-4e8f-a4ea-afe96b745170 None None] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:44:03.767821 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7248b879-6df3-4e8f-a4ea-afe96b745170 None None] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:44:03.774802 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b022a3-d2a2-44d2-a63e-8f2fa89ca796 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:44:03.775615 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b022a3-d2a2-44d2-a63e-8f2fa89ca796 admin admin] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:03.775846 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b022a3-d2a2-44d2-a63e-8f2fa89ca796 admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:03.776128 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b022a3-d2a2-44d2-a63e-8f2fa89ca796 admin admin] PATH_INFO: `/v3/projects` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:03.776864 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b022a3-d2a2-44d2-a63e-8f2fa89ca796 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:44:03.778868 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b022a3-d2a2-44d2-a63e-8f2fa89ca796 admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:44:03.815066 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1129/2277] 10.222.0.67 () {60 vars in 1152 bytes} [Wed May 25 14:44:03 2022] POST /identity/v3/projects => generated 385 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:44:03.819753 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8aa7357-04de-4892-80b3-f2fb894b8674 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:44:03.830628 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:44:03.848326 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8aa7357-04de-4892-80b3-f2fb894b8674 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:44:03.965067 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e88556-63f5-4b70-9153-4e2d606490ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:44:03.966681 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e88556-63f5-4b70-9153-4e2d606490ae admin admin] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:03.967223 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e88556-63f5-4b70-9153-4e2d606490ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:03.967726 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e88556-63f5-4b70-9153-4e2d606490ae admin admin] PATH_INFO: `/v3/users` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:03.969819 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e88556-63f5-4b70-9153-4e2d606490ae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:44:03.975911 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e88556-63f5-4b70-9153-4e2d606490ae admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:44:04.024154 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1149/2278] 10.222.0.67 () {60 vars in 1143 bytes} [Wed May 25 14:44:03 2022] POST /identity/v3/users => generated 293 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:44:04.028451 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b022a3-d2a2-44d2-a63e-8f2fa89ca796 admin admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:44:04.042317 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b022a3-d2a2-44d2-a63e-8f2fa89ca796 admin admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:44:04.050744 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c769eda5-54e7-4c07-a09e-bdd4a2bc8282 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:44:04.052830 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c769eda5-54e7-4c07-a09e-bdd4a2bc8282 admin admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:04.053275 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c769eda5-54e7-4c07-a09e-bdd4a2bc8282 admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:04.054453 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c769eda5-54e7-4c07-a09e-bdd4a2bc8282 admin admin] PATH_INFO: `/v3/roles` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:04.055194 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c769eda5-54e7-4c07-a09e-bdd4a2bc8282 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:44:04.057921 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c769eda5-54e7-4c07-a09e-bdd4a2bc8282 admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:44:04.073963 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1130/2279] 10.222.0.67 () {58 vars in 1121 bytes} [Wed May 25 14:44:04 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:44:04.079707 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e88556-63f5-4b70-9153-4e2d606490ae admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:44:04.101829 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e88556-63f5-4b70-9153-4e2d606490ae admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:44:04.109179 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175f207d-1363-4276-947c-8ca025a637a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:44:04.111985 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175f207d-1363-4276-947c-8ca025a637a3 admin admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:04.111985 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175f207d-1363-4276-947c-8ca025a637a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:04.111985 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175f207d-1363-4276-947c-8ca025a637a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:04.112445 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175f207d-1363-4276-947c-8ca025a637a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:44:04.114356 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175f207d-1363-4276-947c-8ca025a637a3 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:44:04.129603 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1150/2280] 10.222.0.67 () {58 vars in 1121 bytes} [Wed May 25 14:44:04 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 25 14:44:04.130809 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c769eda5-54e7-4c07-a09e-bdd4a2bc8282 admin admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:44:04.143934 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c769eda5-54e7-4c07-a09e-bdd4a2bc8282 admin admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:44:04.149374 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443e8923-5ede-4736-b942-920feea2344c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:44:04.151853 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443e8923-5ede-4736-b942-920feea2344c admin admin] REQUEST_METHOD: `PUT` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:04.151853 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443e8923-5ede-4736-b942-920feea2344c admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:04.151853 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443e8923-5ede-4736-b942-920feea2344c admin admin] PATH_INFO: `/v3/projects/a98adea32cef40119b1e8d9c8e0dd96d/users/32b2c1c0468e4ae38f3e2bc4cf390d10/roles/48808901834b4d5eab2c7e6b5b03791e` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:04.176264 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443e8923-5ede-4736-b942-920feea2344c admin admin] RBAC: Authorizing `identity:create_grant(project_id=a98adea32cef40119b1e8d9c8e0dd96d, user_id=32b2c1c0468e4ae38f3e2bc4cf390d10, role_id=48808901834b4d5eab2c7e6b5b03791e)` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:44:04.179692 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443e8923-5ede-4736-b942-920feea2344c admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:44:04.203847 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1131/2281] 10.222.0.67 () {60 vars in 1482 bytes} [Wed May 25 14:44:04 2022] PUT /identity/v3/projects/a98adea32cef40119b1e8d9c8e0dd96d/users/32b2c1c0468e4ae38f3e2bc4cf390d10/roles/48808901834b4d5eab2c7e6b5b03791e => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:44:04.216315 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8483634-ebeb-4f96-b66e-565b19d6195d None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:04.216315 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8483634-ebeb-4f96-b66e-565b19d6195d None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:04.216315 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8483634-ebeb-4f96-b66e-565b19d6195d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:04.270128 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-f8483634-ebeb-4f96-b66e-565b19d6195d None None] MFA Rules not processed for user `32b2c1c0468e4ae38f3e2bc4cf390d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:44:04.271411 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-f8483634-ebeb-4f96-b66e-565b19d6195d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:44:04.366753 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1151/2282] 10.222.0.67 () {58 vars in 957 bytes} [Wed May 25 14:44:04 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:44:04.381215 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443e8923-5ede-4736-b942-920feea2344c admin admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:44:04.383539 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-443e8923-5ede-4736-b942-920feea2344c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:44:04.413194 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:44:04.523590 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443e8923-5ede-4736-b942-920feea2344c admin admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:44:04.529234 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b1d15d-78fe-4224-a30f-6a276714abe1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e462acc9da84a61bb23998dd54e1858', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfe93ee8d32a441295efc0b885de4bd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:44:04.530200 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b1d15d-78fe-4224-a30f-6a276714abe1 service cinder] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:04.531056 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b1d15d-78fe-4224-a30f-6a276714abe1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:04.531546 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b1d15d-78fe-4224-a30f-6a276714abe1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:04.568276 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b1d15d-78fe-4224-a30f-6a276714abe1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:44:04.570623 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b1d15d-78fe-4224-a30f-6a276714abe1 service cinder] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:44:04.600186 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1132/2283] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 14:44:04 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:44:07.287602 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8483634-ebeb-4f96-b66e-565b19d6195d None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:44:07.368198 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8483634-ebeb-4f96-b66e-565b19d6195d None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:44:07.372681 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc61104-74cd-49ad-b398-2bfba7a012a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:44:07.373540 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc61104-74cd-49ad-b398-2bfba7a012a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:07.373820 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc61104-74cd-49ad-b398-2bfba7a012a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:07.374094 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc61104-74cd-49ad-b398-2bfba7a012a2 admin admin] PATH_INFO: `/v3/users/32b2c1c0468e4ae38f3e2bc4cf390d10` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:07.376490 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc61104-74cd-49ad-b398-2bfba7a012a2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=32b2c1c0468e4ae38f3e2bc4cf390d10)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:44:07.378524 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc61104-74cd-49ad-b398-2bfba7a012a2 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:44:07.394782 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:44:07.438718 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-abc61104-74cd-49ad-b398-2bfba7a012a2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '32b2c1c0468e4ae38f3e2bc4cf390d10'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:44:07.445712 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-abc61104-74cd-49ad-b398-2bfba7a012a2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '32b2c1c0468e4ae38f3e2bc4cf390d10'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:44:07.446325 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-abc61104-74cd-49ad-b398-2bfba7a012a2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '32b2c1c0468e4ae38f3e2bc4cf390d10'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:44:07.454741 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-abc61104-74cd-49ad-b398-2bfba7a012a2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '32b2c1c0468e4ae38f3e2bc4cf390d10'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:44:07.466917 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-abc61104-74cd-49ad-b398-2bfba7a012a2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '32b2c1c0468e4ae38f3e2bc4cf390d10'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:44:07.473464 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1152/2284] 10.222.0.67 () {58 vars in 1223 bytes} [Wed May 25 14:44:07 2022] DELETE /identity/v3/users/32b2c1c0468e4ae38f3e2bc4cf390d10 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:44:07.477966 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aee9c09-90cf-4cbc-8901-ae653ba3db1d None None] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:07.478458 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aee9c09-90cf-4cbc-8901-ae653ba3db1d None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:07.478543 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aee9c09-90cf-4cbc-8901-ae653ba3db1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:07.497282 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.auth.core [None req-7aee9c09-90cf-4cbc-8901-ae653ba3db1d None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:44:07.498498 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-7aee9c09-90cf-4cbc-8901-ae653ba3db1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:44:07.560517 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1133/2285] 10.222.0.67 () {58 vars in 957 bytes} [Wed May 25 14:44:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:44:07.570815 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc61104-74cd-49ad-b398-2bfba7a012a2 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:44:07.572271 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-abc61104-74cd-49ad-b398-2bfba7a012a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:44:07.630007 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc61104-74cd-49ad-b398-2bfba7a012a2 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:44:07.633870 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d3ee9e-6811-405a-ab2f-7d69c02833c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b68eed985c7b49839bcdd173186ad4ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfe93ee8d32a441295efc0b885de4bd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:44:07.634506 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d3ee9e-6811-405a-ab2f-7d69c02833c0 service neutron] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:07.634797 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d3ee9e-6811-405a-ab2f-7d69c02833c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:07.635104 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d3ee9e-6811-405a-ab2f-7d69c02833c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:07.644248 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d3ee9e-6811-405a-ab2f-7d69c02833c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:44:07.645705 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d3ee9e-6811-405a-ab2f-7d69c02833c0 service neutron] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:44:07.655575 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1153/2286] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 14:44:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:44:08.357446 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a998d1f7-04c0-4d91-b49b-458dc7712f80 None None] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:08.358007 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a998d1f7-04c0-4d91-b49b-458dc7712f80 None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:08.358466 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a998d1f7-04c0-4d91-b49b-458dc7712f80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:08.419850 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d3ee9e-6811-405a-ab2f-7d69c02833c0 service neutron] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:44:08.425220 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-06d3ee9e-6811-405a-ab2f-7d69c02833c0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:44:08.446110 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d3ee9e-6811-405a-ab2f-7d69c02833c0 service neutron] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:44:08.452627 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5173746c-87ba-4f63-941b-3e71638ca07a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:44:08.454010 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5173746c-87ba-4f63-941b-3e71638ca07a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:08.454866 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5173746c-87ba-4f63-941b-3e71638ca07a admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:08.455395 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5173746c-87ba-4f63-941b-3e71638ca07a admin admin] PATH_INFO: `/v3/projects/a98adea32cef40119b1e8d9c8e0dd96d` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:08.457547 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5173746c-87ba-4f63-941b-3e71638ca07a admin admin] RBAC: Authorizing `identity:delete_project(project_id=a98adea32cef40119b1e8d9c8e0dd96d)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:44:08.459611 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5173746c-87ba-4f63-941b-3e71638ca07a admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:44:08.493445 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.auth.core [None req-a998d1f7-04c0-4d91-b49b-458dc7712f80 None None] MFA Rules not processed for user `e03f5bb82ffb41a1b1dde935d093e6f4`. Rule list: `[]` (Enabled: `True`). {{(pid=80474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:44:08.495468 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-a998d1f7-04c0-4d91-b49b-458dc7712f80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:44:08.576741 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-5173746c-87ba-4f63-941b-3e71638ca07a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a98adea32cef40119b1e8d9c8e0dd96d', 'request_id': 'req-5173746c-87ba-4f63-941b-3e71638ca07a'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:44:08.587095 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-5173746c-87ba-4f63-941b-3e71638ca07a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a98adea32cef40119b1e8d9c8e0dd96d', 'request_id': 'req-5173746c-87ba-4f63-941b-3e71638ca07a'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:44:08.613214 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-5173746c-87ba-4f63-941b-3e71638ca07a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a98adea32cef40119b1e8d9c8e0dd96d', 'request_id': 'req-5173746c-87ba-4f63-941b-3e71638ca07a'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:44:08.626653 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1134/2287] 10.222.0.67 () {58 vars in 1009 bytes} [Wed May 25 14:44:08 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:44:08.634170 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-5173746c-87ba-4f63-941b-3e71638ca07a admin admin] The token cache is being invalidate because project a98adea32cef40119b1e8d9c8e0dd96d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80475) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 14:44:08.634932 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-5173746c-87ba-4f63-941b-3e71638ca07a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:44:08.635211 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-5173746c-87ba-4f63-941b-3e71638ca07a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:44:08.642858 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79736e3-8537-42c6-b8d5-56ebe4f6f818 None None] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:08.643125 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1154/2288] 10.222.0.67 () {58 vars in 1232 bytes} [Wed May 25 14:44:08 2022] DELETE /identity/v3/projects/a98adea32cef40119b1e8d9c8e0dd96d => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:44:08.643551 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79736e3-8537-42c6-b8d5-56ebe4f6f818 None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:08.644004 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79736e3-8537-42c6-b8d5-56ebe4f6f818 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:08.644906 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5173746c-87ba-4f63-941b-3e71638ca07a admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:44:08.646537 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-5173746c-87ba-4f63-941b-3e71638ca07a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:44:08.668000 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.auth.core [None req-f79736e3-8537-42c6-b8d5-56ebe4f6f818 None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:44:08.669461 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-f79736e3-8537-42c6-b8d5-56ebe4f6f818 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:44:08.685686 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:44:08.695706 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:44:08.785719 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1135/2289] 10.222.0.67 () {58 vars in 957 bytes} [Wed May 25 14:44:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:44:08.794183 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c576d46-7310-4f88-bbcd-b2284bd3ed7e None None] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:08.794483 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c576d46-7310-4f88-bbcd-b2284bd3ed7e None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:08.795737 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c576d46-7310-4f88-bbcd-b2284bd3ed7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:08.815994 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.auth.core [None req-3c576d46-7310-4f88-bbcd-b2284bd3ed7e None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:44:08.818050 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-3c576d46-7310-4f88-bbcd-b2284bd3ed7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:44:08.835925 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1136/2290] 10.222.0.67 () {58 vars in 957 bytes} [Wed May 25 14:44:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:44:08.840222 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c576d46-7310-4f88-bbcd-b2284bd3ed7e None None] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:44:08.846706 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5173746c-87ba-4f63-941b-3e71638ca07a admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:44:08.852474 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1760591-4396-458c-b35c-b2da4c7062ba service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbe9e38881834198842a476889678096', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfe93ee8d32a441295efc0b885de4bd7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:44:08.853136 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1760591-4396-458c-b35c-b2da4c7062ba service swift] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:08.853587 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1760591-4396-458c-b35c-b2da4c7062ba service swift] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:08.853875 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1760591-4396-458c-b35c-b2da4c7062ba service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:08.856511 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-f1760591-4396-458c-b35c-b2da4c7062ba service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:44:08.861489 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c576d46-7310-4f88-bbcd-b2284bd3ed7e None None] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:44:08.866543 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8943ed1-bebc-4f95-bb09-39884591e970 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:44:08.867207 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8943ed1-bebc-4f95-bb09-39884591e970 admin admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:08.867492 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8943ed1-bebc-4f95-bb09-39884591e970 admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:08.867764 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8943ed1-bebc-4f95-bb09-39884591e970 admin admin] PATH_INFO: `/v3/domains` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:08.868499 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8943ed1-bebc-4f95-bb09-39884591e970 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:44:08.868819 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8943ed1-bebc-4f95-bb09-39884591e970 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:44:08.870536 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8943ed1-bebc-4f95-bb09-39884591e970 admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:44:08.891934 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1137/2291] 10.222.0.67 () {58 vars in 1152 bytes} [Wed May 25 14:44:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:44:08.895443 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8943ed1-bebc-4f95-bb09-39884591e970 admin admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:44:08.924431 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8943ed1-bebc-4f95-bb09-39884591e970 admin admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:44:08.941202 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78aa816-68eb-4c1a-a26e-2950156c063f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:44:08.942161 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78aa816-68eb-4c1a-a26e-2950156c063f admin admin] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:08.942842 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78aa816-68eb-4c1a-a26e-2950156c063f admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:08.943488 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78aa816-68eb-4c1a-a26e-2950156c063f admin admin] PATH_INFO: `/v3/projects` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:08.944414 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78aa816-68eb-4c1a-a26e-2950156c063f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:44:08.948690 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78aa816-68eb-4c1a-a26e-2950156c063f admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:44:08.971307 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1760591-4396-458c-b35c-b2da4c7062ba service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:44:08.973632 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1760591-4396-458c-b35c-b2da4c7062ba service swift] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:44:09.032865 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1138/2292] 10.222.0.67 () {60 vars in 1152 bytes} [Wed May 25 14:44:08 2022] POST /identity/v3/projects => generated 363 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:44:09.036429 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78aa816-68eb-4c1a-a26e-2950156c063f admin admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:44:09.037083 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1155/2293] 10.222.0.67 () {60 vars in 1384 bytes} [Wed May 25 14:44:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 25 14:44:09.130956 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78aa816-68eb-4c1a-a26e-2950156c063f admin admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:44:09.136365 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372cfda0-280e-4e2d-8cc5-7d0bb19fc4fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:44:09.137402 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372cfda0-280e-4e2d-8cc5-7d0bb19fc4fd admin admin] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:09.137846 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372cfda0-280e-4e2d-8cc5-7d0bb19fc4fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:09.138501 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372cfda0-280e-4e2d-8cc5-7d0bb19fc4fd admin admin] PATH_INFO: `/v3/users` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:09.139432 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372cfda0-280e-4e2d-8cc5-7d0bb19fc4fd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:44:09.144296 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372cfda0-280e-4e2d-8cc5-7d0bb19fc4fd admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:44:09.195115 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1139/2294] 10.222.0.67 () {60 vars in 1143 bytes} [Wed May 25 14:44:09 2022] POST /identity/v3/users => generated 282 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 14:44:09.198683 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1760591-4396-458c-b35c-b2da4c7062ba service swift] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:44:09.223421 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1760591-4396-458c-b35c-b2da4c7062ba service swift] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:44:09.238863 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651f5ee2-087b-453f-befd-05f5a001cccb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:44:09.239899 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651f5ee2-087b-453f-befd-05f5a001cccb admin admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:09.240251 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651f5ee2-087b-453f-befd-05f5a001cccb admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:09.240598 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651f5ee2-087b-453f-befd-05f5a001cccb admin admin] PATH_INFO: `/v3/roles` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:09.243600 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651f5ee2-087b-453f-befd-05f5a001cccb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:44:09.246125 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651f5ee2-087b-453f-befd-05f5a001cccb admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:44:09.269676 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1156/2295] 10.222.0.67 () {58 vars in 1121 bytes} [Wed May 25 14:44:09 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:44:09.273716 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372cfda0-280e-4e2d-8cc5-7d0bb19fc4fd admin admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:44:09.289357 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372cfda0-280e-4e2d-8cc5-7d0bb19fc4fd admin admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:44:09.296049 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d25a444-4658-4ced-9610-cd2776a493fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:44:09.297639 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d25a444-4658-4ced-9610-cd2776a493fa admin admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:09.297929 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d25a444-4658-4ced-9610-cd2776a493fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:09.298353 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d25a444-4658-4ced-9610-cd2776a493fa admin admin] PATH_INFO: `/v3/roles` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:09.299299 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d25a444-4658-4ced-9610-cd2776a493fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:44:09.301754 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d25a444-4658-4ced-9610-cd2776a493fa admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:44:09.314152 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1140/2296] 10.222.0.67 () {58 vars in 1121 bytes} [Wed May 25 14:44:09 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:44:09.318353 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651f5ee2-087b-453f-befd-05f5a001cccb admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:44:09.329986 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651f5ee2-087b-453f-befd-05f5a001cccb admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:44:09.336800 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19914117-962c-499a-b5c9-4c8a7da950f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:44:09.337427 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19914117-962c-499a-b5c9-4c8a7da950f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:09.337715 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19914117-962c-499a-b5c9-4c8a7da950f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:09.338208 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19914117-962c-499a-b5c9-4c8a7da950f5 admin admin] PATH_INFO: `/v3/projects/afcb65c8691d48eeb0a281fa0df89a7b/users/b085f6be9c4c49d9a5e1c4e819becaa2/roles/48808901834b4d5eab2c7e6b5b03791e` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:09.391591 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19914117-962c-499a-b5c9-4c8a7da950f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=afcb65c8691d48eeb0a281fa0df89a7b, user_id=b085f6be9c4c49d9a5e1c4e819becaa2, role_id=48808901834b4d5eab2c7e6b5b03791e)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:44:09.396766 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19914117-962c-499a-b5c9-4c8a7da950f5 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:44:09.464527 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1157/2297] 10.222.0.67 () {60 vars in 1482 bytes} [Wed May 25 14:44:09 2022] PUT /identity/v3/projects/afcb65c8691d48eeb0a281fa0df89a7b/users/b085f6be9c4c49d9a5e1c4e819becaa2/roles/48808901834b4d5eab2c7e6b5b03791e => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:44:09.472976 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef991eb8-71b1-4efe-911e-41eddb1a0feb None None] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:09.473282 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef991eb8-71b1-4efe-911e-41eddb1a0feb None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:09.473584 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef991eb8-71b1-4efe-911e-41eddb1a0feb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:09.514533 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.auth.core [None req-ef991eb8-71b1-4efe-911e-41eddb1a0feb None None] MFA Rules not processed for user `b085f6be9c4c49d9a5e1c4e819becaa2`. Rule list: `[]` (Enabled: `True`). {{(pid=80474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:44:09.516976 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-ef991eb8-71b1-4efe-911e-41eddb1a0feb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:44:09.583701 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:44:09.620100 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1141/2298] 10.222.0.67 () {58 vars in 957 bytes} [Wed May 25 14:44:09 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:44:09.634387 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19914117-962c-499a-b5c9-4c8a7da950f5 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:44:09.636552 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-19914117-962c-499a-b5c9-4c8a7da950f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:44:09.805934 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19914117-962c-499a-b5c9-4c8a7da950f5 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:44:09.814144 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a68343-5d62-4393-a70b-8827e410f70d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e462acc9da84a61bb23998dd54e1858', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfe93ee8d32a441295efc0b885de4bd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:44:09.817330 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a68343-5d62-4393-a70b-8827e410f70d service cinder] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:09.817675 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a68343-5d62-4393-a70b-8827e410f70d service cinder] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:09.817971 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a68343-5d62-4393-a70b-8827e410f70d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:09.845010 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a68343-5d62-4393-a70b-8827e410f70d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:44:09.846907 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a68343-5d62-4393-a70b-8827e410f70d service cinder] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:44:09.871381 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1158/2299] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 14:44:09 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:44:19.615895 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=8 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:44:19.857773 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=97,keystone:INSERT=1 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:44:27.309707 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef991eb8-71b1-4efe-911e-41eddb1a0feb None None] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:44:27.311183 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-ef991eb8-71b1-4efe-911e-41eddb1a0feb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:44:27.377978 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef991eb8-71b1-4efe-911e-41eddb1a0feb None None] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:44:27.382117 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd553d6-34ac-4609-a08a-91448bf3b6e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b68eed985c7b49839bcdd173186ad4ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfe93ee8d32a441295efc0b885de4bd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:44:27.383281 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd553d6-34ac-4609-a08a-91448bf3b6e7 service neutron] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:27.383563 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd553d6-34ac-4609-a08a-91448bf3b6e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:27.384005 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd553d6-34ac-4609-a08a-91448bf3b6e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:27.386401 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-fbd553d6-34ac-4609-a08a-91448bf3b6e7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:44:27.462225 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd553d6-34ac-4609-a08a-91448bf3b6e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:44:27.464429 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd553d6-34ac-4609-a08a-91448bf3b6e7 service neutron] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:44:27.476039 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1142/2300] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 14:44:27 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:44:27.948065 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b414e2-bd75-402b-84dd-8613cdbb802a None None] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:27.948673 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b414e2-bd75-402b-84dd-8613cdbb802a None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:27.948673 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b414e2-bd75-402b-84dd-8613cdbb802a None None] PATH_INFO: `/` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:27.950016 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1159/2301] 10.222.0.67 () {54 vars in 921 bytes} [Wed May 25 14:44:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:44:27.957268 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73893f9c-c46d-4765-b788-4a4605790c0d None None] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:27.957652 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73893f9c-c46d-4765-b788-4a4605790c0d None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:27.957899 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73893f9c-c46d-4765-b788-4a4605790c0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:28.024002 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.auth.core [None req-73893f9c-c46d-4765-b788-4a4605790c0d None None] MFA Rules not processed for user `428ec99478284743943ed41e9d24a603`. Rule list: `[]` (Enabled: `True`). {{(pid=80474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:44:28.027323 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-73893f9c-c46d-4765-b788-4a4605790c0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:44:28.128264 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1143/2302] 10.222.0.67 () {58 vars in 1018 bytes} [Wed May 25 14:44:27 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:44:38.056689 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b414e2-bd75-402b-84dd-8613cdbb802a None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:44:38.059091 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-b6b414e2-bd75-402b-84dd-8613cdbb802a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:44:38.123299 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=96 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:44:38.161055 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b414e2-bd75-402b-84dd-8613cdbb802a None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:44:38.164950 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d3ffda-5099-4517-9fe4-4b596ae65528 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5e4d67668ce40509e057f4f4c994521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfe93ee8d32a441295efc0b885de4bd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:44:38.165598 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d3ffda-5099-4517-9fe4-4b596ae65528 service glance] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:38.165882 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d3ffda-5099-4517-9fe4-4b596ae65528 service glance] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:38.166154 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d3ffda-5099-4517-9fe4-4b596ae65528 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:38.177591 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d3ffda-5099-4517-9fe4-4b596ae65528 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:44:38.179023 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d3ffda-5099-4517-9fe4-4b596ae65528 service glance] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:44:38.191680 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1160/2303] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 14:44:38 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:44:38.279845 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196f43d1-20a8-4ce5-93d9-e00c29810053 None None] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:38.280057 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196f43d1-20a8-4ce5-93d9-e00c29810053 None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:38.280320 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196f43d1-20a8-4ce5-93d9-e00c29810053 None None] PATH_INFO: `/` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:38.282575 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1144/2304] 10.222.0.67 () {54 vars in 921 bytes} [Wed May 25 14:44:38 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 14:44:38.290059 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfa6362-9f39-46dc-9219-72bf7f5d0a06 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:38.290546 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfa6362-9f39-46dc-9219-72bf7f5d0a06 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:38.290915 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfa6362-9f39-46dc-9219-72bf7f5d0a06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:38.313840 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-2cfa6362-9f39-46dc-9219-72bf7f5d0a06 None None] MFA Rules not processed for user `b68eed985c7b49839bcdd173186ad4ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:44:38.315212 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-2cfa6362-9f39-46dc-9219-72bf7f5d0a06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:44:38.330326 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1161/2305] 10.222.0.67 () {58 vars in 1018 bytes} [Wed May 25 14:44:38 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:44:38.343785 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196f43d1-20a8-4ce5-93d9-e00c29810053 None None] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:44:38.345903 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-196f43d1-20a8-4ce5-93d9-e00c29810053 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:44:38.360213 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196f43d1-20a8-4ce5-93d9-e00c29810053 None None] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:44:38.364282 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4d350b-e319-4615-9d9b-d255b48d8239 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b68eed985c7b49839bcdd173186ad4ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfe93ee8d32a441295efc0b885de4bd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:44:38.365122 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4d350b-e319-4615-9d9b-d255b48d8239 service neutron] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:38.365629 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4d350b-e319-4615-9d9b-d255b48d8239 service neutron] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:38.366049 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4d350b-e319-4615-9d9b-d255b48d8239 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:38.377231 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4d350b-e319-4615-9d9b-d255b48d8239 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:44:38.379961 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4d350b-e319-4615-9d9b-d255b48d8239 service neutron] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:44:38.394189 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1145/2306] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 14:44:38 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:44:38.500495 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e1da75-b259-4b21-841d-03675358d845 None None] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:38.500962 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e1da75-b259-4b21-841d-03675358d845 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:38.501433 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e1da75-b259-4b21-841d-03675358d845 None None] PATH_INFO: `/` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:38.503841 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1162/2307] 10.222.0.67 () {54 vars in 921 bytes} [Wed May 25 14:44:38 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:44:38.511048 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249e3a1e-63d2-4714-9198-58d743848682 None None] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:38.511513 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249e3a1e-63d2-4714-9198-58d743848682 None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:38.511955 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249e3a1e-63d2-4714-9198-58d743848682 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:38.554884 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.auth.core [None req-249e3a1e-63d2-4714-9198-58d743848682 None None] MFA Rules not processed for user `428ec99478284743943ed41e9d24a603`. Rule list: `[]` (Enabled: `True`). {{(pid=80474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:44:38.556875 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-249e3a1e-63d2-4714-9198-58d743848682 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:44:38.569194 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1146/2308] 10.222.0.67 () {58 vars in 1018 bytes} [Wed May 25 14:44:38 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:44:38.579807 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e1da75-b259-4b21-841d-03675358d845 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:44:38.592768 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e1da75-b259-4b21-841d-03675358d845 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:44:38.597336 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5818ad-68d5-4ec5-85ce-661399d3f9c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b68eed985c7b49839bcdd173186ad4ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfe93ee8d32a441295efc0b885de4bd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:44:38.598517 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5818ad-68d5-4ec5-85ce-661399d3f9c5 service neutron] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:38.598517 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5818ad-68d5-4ec5-85ce-661399d3f9c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:38.601835 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5818ad-68d5-4ec5-85ce-661399d3f9c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:38.612826 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5818ad-68d5-4ec5-85ce-661399d3f9c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:44:38.614311 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5818ad-68d5-4ec5-85ce-661399d3f9c5 service neutron] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:44:38.630147 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1163/2309] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 14:44:38 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:44:40.182234 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249e3a1e-63d2-4714-9198-58d743848682 None None] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:44:40.183908 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-249e3a1e-63d2-4714-9198-58d743848682 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:44:40.316853 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249e3a1e-63d2-4714-9198-58d743848682 None None] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:44:40.322290 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ca1bd3-197f-4f22-a894-d0598d1d054f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad2b99c2122a4311996364e982e1c801', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfe93ee8d32a441295efc0b885de4bd7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:44:40.322961 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ca1bd3-197f-4f22-a894-d0598d1d054f service placement] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:40.323284 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ca1bd3-197f-4f22-a894-d0598d1d054f service placement] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:40.323584 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ca1bd3-197f-4f22-a894-d0598d1d054f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:40.325628 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-07ca1bd3-197f-4f22-a894-d0598d1d054f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:44:40.340949 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ca1bd3-197f-4f22-a894-d0598d1d054f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:44:40.342943 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ca1bd3-197f-4f22-a894-d0598d1d054f service placement] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:44:40.355080 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1147/2310] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 14:44:40 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:44:42.371142 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3451a022-bd16-4785-b713-5f660282ed74 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:42.371960 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3451a022-bd16-4785-b713-5f660282ed74 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:42.372125 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3451a022-bd16-4785-b713-5f660282ed74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:42.395375 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-3451a022-bd16-4785-b713-5f660282ed74 None None] MFA Rules not processed for user `e03f5bb82ffb41a1b1dde935d093e6f4`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:44:42.396585 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-3451a022-bd16-4785-b713-5f660282ed74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:44:42.466813 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1164/2311] 10.222.0.67 () {58 vars in 1009 bytes} [Wed May 25 14:44:42 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:44:42.489103 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ca1bd3-197f-4f22-a894-d0598d1d054f service placement] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:44:42.567859 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ca1bd3-197f-4f22-a894-d0598d1d054f service placement] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:44:42.573130 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f5ddff-035a-4407-832c-55dc6370360c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbe9e38881834198842a476889678096', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfe93ee8d32a441295efc0b885de4bd7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:44:42.573781 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f5ddff-035a-4407-832c-55dc6370360c service swift] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:42.574062 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f5ddff-035a-4407-832c-55dc6370360c service swift] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:42.574337 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f5ddff-035a-4407-832c-55dc6370360c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:42.585168 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f5ddff-035a-4407-832c-55dc6370360c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:44:42.586719 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f5ddff-035a-4407-832c-55dc6370360c service swift] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:44:42.600369 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1148/2312] 10.222.0.67 () {60 vars in 1384 bytes} [Wed May 25 14:44:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 25 14:44:52.459296 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=69 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:44:52.594615 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=82 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:44:52.626971 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3451a022-bd16-4785-b713-5f660282ed74 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:44:52.724333 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3451a022-bd16-4785-b713-5f660282ed74 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:44:52.732808 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2121840-421a-4dc4-b96b-2068df765deb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:44:52.734442 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2121840-421a-4dc4-b96b-2068df765deb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:52.739322 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2121840-421a-4dc4-b96b-2068df765deb admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:52.739575 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2121840-421a-4dc4-b96b-2068df765deb admin admin] PATH_INFO: `/v3/users/b085f6be9c4c49d9a5e1c4e819becaa2` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:52.741377 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2121840-421a-4dc4-b96b-2068df765deb admin admin] RBAC: Authorizing `identity:delete_user(user_id=b085f6be9c4c49d9a5e1c4e819becaa2)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:44:52.743595 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2121840-421a-4dc4-b96b-2068df765deb admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:44:52.843215 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-d2121840-421a-4dc4-b96b-2068df765deb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b085f6be9c4c49d9a5e1c4e819becaa2'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:44:52.854578 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-d2121840-421a-4dc4-b96b-2068df765deb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b085f6be9c4c49d9a5e1c4e819becaa2'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:44:52.855657 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-d2121840-421a-4dc4-b96b-2068df765deb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b085f6be9c4c49d9a5e1c4e819becaa2'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:44:52.876667 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-d2121840-421a-4dc4-b96b-2068df765deb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b085f6be9c4c49d9a5e1c4e819becaa2'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:44:52.909995 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-d2121840-421a-4dc4-b96b-2068df765deb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b085f6be9c4c49d9a5e1c4e819becaa2'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:44:52.916557 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1165/2313] 10.222.0.67 () {58 vars in 1223 bytes} [Wed May 25 14:44:52 2022] DELETE /identity/v3/users/b085f6be9c4c49d9a5e1c4e819becaa2 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:44:52.922392 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f6c080-ed63-465e-9a64-a107c0e9c402 None None] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:52.922679 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f6c080-ed63-465e-9a64-a107c0e9c402 None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:52.922966 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f6c080-ed63-465e-9a64-a107c0e9c402 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:52.941287 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.auth.core [None req-e6f6c080-ed63-465e-9a64-a107c0e9c402 None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:44:52.943247 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-e6f6c080-ed63-465e-9a64-a107c0e9c402 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:44:53.025480 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1149/2314] 10.222.0.67 () {58 vars in 957 bytes} [Wed May 25 14:44:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:44:53.034234 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2121840-421a-4dc4-b96b-2068df765deb admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:44:53.036237 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-d2121840-421a-4dc4-b96b-2068df765deb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:44:53.120242 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2121840-421a-4dc4-b96b-2068df765deb admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:44:53.130075 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d933c94b-f250-4947-96d2-38b918c93f02 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b68eed985c7b49839bcdd173186ad4ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfe93ee8d32a441295efc0b885de4bd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:44:53.130749 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d933c94b-f250-4947-96d2-38b918c93f02 service neutron] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:53.131070 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d933c94b-f250-4947-96d2-38b918c93f02 service neutron] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:53.131362 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d933c94b-f250-4947-96d2-38b918c93f02 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:53.146950 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d933c94b-f250-4947-96d2-38b918c93f02 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:44:53.148473 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d933c94b-f250-4947-96d2-38b918c93f02 service neutron] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:44:53.161357 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1166/2315] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 14:44:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:44:53.746340 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f6c080-ed63-465e-9a64-a107c0e9c402 None None] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:44:53.747978 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-e6f6c080-ed63-465e-9a64-a107c0e9c402 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:44:53.766517 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f6c080-ed63-465e-9a64-a107c0e9c402 None None] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:44:53.775832 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac05a18-2ee5-45c6-8863-8ee1dcbc09a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:44:53.776832 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac05a18-2ee5-45c6-8863-8ee1dcbc09a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:53.777126 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac05a18-2ee5-45c6-8863-8ee1dcbc09a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:53.777508 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac05a18-2ee5-45c6-8863-8ee1dcbc09a3 admin admin] PATH_INFO: `/v3/projects/afcb65c8691d48eeb0a281fa0df89a7b` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:53.779345 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac05a18-2ee5-45c6-8863-8ee1dcbc09a3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=afcb65c8691d48eeb0a281fa0df89a7b)` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:44:53.781898 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac05a18-2ee5-45c6-8863-8ee1dcbc09a3 admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:44:53.851578 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-1ac05a18-2ee5-45c6-8863-8ee1dcbc09a3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'afcb65c8691d48eeb0a281fa0df89a7b', 'request_id': 'req-1ac05a18-2ee5-45c6-8863-8ee1dcbc09a3'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:44:53.861653 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-1ac05a18-2ee5-45c6-8863-8ee1dcbc09a3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'afcb65c8691d48eeb0a281fa0df89a7b', 'request_id': 'req-1ac05a18-2ee5-45c6-8863-8ee1dcbc09a3'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:44:53.872403 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-1ac05a18-2ee5-45c6-8863-8ee1dcbc09a3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'afcb65c8691d48eeb0a281fa0df89a7b', 'request_id': 'req-1ac05a18-2ee5-45c6-8863-8ee1dcbc09a3'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:44:53.886580 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-1ac05a18-2ee5-45c6-8863-8ee1dcbc09a3 admin admin] The token cache is being invalidate because project afcb65c8691d48eeb0a281fa0df89a7b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80474) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 14:44:53.886912 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-1ac05a18-2ee5-45c6-8863-8ee1dcbc09a3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:44:53.887610 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-1ac05a18-2ee5-45c6-8863-8ee1dcbc09a3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:44:53.889147 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1150/2316] 10.222.0.67 () {58 vars in 1232 bytes} [Wed May 25 14:44:53 2022] DELETE /identity/v3/projects/afcb65c8691d48eeb0a281fa0df89a7b => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:44:53.895640 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b428d2be-344c-4c23-9ee4-fd2318a3da29 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:53.896221 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b428d2be-344c-4c23-9ee4-fd2318a3da29 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:53.896469 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b428d2be-344c-4c23-9ee4-fd2318a3da29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:53.918071 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-b428d2be-344c-4c23-9ee4-fd2318a3da29 None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:44:53.919074 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-b428d2be-344c-4c23-9ee4-fd2318a3da29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:44:53.940766 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:44:54.003306 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1167/2317] 10.222.0.67 () {58 vars in 957 bytes} [Wed May 25 14:44:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:44:54.012211 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243afeb0-0cd1-4cc7-9d55-f318bc23e4d3 None None] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:54.012563 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243afeb0-0cd1-4cc7-9d55-f318bc23e4d3 None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:54.012916 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243afeb0-0cd1-4cc7-9d55-f318bc23e4d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:54.054134 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.auth.core [None req-243afeb0-0cd1-4cc7-9d55-f318bc23e4d3 None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:44:54.055430 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-243afeb0-0cd1-4cc7-9d55-f318bc23e4d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:44:54.068238 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1151/2318] 10.222.0.67 () {58 vars in 957 bytes} [Wed May 25 14:44:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:44:54.069540 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b428d2be-344c-4c23-9ee4-fd2318a3da29 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:44:54.082670 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b428d2be-344c-4c23-9ee4-fd2318a3da29 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:44:54.087508 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd627f9-be49-4140-8dc8-3dcebd578b9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:44:54.088495 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd627f9-be49-4140-8dc8-3dcebd578b9c admin admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:54.088784 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd627f9-be49-4140-8dc8-3dcebd578b9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:54.089062 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd627f9-be49-4140-8dc8-3dcebd578b9c admin admin] PATH_INFO: `/v3/domains` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:54.090041 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd627f9-be49-4140-8dc8-3dcebd578b9c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:44:54.090495 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd627f9-be49-4140-8dc8-3dcebd578b9c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:44:54.092162 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd627f9-be49-4140-8dc8-3dcebd578b9c admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:44:54.112743 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1168/2319] 10.222.0.67 () {58 vars in 1152 bytes} [Wed May 25 14:44:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:44:54.121664 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243afeb0-0cd1-4cc7-9d55-f318bc23e4d3 None None] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:44:54.132729 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243afeb0-0cd1-4cc7-9d55-f318bc23e4d3 None None] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:44:54.138665 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d55130d-35c6-4af8-88b9-8f7b6080d615 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:44:54.139508 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d55130d-35c6-4af8-88b9-8f7b6080d615 admin admin] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:54.140723 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d55130d-35c6-4af8-88b9-8f7b6080d615 admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:54.141294 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d55130d-35c6-4af8-88b9-8f7b6080d615 admin admin] PATH_INFO: `/v3/projects` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:54.142295 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d55130d-35c6-4af8-88b9-8f7b6080d615 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:44:54.144841 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d55130d-35c6-4af8-88b9-8f7b6080d615 admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:44:54.210820 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1152/2320] 10.222.0.67 () {60 vars in 1152 bytes} [Wed May 25 14:44:54 2022] POST /identity/v3/projects => generated 373 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:44:54.214108 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd627f9-be49-4140-8dc8-3dcebd578b9c admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:44:54.233211 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd627f9-be49-4140-8dc8-3dcebd578b9c admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:44:54.335371 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9896a7c9-c63e-44d1-bd8b-5d4450790976 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:44:54.335716 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9896a7c9-c63e-44d1-bd8b-5d4450790976 admin admin] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:54.336002 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9896a7c9-c63e-44d1-bd8b-5d4450790976 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:54.336283 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9896a7c9-c63e-44d1-bd8b-5d4450790976 admin admin] PATH_INFO: `/v3/users` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:54.337027 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9896a7c9-c63e-44d1-bd8b-5d4450790976 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:44:54.342066 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9896a7c9-c63e-44d1-bd8b-5d4450790976 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:44:54.370062 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1169/2321] 10.222.0.67 () {60 vars in 1143 bytes} [Wed May 25 14:44:54 2022] POST /identity/v3/users => generated 287 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 14:44:54.374369 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d55130d-35c6-4af8-88b9-8f7b6080d615 admin admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:44:54.386073 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d55130d-35c6-4af8-88b9-8f7b6080d615 admin admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:44:54.391284 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd73d3f-3c84-4893-b9b9-dc74afe091ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:44:54.392160 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd73d3f-3c84-4893-b9b9-dc74afe091ac admin admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:54.392451 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd73d3f-3c84-4893-b9b9-dc74afe091ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:54.392734 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd73d3f-3c84-4893-b9b9-dc74afe091ac admin admin] PATH_INFO: `/v3/roles` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:54.393491 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd73d3f-3c84-4893-b9b9-dc74afe091ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:44:54.395750 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd73d3f-3c84-4893-b9b9-dc74afe091ac admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:44:54.407452 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1153/2322] 10.222.0.67 () {58 vars in 1121 bytes} [Wed May 25 14:44:54 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 25 14:44:54.411850 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9896a7c9-c63e-44d1-bd8b-5d4450790976 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:44:54.425334 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9896a7c9-c63e-44d1-bd8b-5d4450790976 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:44:54.432847 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733890aa-6f5d-42d5-9ba4-62d543b8a5d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:44:54.434047 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733890aa-6f5d-42d5-9ba4-62d543b8a5d1 admin admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:54.434852 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733890aa-6f5d-42d5-9ba4-62d543b8a5d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:54.435531 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733890aa-6f5d-42d5-9ba4-62d543b8a5d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:54.436970 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733890aa-6f5d-42d5-9ba4-62d543b8a5d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:44:54.440257 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733890aa-6f5d-42d5-9ba4-62d543b8a5d1 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:44:54.459398 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1170/2323] 10.222.0.67 () {58 vars in 1121 bytes} [Wed May 25 14:44:54 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:44:54.463566 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd73d3f-3c84-4893-b9b9-dc74afe091ac admin admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:44:54.475135 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd73d3f-3c84-4893-b9b9-dc74afe091ac admin admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:44:54.479878 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e56e79-6920-4408-bf86-8abb761d1727 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:44:54.480764 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e56e79-6920-4408-bf86-8abb761d1727 admin admin] REQUEST_METHOD: `PUT` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:54.481058 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e56e79-6920-4408-bf86-8abb761d1727 admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:54.481340 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e56e79-6920-4408-bf86-8abb761d1727 admin admin] PATH_INFO: `/v3/projects/d5c8fd5239254b909e197e2c97a2522c/users/4c70290b3b664d66857030af2680105b/roles/48808901834b4d5eab2c7e6b5b03791e` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:54.509302 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e56e79-6920-4408-bf86-8abb761d1727 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d5c8fd5239254b909e197e2c97a2522c, user_id=4c70290b3b664d66857030af2680105b, role_id=48808901834b4d5eab2c7e6b5b03791e)` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:44:54.512966 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e56e79-6920-4408-bf86-8abb761d1727 admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:44:54.530144 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1154/2324] 10.222.0.67 () {60 vars in 1482 bytes} [Wed May 25 14:44:54 2022] PUT /identity/v3/projects/d5c8fd5239254b909e197e2c97a2522c/users/4c70290b3b664d66857030af2680105b/roles/48808901834b4d5eab2c7e6b5b03791e => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:44:54.541873 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0461b9c-d0d6-4eef-9c24-c6318dcb3366 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:54.542165 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0461b9c-d0d6-4eef-9c24-c6318dcb3366 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:54.542444 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0461b9c-d0d6-4eef-9c24-c6318dcb3366 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:54.572209 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-c0461b9c-d0d6-4eef-9c24-c6318dcb3366 None None] MFA Rules not processed for user `4c70290b3b664d66857030af2680105b`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:44:54.573445 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-c0461b9c-d0d6-4eef-9c24-c6318dcb3366 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:44:54.656709 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1171/2325] 10.222.0.67 () {58 vars in 957 bytes} [Wed May 25 14:44:54 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:44:54.672721 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e56e79-6920-4408-bf86-8abb761d1727 admin admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:44:54.674927 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-94e56e79-6920-4408-bf86-8abb761d1727 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:44:54.701448 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:44:54.747228 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e56e79-6920-4408-bf86-8abb761d1727 admin admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:44:54.752448 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1eda47-ecc7-43b6-a8d5-8a13c7c146df service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e462acc9da84a61bb23998dd54e1858', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfe93ee8d32a441295efc0b885de4bd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:44:54.753095 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1eda47-ecc7-43b6-a8d5-8a13c7c146df service cinder] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:54.753455 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1eda47-ecc7-43b6-a8d5-8a13c7c146df service cinder] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:54.753667 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1eda47-ecc7-43b6-a8d5-8a13c7c146df service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:54.764967 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1eda47-ecc7-43b6-a8d5-8a13c7c146df service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:44:54.766388 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1eda47-ecc7-43b6-a8d5-8a13c7c146df service cinder] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:44:54.776714 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1155/2326] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 14:44:54 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:44:54.802516 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0461b9c-d0d6-4eef-9c24-c6318dcb3366 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:44:54.832521 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:44:54.898468 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0461b9c-d0d6-4eef-9c24-c6318dcb3366 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:44:54.910718 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6486ced7-7ba7-4aab-8251-b09ec7fe084f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:44:54.911804 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6486ced7-7ba7-4aab-8251-b09ec7fe084f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:54.912201 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6486ced7-7ba7-4aab-8251-b09ec7fe084f admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:54.912732 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6486ced7-7ba7-4aab-8251-b09ec7fe084f admin admin] PATH_INFO: `/v3/users/4c70290b3b664d66857030af2680105b` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:54.914388 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6486ced7-7ba7-4aab-8251-b09ec7fe084f admin admin] RBAC: Authorizing `identity:delete_user(user_id=4c70290b3b664d66857030af2680105b)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:44:54.916998 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6486ced7-7ba7-4aab-8251-b09ec7fe084f admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:44:54.976864 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-6486ced7-7ba7-4aab-8251-b09ec7fe084f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4c70290b3b664d66857030af2680105b'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:44:54.985378 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-6486ced7-7ba7-4aab-8251-b09ec7fe084f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4c70290b3b664d66857030af2680105b'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:44:54.986051 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-6486ced7-7ba7-4aab-8251-b09ec7fe084f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4c70290b3b664d66857030af2680105b'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:44:54.994641 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-6486ced7-7ba7-4aab-8251-b09ec7fe084f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4c70290b3b664d66857030af2680105b'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:44:55.014070 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-6486ced7-7ba7-4aab-8251-b09ec7fe084f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4c70290b3b664d66857030af2680105b'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:44:55.025103 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1172/2327] 10.222.0.67 () {58 vars in 1223 bytes} [Wed May 25 14:44:54 2022] DELETE /identity/v3/users/4c70290b3b664d66857030af2680105b => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:44:55.030018 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ce924f-bd58-4fe3-b407-a491d49bbe6e None None] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:55.030616 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ce924f-bd58-4fe3-b407-a491d49bbe6e None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:55.031222 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ce924f-bd58-4fe3-b407-a491d49bbe6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:55.052396 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.auth.core [None req-61ce924f-bd58-4fe3-b407-a491d49bbe6e None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:44:55.053620 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-61ce924f-bd58-4fe3-b407-a491d49bbe6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:44:55.130250 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1156/2328] 10.222.0.67 () {58 vars in 957 bytes} [Wed May 25 14:44:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:44:55.141079 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6486ced7-7ba7-4aab-8251-b09ec7fe084f admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:44:55.142561 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-6486ced7-7ba7-4aab-8251-b09ec7fe084f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:44:55.207630 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6486ced7-7ba7-4aab-8251-b09ec7fe084f admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:44:55.211410 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1552a24f-4b0f-42b3-8049-af324fd560cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b68eed985c7b49839bcdd173186ad4ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfe93ee8d32a441295efc0b885de4bd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:44:55.212066 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1552a24f-4b0f-42b3-8049-af324fd560cf service neutron] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:55.212359 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1552a24f-4b0f-42b3-8049-af324fd560cf service neutron] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:55.212633 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1552a24f-4b0f-42b3-8049-af324fd560cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:55.222936 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1552a24f-4b0f-42b3-8049-af324fd560cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:44:55.224444 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1552a24f-4b0f-42b3-8049-af324fd560cf service neutron] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:44:55.238631 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1173/2329] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 14:44:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:44:55.602526 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ce924f-bd58-4fe3-b407-a491d49bbe6e None None] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:44:55.604087 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-61ce924f-bd58-4fe3-b407-a491d49bbe6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:44:55.616498 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ce924f-bd58-4fe3-b407-a491d49bbe6e None None] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:44:55.634047 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a3133d-03a9-4318-b4ec-a74a0927fbca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:44:55.635270 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a3133d-03a9-4318-b4ec-a74a0927fbca admin admin] REQUEST_METHOD: `DELETE` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:55.636349 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a3133d-03a9-4318-b4ec-a74a0927fbca admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:55.636349 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a3133d-03a9-4318-b4ec-a74a0927fbca admin admin] PATH_INFO: `/v3/projects/d5c8fd5239254b909e197e2c97a2522c` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:55.637067 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a3133d-03a9-4318-b4ec-a74a0927fbca admin admin] RBAC: Authorizing `identity:delete_project(project_id=d5c8fd5239254b909e197e2c97a2522c)` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:44:55.639049 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a3133d-03a9-4318-b4ec-a74a0927fbca admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:44:55.697276 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-49a3133d-03a9-4318-b4ec-a74a0927fbca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd5c8fd5239254b909e197e2c97a2522c', 'request_id': 'req-49a3133d-03a9-4318-b4ec-a74a0927fbca'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:44:55.714180 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-49a3133d-03a9-4318-b4ec-a74a0927fbca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd5c8fd5239254b909e197e2c97a2522c', 'request_id': 'req-49a3133d-03a9-4318-b4ec-a74a0927fbca'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:44:55.721659 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-49a3133d-03a9-4318-b4ec-a74a0927fbca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd5c8fd5239254b909e197e2c97a2522c', 'request_id': 'req-49a3133d-03a9-4318-b4ec-a74a0927fbca'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:44:55.734486 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-49a3133d-03a9-4318-b4ec-a74a0927fbca admin admin] The token cache is being invalidate because project d5c8fd5239254b909e197e2c97a2522c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80474) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 14:44:55.734778 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-49a3133d-03a9-4318-b4ec-a74a0927fbca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:44:55.735483 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-49a3133d-03a9-4318-b4ec-a74a0927fbca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:44:55.737045 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1157/2330] 10.222.0.67 () {58 vars in 1232 bytes} [Wed May 25 14:44:55 2022] DELETE /identity/v3/projects/d5c8fd5239254b909e197e2c97a2522c => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:44:55.742089 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a62eb6-eb6d-42b3-89ed-af13c793face None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:55.742386 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a62eb6-eb6d-42b3-89ed-af13c793face None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:55.742692 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a62eb6-eb6d-42b3-89ed-af13c793face None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:55.761482 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-a3a62eb6-eb6d-42b3-89ed-af13c793face None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:44:55.762731 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-a3a62eb6-eb6d-42b3-89ed-af13c793face None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:44:55.801836 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:44:55.842255 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1174/2331] 10.222.0.67 () {58 vars in 957 bytes} [Wed May 25 14:44:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:44:55.850313 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30d4377-44b1-45c0-8c7a-7bcc2d185802 None None] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:55.850805 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30d4377-44b1-45c0-8c7a-7bcc2d185802 None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:55.850898 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30d4377-44b1-45c0-8c7a-7bcc2d185802 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:55.870799 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.auth.core [None req-a30d4377-44b1-45c0-8c7a-7bcc2d185802 None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:44:55.871920 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-a30d4377-44b1-45c0-8c7a-7bcc2d185802 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:44:55.882455 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1158/2332] 10.222.0.67 () {58 vars in 957 bytes} [Wed May 25 14:44:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:44:55.887044 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a62eb6-eb6d-42b3-89ed-af13c793face None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:44:55.897552 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a62eb6-eb6d-42b3-89ed-af13c793face None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:44:55.902121 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb0d2af-47eb-47ee-81d4-6bfbfa585a04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:44:55.902778 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb0d2af-47eb-47ee-81d4-6bfbfa585a04 admin admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:55.903259 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb0d2af-47eb-47ee-81d4-6bfbfa585a04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:55.903595 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb0d2af-47eb-47ee-81d4-6bfbfa585a04 admin admin] PATH_INFO: `/v3/domains` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:55.904366 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb0d2af-47eb-47ee-81d4-6bfbfa585a04 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:44:55.904668 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb0d2af-47eb-47ee-81d4-6bfbfa585a04 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:44:55.907327 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb0d2af-47eb-47ee-81d4-6bfbfa585a04 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:44:55.920575 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1175/2333] 10.222.0.67 () {58 vars in 1152 bytes} [Wed May 25 14:44:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:44:55.925704 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30d4377-44b1-45c0-8c7a-7bcc2d185802 None None] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:44:55.937376 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30d4377-44b1-45c0-8c7a-7bcc2d185802 None None] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:44:55.942289 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e74be9-8c9f-4782-804e-9cbb3bb6d4ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:44:55.942956 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e74be9-8c9f-4782-804e-9cbb3bb6d4ab admin admin] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:55.943281 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e74be9-8c9f-4782-804e-9cbb3bb6d4ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:55.943578 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e74be9-8c9f-4782-804e-9cbb3bb6d4ab admin admin] PATH_INFO: `/v3/projects` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:55.944259 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e74be9-8c9f-4782-804e-9cbb3bb6d4ab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:44:55.946175 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e74be9-8c9f-4782-804e-9cbb3bb6d4ab admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:44:55.974005 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1159/2334] 10.222.0.67 () {60 vars in 1152 bytes} [Wed May 25 14:44:55 2022] POST /identity/v3/projects => generated 375 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:44:55.978479 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb0d2af-47eb-47ee-81d4-6bfbfa585a04 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:44:55.990513 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb0d2af-47eb-47ee-81d4-6bfbfa585a04 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:44:56.055865 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7251b3c-e1b0-46fc-9abc-37032a867296 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:44:56.056469 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7251b3c-e1b0-46fc-9abc-37032a867296 admin admin] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:56.056753 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7251b3c-e1b0-46fc-9abc-37032a867296 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:56.057028 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7251b3c-e1b0-46fc-9abc-37032a867296 admin admin] PATH_INFO: `/v3/users` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:56.057741 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7251b3c-e1b0-46fc-9abc-37032a867296 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:44:56.059732 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7251b3c-e1b0-46fc-9abc-37032a867296 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:44:56.087144 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1176/2335] 10.222.0.67 () {60 vars in 1143 bytes} [Wed May 25 14:44:55 2022] POST /identity/v3/users => generated 288 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 14:44:56.091801 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e74be9-8c9f-4782-804e-9cbb3bb6d4ab admin admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:44:56.103734 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e74be9-8c9f-4782-804e-9cbb3bb6d4ab admin admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:44:56.109119 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d545b7-63db-4985-8801-eac2bdbe8cbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:44:56.109840 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d545b7-63db-4985-8801-eac2bdbe8cbc admin admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:56.110135 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d545b7-63db-4985-8801-eac2bdbe8cbc admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:56.110416 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d545b7-63db-4985-8801-eac2bdbe8cbc admin admin] PATH_INFO: `/v3/roles` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:56.111210 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d545b7-63db-4985-8801-eac2bdbe8cbc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:44:56.112862 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d545b7-63db-4985-8801-eac2bdbe8cbc admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:44:56.124606 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1160/2336] 10.222.0.67 () {58 vars in 1121 bytes} [Wed May 25 14:44:56 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:44:56.128999 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7251b3c-e1b0-46fc-9abc-37032a867296 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:44:56.141987 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7251b3c-e1b0-46fc-9abc-37032a867296 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:44:56.148003 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a3f5a4-cfda-4cf7-b7de-9cb5a42498fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:44:56.148877 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a3f5a4-cfda-4cf7-b7de-9cb5a42498fa admin admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:56.149250 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a3f5a4-cfda-4cf7-b7de-9cb5a42498fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:56.149551 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a3f5a4-cfda-4cf7-b7de-9cb5a42498fa admin admin] PATH_INFO: `/v3/roles` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:56.150446 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a3f5a4-cfda-4cf7-b7de-9cb5a42498fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:44:56.152312 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a3f5a4-cfda-4cf7-b7de-9cb5a42498fa admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:44:56.166948 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1177/2337] 10.222.0.67 () {58 vars in 1121 bytes} [Wed May 25 14:44:56 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 25 14:44:56.168436 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d545b7-63db-4985-8801-eac2bdbe8cbc admin admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:44:56.180751 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d545b7-63db-4985-8801-eac2bdbe8cbc admin admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:44:56.186625 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e271c50e-d247-476c-8327-834359229644 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:44:56.188239 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e271c50e-d247-476c-8327-834359229644 admin admin] REQUEST_METHOD: `PUT` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:56.188527 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e271c50e-d247-476c-8327-834359229644 admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:56.188809 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e271c50e-d247-476c-8327-834359229644 admin admin] PATH_INFO: `/v3/projects/1d1173d711ee480a99e5fa9e7ccd7d9a/users/5c7f06210d554d25991eeca675f0e9fe/roles/48808901834b4d5eab2c7e6b5b03791e` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:56.191862 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:44:56.212363 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e271c50e-d247-476c-8327-834359229644 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d1173d711ee480a99e5fa9e7ccd7d9a, user_id=5c7f06210d554d25991eeca675f0e9fe, role_id=48808901834b4d5eab2c7e6b5b03791e)` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:44:56.214975 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e271c50e-d247-476c-8327-834359229644 admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:44:56.234589 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1161/2338] 10.222.0.67 () {60 vars in 1482 bytes} [Wed May 25 14:44:56 2022] PUT /identity/v3/projects/1d1173d711ee480a99e5fa9e7ccd7d9a/users/5c7f06210d554d25991eeca675f0e9fe/roles/48808901834b4d5eab2c7e6b5b03791e => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:44:56.247010 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd50954-6afc-4555-95de-9a91a881ca8c None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:56.247550 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd50954-6afc-4555-95de-9a91a881ca8c None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:56.248073 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd50954-6afc-4555-95de-9a91a881ca8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:56.292836 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-1cd50954-6afc-4555-95de-9a91a881ca8c None None] MFA Rules not processed for user `5c7f06210d554d25991eeca675f0e9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:44:56.294098 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-1cd50954-6afc-4555-95de-9a91a881ca8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:44:56.387355 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1178/2339] 10.222.0.67 () {58 vars in 957 bytes} [Wed May 25 14:44:56 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:44:56.398912 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e271c50e-d247-476c-8327-834359229644 admin admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:44:56.401303 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-e271c50e-d247-476c-8327-834359229644 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:44:56.485821 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e271c50e-d247-476c-8327-834359229644 admin admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:44:56.492189 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ebfb61-313a-4b2e-948e-906fcf9dfd5d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e462acc9da84a61bb23998dd54e1858', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfe93ee8d32a441295efc0b885de4bd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:44:56.492873 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ebfb61-313a-4b2e-948e-906fcf9dfd5d service cinder] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:56.493159 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ebfb61-313a-4b2e-948e-906fcf9dfd5d service cinder] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:56.493539 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ebfb61-313a-4b2e-948e-906fcf9dfd5d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:56.512469 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ebfb61-313a-4b2e-948e-906fcf9dfd5d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:44:56.513924 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ebfb61-313a-4b2e-948e-906fcf9dfd5d service cinder] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:44:56.524451 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1162/2340] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 14:44:56 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:44:57.947582 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d848d4b9-27c4-4214-b82e-6da527eb3115 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:57.948143 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d848d4b9-27c4-4214-b82e-6da527eb3115 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:57.948143 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d848d4b9-27c4-4214-b82e-6da527eb3115 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:57.966275 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-d848d4b9-27c4-4214-b82e-6da527eb3115 None None] MFA Rules not processed for user `5c7f06210d554d25991eeca675f0e9fe`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:44:57.967520 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-d848d4b9-27c4-4214-b82e-6da527eb3115 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:44:57.975513 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1179/2341] 10.222.0.67 () {58 vars in 957 bytes} [Wed May 25 14:44:57 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:45:01.598176 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7454545-21cc-4ebf-9e96-b35303cc0f2d None None] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:45:01.598878 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7454545-21cc-4ebf-9e96-b35303cc0f2d None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:45:01.599070 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7454545-21cc-4ebf-9e96-b35303cc0f2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:45:01.622545 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.auth.core [None req-b7454545-21cc-4ebf-9e96-b35303cc0f2d None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:45:01.623417 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-b7454545-21cc-4ebf-9e96-b35303cc0f2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:45:01.705889 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1163/2342] 10.222.0.91 () {58 vars in 1016 bytes} [Wed May 25 14:45:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:45:01.739072 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d848d4b9-27c4-4214-b82e-6da527eb3115 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:45:01.740644 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-d848d4b9-27c4-4214-b82e-6da527eb3115 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:45:01.791117 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:45:01.854584 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d848d4b9-27c4-4214-b82e-6da527eb3115 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:45:01.862371 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998193e9-7790-42e6-8059-3aa106c5714f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '428ec99478284743943ed41e9d24a603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfe93ee8d32a441295efc0b885de4bd7', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:45:01.863162 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998193e9-7790-42e6-8059-3aa106c5714f service nova] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:45:01.863523 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998193e9-7790-42e6-8059-3aa106c5714f service nova] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:45:01.863875 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998193e9-7790-42e6-8059-3aa106c5714f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:45:01.874520 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998193e9-7790-42e6-8059-3aa106c5714f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:45:01.877001 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998193e9-7790-42e6-8059-3aa106c5714f service nova] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:45:01.906081 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1180/2343] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 14:45:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:45:07.699690 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b655dcf0-e997-48af-881d-c324d6303f84 None None] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:45:07.700268 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b655dcf0-e997-48af-881d-c324d6303f84 None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:45:07.700268 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b655dcf0-e997-48af-881d-c324d6303f84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:45:07.721494 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.auth.core [None req-b655dcf0-e997-48af-881d-c324d6303f84 None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:45:07.722727 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-b655dcf0-e997-48af-881d-c324d6303f84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:45:07.730729 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1164/2344] 10.222.0.91 () {58 vars in 1016 bytes} [Wed May 25 14:45:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:45:07.764898 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998193e9-7790-42e6-8059-3aa106c5714f service nova] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:45:07.766879 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-998193e9-7790-42e6-8059-3aa106c5714f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:45:07.783189 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998193e9-7790-42e6-8059-3aa106c5714f service nova] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:45:07.789181 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41e8e32-97f6-44e9-b34a-ff1d58f17e0a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '428ec99478284743943ed41e9d24a603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfe93ee8d32a441295efc0b885de4bd7', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:45:07.789895 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41e8e32-97f6-44e9-b34a-ff1d58f17e0a service nova] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:45:07.790181 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41e8e32-97f6-44e9-b34a-ff1d58f17e0a service nova] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:45:07.790456 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41e8e32-97f6-44e9-b34a-ff1d58f17e0a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:45:07.800217 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41e8e32-97f6-44e9-b34a-ff1d58f17e0a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:45:07.801817 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41e8e32-97f6-44e9-b34a-ff1d58f17e0a service nova] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:45:07.812664 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1181/2345] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 14:45:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:45:09.704426 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcde0890-543a-44e8-bc25-5e5e753981d4 None None] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:45:09.705079 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcde0890-543a-44e8-bc25-5e5e753981d4 None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:45:09.705079 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcde0890-543a-44e8-bc25-5e5e753981d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:45:09.726494 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.auth.core [None req-bcde0890-543a-44e8-bc25-5e5e753981d4 None None] MFA Rules not processed for user `e03f5bb82ffb41a1b1dde935d093e6f4`. Rule list: `[]` (Enabled: `True`). {{(pid=80474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:45:09.727750 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-bcde0890-543a-44e8-bc25-5e5e753981d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:45:09.801602 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1165/2346] 10.222.0.67 () {58 vars in 967 bytes} [Wed May 25 14:45:09 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 14:45:09.820747 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41e8e32-97f6-44e9-b34a-ff1d58f17e0a service nova] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:45:09.822248 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-d41e8e32-97f6-44e9-b34a-ff1d58f17e0a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:45:09.920066 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41e8e32-97f6-44e9-b34a-ff1d58f17e0a service nova] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:45:09.926917 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6585b2b-2a08-4694-82a6-d7f0d1da7fd2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbe9e38881834198842a476889678096', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfe93ee8d32a441295efc0b885de4bd7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:45:09.927643 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6585b2b-2a08-4694-82a6-d7f0d1da7fd2 service swift] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:45:09.927928 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6585b2b-2a08-4694-82a6-d7f0d1da7fd2 service swift] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:45:09.928208 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6585b2b-2a08-4694-82a6-d7f0d1da7fd2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:45:09.939684 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6585b2b-2a08-4694-82a6-d7f0d1da7fd2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:45:09.942237 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6585b2b-2a08-4694-82a6-d7f0d1da7fd2 service swift] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:45:09.956501 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1182/2347] 10.222.0.67 () {60 vars in 1384 bytes} [Wed May 25 14:45:09 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 25 14:45:14.110561 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05854ff7-b06c-4239-a5b3-eb82378c28b0 None None] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:45:14.111145 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05854ff7-b06c-4239-a5b3-eb82378c28b0 None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:45:14.111145 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05854ff7-b06c-4239-a5b3-eb82378c28b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:45:14.130452 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.auth.core [None req-05854ff7-b06c-4239-a5b3-eb82378c28b0 None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:45:14.131695 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-05854ff7-b06c-4239-a5b3-eb82378c28b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:45:14.140451 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1166/2348] 10.222.0.91 () {58 vars in 1016 bytes} [Wed May 25 14:45:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:45:14.173621 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6585b2b-2a08-4694-82a6-d7f0d1da7fd2 service swift] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:45:14.185605 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6585b2b-2a08-4694-82a6-d7f0d1da7fd2 service swift] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:45:14.192082 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b304b660-a4cc-4f20-831e-178d307bd5fa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '428ec99478284743943ed41e9d24a603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfe93ee8d32a441295efc0b885de4bd7', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:45:14.192722 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b304b660-a4cc-4f20-831e-178d307bd5fa service nova] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:45:14.193012 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b304b660-a4cc-4f20-831e-178d307bd5fa service nova] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:45:14.193296 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b304b660-a4cc-4f20-831e-178d307bd5fa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:45:14.202421 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b304b660-a4cc-4f20-831e-178d307bd5fa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:45:14.204009 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b304b660-a4cc-4f20-831e-178d307bd5fa service nova] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:45:14.216957 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1183/2349] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 14:45:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:45:19.200692 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a49cc8-b2ec-4007-895b-015f5475d34a None None] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:45:19.201276 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a49cc8-b2ec-4007-895b-015f5475d34a None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:45:19.201276 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a49cc8-b2ec-4007-895b-015f5475d34a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:45:19.220931 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.auth.core [None req-95a49cc8-b2ec-4007-895b-015f5475d34a None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:45:19.222136 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-95a49cc8-b2ec-4007-895b-015f5475d34a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:45:19.230045 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1167/2350] 10.222.0.91 () {58 vars in 1016 bytes} [Wed May 25 14:45:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 14:45:19.257183 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b304b660-a4cc-4f20-831e-178d307bd5fa service nova] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:45:19.269357 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b304b660-a4cc-4f20-831e-178d307bd5fa service nova] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:45:19.275033 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51b6654-8fd2-4c67-9e75-c055e421fcde service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '428ec99478284743943ed41e9d24a603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfe93ee8d32a441295efc0b885de4bd7', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:45:19.275684 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51b6654-8fd2-4c67-9e75-c055e421fcde service nova] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:45:19.275968 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51b6654-8fd2-4c67-9e75-c055e421fcde service nova] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:45:19.276244 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51b6654-8fd2-4c67-9e75-c055e421fcde service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:45:19.285707 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51b6654-8fd2-4c67-9e75-c055e421fcde service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:45:19.287351 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51b6654-8fd2-4c67-9e75-c055e421fcde service nova] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:45:19.298154 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1184/2351] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 14:45:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:45:26.482600 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c50ef32-d2f7-4b5c-afa4-6689c59f0ff3 None None] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:45:26.483810 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c50ef32-d2f7-4b5c-afa4-6689c59f0ff3 None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:45:26.483933 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c50ef32-d2f7-4b5c-afa4-6689c59f0ff3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:45:26.492158 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=95,keystone:INSERT=1 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:45:26.507584 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.auth.core [None req-1c50ef32-d2f7-4b5c-afa4-6689c59f0ff3 None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:45:26.509059 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-1c50ef32-d2f7-4b5c-afa4-6689c59f0ff3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:45:26.519082 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1168/2352] 10.222.0.91 () {58 vars in 1016 bytes} [Wed May 25 14:45:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:45:26.548548 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51b6654-8fd2-4c67-9e75-c055e421fcde service nova] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:45:26.560324 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51b6654-8fd2-4c67-9e75-c055e421fcde service nova] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:45:26.566623 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3f1f7c-8f4e-4c0d-a937-ff280ec7d89a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '428ec99478284743943ed41e9d24a603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfe93ee8d32a441295efc0b885de4bd7', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:45:26.567321 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3f1f7c-8f4e-4c0d-a937-ff280ec7d89a service nova] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:45:26.567607 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3f1f7c-8f4e-4c0d-a937-ff280ec7d89a service nova] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:45:26.567881 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3f1f7c-8f4e-4c0d-a937-ff280ec7d89a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:45:26.577057 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3f1f7c-8f4e-4c0d-a937-ff280ec7d89a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:45:26.579610 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3f1f7c-8f4e-4c0d-a937-ff280ec7d89a service nova] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:45:26.591497 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1185/2353] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 14:45:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:45:30.482349 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cceeb074-e3b3-41be-a08b-97f71602b83b None None] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:45:30.482846 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cceeb074-e3b3-41be-a08b-97f71602b83b None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:45:30.482961 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cceeb074-e3b3-41be-a08b-97f71602b83b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:45:30.500981 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.auth.core [None req-cceeb074-e3b3-41be-a08b-97f71602b83b None None] MFA Rules not processed for user `e03f5bb82ffb41a1b1dde935d093e6f4`. Rule list: `[]` (Enabled: `True`). {{(pid=80474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:45:30.502205 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-cceeb074-e3b3-41be-a08b-97f71602b83b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:45:30.509827 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1169/2354] 10.222.0.67 () {58 vars in 1009 bytes} [Wed May 25 14:45:30 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:45:30.522617 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3f1f7c-8f4e-4c0d-a937-ff280ec7d89a service nova] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:45:30.534771 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3f1f7c-8f4e-4c0d-a937-ff280ec7d89a service nova] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:45:30.539825 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2c6fa5-453e-4e0e-9c9b-e38011d8bc36 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbe9e38881834198842a476889678096', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfe93ee8d32a441295efc0b885de4bd7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:45:30.540465 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2c6fa5-453e-4e0e-9c9b-e38011d8bc36 service swift] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:45:30.540778 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2c6fa5-453e-4e0e-9c9b-e38011d8bc36 service swift] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:45:30.541057 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2c6fa5-453e-4e0e-9c9b-e38011d8bc36 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:45:30.550070 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2c6fa5-453e-4e0e-9c9b-e38011d8bc36 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:45:30.551658 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2c6fa5-453e-4e0e-9c9b-e38011d8bc36 service swift] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:45:30.560158 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1186/2355] 10.222.0.67 () {60 vars in 1384 bytes} [Wed May 25 14:45:30 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 25 14:45:31.174660 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc3e944-9b77-4a7b-a8e2-5dd284303b2c None None] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:45:31.174956 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc3e944-9b77-4a7b-a8e2-5dd284303b2c None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:45:31.175295 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc3e944-9b77-4a7b-a8e2-5dd284303b2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:45:31.193536 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.auth.core [None req-5fc3e944-9b77-4a7b-a8e2-5dd284303b2c None None] MFA Rules not processed for user `e03f5bb82ffb41a1b1dde935d093e6f4`. Rule list: `[]` (Enabled: `True`). {{(pid=80474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:45:31.194766 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-5fc3e944-9b77-4a7b-a8e2-5dd284303b2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:45:31.202634 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1170/2356] 10.222.0.67 () {58 vars in 967 bytes} [Wed May 25 14:45:31 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 14:45:31.216488 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2c6fa5-453e-4e0e-9c9b-e38011d8bc36 service swift] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:45:31.228091 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2c6fa5-453e-4e0e-9c9b-e38011d8bc36 service swift] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:45:31.233994 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8816dd8-5f0a-4728-9fb7-04d0635baeae service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbe9e38881834198842a476889678096', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfe93ee8d32a441295efc0b885de4bd7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:45:31.234768 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8816dd8-5f0a-4728-9fb7-04d0635baeae service swift] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:45:31.235117 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8816dd8-5f0a-4728-9fb7-04d0635baeae service swift] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:45:31.235372 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8816dd8-5f0a-4728-9fb7-04d0635baeae service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:45:31.244905 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8816dd8-5f0a-4728-9fb7-04d0635baeae service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:45:31.246530 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8816dd8-5f0a-4728-9fb7-04d0635baeae service swift] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:45:31.256119 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1187/2357] 10.222.0.67 () {60 vars in 1384 bytes} [Wed May 25 14:45:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 25 14:45:31.518478 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce77c1b0-8d89-4e33-8d04-ec3ab698d866 None None] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:45:31.519396 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce77c1b0-8d89-4e33-8d04-ec3ab698d866 None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:45:31.519882 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce77c1b0-8d89-4e33-8d04-ec3ab698d866 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:45:31.540625 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.auth.core [None req-ce77c1b0-8d89-4e33-8d04-ec3ab698d866 None None] MFA Rules not processed for user `e03f5bb82ffb41a1b1dde935d093e6f4`. Rule list: `[]` (Enabled: `True`). {{(pid=80474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:45:31.541853 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-ce77c1b0-8d89-4e33-8d04-ec3ab698d866 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:45:31.551265 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1171/2358] 10.222.0.67 () {58 vars in 1009 bytes} [Wed May 25 14:45:31 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:45:31.568065 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8816dd8-5f0a-4728-9fb7-04d0635baeae service swift] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:45:31.582259 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8816dd8-5f0a-4728-9fb7-04d0635baeae service swift] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:45:31.589961 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1884acd8-930a-40a1-93b3-e21be436eac6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbe9e38881834198842a476889678096', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfe93ee8d32a441295efc0b885de4bd7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:45:31.590779 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1884acd8-930a-40a1-93b3-e21be436eac6 service swift] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:45:31.594717 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1884acd8-930a-40a1-93b3-e21be436eac6 service swift] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:45:31.594717 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1884acd8-930a-40a1-93b3-e21be436eac6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:45:31.605831 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1884acd8-930a-40a1-93b3-e21be436eac6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:45:31.609439 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1884acd8-930a-40a1-93b3-e21be436eac6 service swift] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:45:31.622733 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1188/2359] 10.222.0.67 () {60 vars in 1384 bytes} [Wed May 25 14:45:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 25 14:45:31.785853 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716ba2b1-7cfc-40b6-a014-801fab28e69f None None] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:45:31.786705 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716ba2b1-7cfc-40b6-a014-801fab28e69f None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:45:31.787203 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716ba2b1-7cfc-40b6-a014-801fab28e69f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:45:31.819546 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.auth.core [None req-716ba2b1-7cfc-40b6-a014-801fab28e69f None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:45:31.822137 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-716ba2b1-7cfc-40b6-a014-801fab28e69f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:45:31.854956 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1172/2360] 10.222.0.91 () {58 vars in 1016 bytes} [Wed May 25 14:45:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:45:31.894062 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1884acd8-930a-40a1-93b3-e21be436eac6 service swift] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:45:31.900397 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=96 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:45:31.911857 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1884acd8-930a-40a1-93b3-e21be436eac6 service swift] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:45:31.917954 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623b4e1b-7337-4669-ae54-b60b1229c86e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '428ec99478284743943ed41e9d24a603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfe93ee8d32a441295efc0b885de4bd7', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:45:31.918695 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623b4e1b-7337-4669-ae54-b60b1229c86e service nova] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:45:31.919087 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623b4e1b-7337-4669-ae54-b60b1229c86e service nova] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:45:31.919370 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623b4e1b-7337-4669-ae54-b60b1229c86e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:45:31.932697 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623b4e1b-7337-4669-ae54-b60b1229c86e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:45:31.934309 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623b4e1b-7337-4669-ae54-b60b1229c86e service nova] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:45:31.979420 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1189/2361] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 14:45:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:45:32.084374 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca900031-5438-44b3-80f9-8564886022ec None None] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:45:32.084683 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca900031-5438-44b3-80f9-8564886022ec None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:45:32.085263 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca900031-5438-44b3-80f9-8564886022ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:45:32.105480 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.auth.core [None req-ca900031-5438-44b3-80f9-8564886022ec None None] MFA Rules not processed for user `e03f5bb82ffb41a1b1dde935d093e6f4`. Rule list: `[]` (Enabled: `True`). {{(pid=80474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:45:32.106709 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-ca900031-5438-44b3-80f9-8564886022ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:45:32.115734 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1173/2362] 10.222.0.67 () {58 vars in 967 bytes} [Wed May 25 14:45:32 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:45:32.132549 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623b4e1b-7337-4669-ae54-b60b1229c86e service nova] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:45:32.145829 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623b4e1b-7337-4669-ae54-b60b1229c86e service nova] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:45:32.150775 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361cd5aa-9c49-43aa-bbc5-7cc1d60c92d7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbe9e38881834198842a476889678096', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfe93ee8d32a441295efc0b885de4bd7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:45:32.151452 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361cd5aa-9c49-43aa-bbc5-7cc1d60c92d7 service swift] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:45:32.151740 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361cd5aa-9c49-43aa-bbc5-7cc1d60c92d7 service swift] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:45:32.152024 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361cd5aa-9c49-43aa-bbc5-7cc1d60c92d7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:45:32.161483 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361cd5aa-9c49-43aa-bbc5-7cc1d60c92d7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:45:32.163135 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361cd5aa-9c49-43aa-bbc5-7cc1d60c92d7 service swift] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:45:32.172447 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1190/2363] 10.222.0.67 () {60 vars in 1384 bytes} [Wed May 25 14:45:32 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 25 14:45:34.381510 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca900031-5438-44b3-80f9-8564886022ec None None] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:45:34.393890 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca900031-5438-44b3-80f9-8564886022ec None None] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:45:34.398463 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c50e61-0275-4316-bfdb-33ad24453e34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:45:34.399378 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c50e61-0275-4316-bfdb-33ad24453e34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:45:34.399664 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c50e61-0275-4316-bfdb-33ad24453e34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:45:34.399964 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c50e61-0275-4316-bfdb-33ad24453e34 admin admin] PATH_INFO: `/v3/users/5c7f06210d554d25991eeca675f0e9fe` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:45:34.401180 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c50e61-0275-4316-bfdb-33ad24453e34 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5c7f06210d554d25991eeca675f0e9fe)` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:45:34.403188 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c50e61-0275-4316-bfdb-33ad24453e34 admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:45:34.466288 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-d6c50e61-0275-4316-bfdb-33ad24453e34 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5c7f06210d554d25991eeca675f0e9fe'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:45:34.466945 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-d6c50e61-0275-4316-bfdb-33ad24453e34 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5c7f06210d554d25991eeca675f0e9fe'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:45:34.467699 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-d6c50e61-0275-4316-bfdb-33ad24453e34 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5c7f06210d554d25991eeca675f0e9fe'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:45:34.480837 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-d6c50e61-0275-4316-bfdb-33ad24453e34 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5c7f06210d554d25991eeca675f0e9fe'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:45:34.489027 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-d6c50e61-0275-4316-bfdb-33ad24453e34 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5c7f06210d554d25991eeca675f0e9fe'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:45:34.509358 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1174/2364] 10.222.0.67 () {58 vars in 1223 bytes} [Wed May 25 14:45:34 2022] DELETE /identity/v3/users/5c7f06210d554d25991eeca675f0e9fe => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:45:34.515495 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fe4494-9060-4e3e-bc52-991468a5958a None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:45:34.516010 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fe4494-9060-4e3e-bc52-991468a5958a None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:45:34.516106 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fe4494-9060-4e3e-bc52-991468a5958a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:45:34.536738 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-e9fe4494-9060-4e3e-bc52-991468a5958a None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:45:34.538064 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-e9fe4494-9060-4e3e-bc52-991468a5958a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:45:34.614820 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1191/2365] 10.222.0.67 () {58 vars in 957 bytes} [Wed May 25 14:45:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:45:34.625469 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c50e61-0275-4316-bfdb-33ad24453e34 admin admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:45:34.626977 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-d6c50e61-0275-4316-bfdb-33ad24453e34 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:45:34.691644 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c50e61-0275-4316-bfdb-33ad24453e34 admin admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:45:34.696579 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f063de-0564-457d-8649-bf712a767a40 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b68eed985c7b49839bcdd173186ad4ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfe93ee8d32a441295efc0b885de4bd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:45:34.697357 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f063de-0564-457d-8649-bf712a767a40 service neutron] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:45:34.697735 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f063de-0564-457d-8649-bf712a767a40 service neutron] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:45:34.698083 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f063de-0564-457d-8649-bf712a767a40 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:45:34.709775 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f063de-0564-457d-8649-bf712a767a40 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:45:34.712567 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f063de-0564-457d-8649-bf712a767a40 service neutron] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:45:34.723978 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1175/2366] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 14:45:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:45:35.012511 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fe4494-9060-4e3e-bc52-991468a5958a None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:45:35.015390 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-e9fe4494-9060-4e3e-bc52-991468a5958a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:45:35.032490 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fe4494-9060-4e3e-bc52-991468a5958a None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:45:35.040681 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0c3336-ef1c-47ae-8dca-0dffaa5bc8a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:45:35.042002 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0c3336-ef1c-47ae-8dca-0dffaa5bc8a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:45:35.042479 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0c3336-ef1c-47ae-8dca-0dffaa5bc8a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:45:35.042973 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0c3336-ef1c-47ae-8dca-0dffaa5bc8a9 admin admin] PATH_INFO: `/v3/projects/1d1173d711ee480a99e5fa9e7ccd7d9a` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:45:35.044459 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0c3336-ef1c-47ae-8dca-0dffaa5bc8a9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1d1173d711ee480a99e5fa9e7ccd7d9a)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:45:35.048084 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0c3336-ef1c-47ae-8dca-0dffaa5bc8a9 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:45:35.105560 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-aa0c3336-ef1c-47ae-8dca-0dffaa5bc8a9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1d1173d711ee480a99e5fa9e7ccd7d9a', 'request_id': 'req-aa0c3336-ef1c-47ae-8dca-0dffaa5bc8a9'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:45:35.113938 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-aa0c3336-ef1c-47ae-8dca-0dffaa5bc8a9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1d1173d711ee480a99e5fa9e7ccd7d9a', 'request_id': 'req-aa0c3336-ef1c-47ae-8dca-0dffaa5bc8a9'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:45:35.121335 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-aa0c3336-ef1c-47ae-8dca-0dffaa5bc8a9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1d1173d711ee480a99e5fa9e7ccd7d9a', 'request_id': 'req-aa0c3336-ef1c-47ae-8dca-0dffaa5bc8a9'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:45:35.136506 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-aa0c3336-ef1c-47ae-8dca-0dffaa5bc8a9 admin admin] The token cache is being invalidate because project 1d1173d711ee480a99e5fa9e7ccd7d9a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80475) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 14:45:35.137007 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-aa0c3336-ef1c-47ae-8dca-0dffaa5bc8a9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:45:35.137638 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-aa0c3336-ef1c-47ae-8dca-0dffaa5bc8a9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:45:35.139603 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1192/2367] 10.222.0.67 () {58 vars in 1232 bytes} [Wed May 25 14:45:35 2022] DELETE /identity/v3/projects/1d1173d711ee480a99e5fa9e7ccd7d9a => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:45:44.718273 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=72,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:45:45.133000 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=65,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:45:50.382786 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c57455-6f8e-4379-85d3-7e5d0f96f2d9 None None] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:45:50.383356 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c57455-6f8e-4379-85d3-7e5d0f96f2d9 None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:45:50.383459 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c57455-6f8e-4379-85d3-7e5d0f96f2d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:45:50.402696 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.auth.core [None req-20c57455-6f8e-4379-85d3-7e5d0f96f2d9 None None] MFA Rules not processed for user `2aacb4ee87124e21ba9f2f811f3c65a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:45:50.403954 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-20c57455-6f8e-4379-85d3-7e5d0f96f2d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:45:50.461943 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1176/2368] 10.222.0.67 () {58 vars in 957 bytes} [Wed May 25 14:45:50 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:46:00.361424 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19fbcd9-a5d4-4c7c-9420-e9f2faec9504 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:46:00.362071 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19fbcd9-a5d4-4c7c-9420-e9f2faec9504 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:46:00.362357 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19fbcd9-a5d4-4c7c-9420-e9f2faec9504 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:46:00.384551 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-f19fbcd9-a5d4-4c7c-9420-e9f2faec9504 None None] MFA Rules not processed for user `54a9a5bdd9674c1f9700800609062675`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:46:00.386047 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-f19fbcd9-a5d4-4c7c-9420-e9f2faec9504 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:46:00.454811 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=25 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:46:00.462941 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1193/2369] 10.222.0.67 () {58 vars in 957 bytes} [Wed May 25 14:46:00 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 14:46:10.451272 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=25 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:46:12.371111 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de526c3-b27d-4c59-87ab-66faa2dca650 None None] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:46:12.371681 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de526c3-b27d-4c59-87ab-66faa2dca650 None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:46:12.371916 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de526c3-b27d-4c59-87ab-66faa2dca650 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:46:12.396938 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.auth.core [None req-8de526c3-b27d-4c59-87ab-66faa2dca650 None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:46:12.398497 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-8de526c3-b27d-4c59-87ab-66faa2dca650 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:46:12.478850 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1177/2370] 10.222.0.91 () {58 vars in 1016 bytes} [Wed May 25 14:46:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:46:12.506964 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19fbcd9-a5d4-4c7c-9420-e9f2faec9504 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:46:12.509226 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-f19fbcd9-a5d4-4c7c-9420-e9f2faec9504 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:46:12.588829 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19fbcd9-a5d4-4c7c-9420-e9f2faec9504 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:46:12.598618 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb351a1-3463-4e5e-bb5b-02f24f2fc9f4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '428ec99478284743943ed41e9d24a603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfe93ee8d32a441295efc0b885de4bd7', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:46:12.599323 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb351a1-3463-4e5e-bb5b-02f24f2fc9f4 service nova] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:46:12.599613 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb351a1-3463-4e5e-bb5b-02f24f2fc9f4 service nova] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:46:12.599900 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb351a1-3463-4e5e-bb5b-02f24f2fc9f4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:46:12.609499 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb351a1-3463-4e5e-bb5b-02f24f2fc9f4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:46:12.611156 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb351a1-3463-4e5e-bb5b-02f24f2fc9f4 service nova] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:46:12.621979 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1194/2371] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 14:46:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:46:13.828296 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b12b40-13cc-4883-845f-c41ebe6d4319 None None] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:46:13.828845 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b12b40-13cc-4883-845f-c41ebe6d4319 None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:46:13.828845 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b12b40-13cc-4883-845f-c41ebe6d4319 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:46:13.848757 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.auth.core [None req-53b12b40-13cc-4883-845f-c41ebe6d4319 None None] MFA Rules not processed for user `4db7e98c4244461daf725c699fb2b9a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:46:13.849969 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-53b12b40-13cc-4883-845f-c41ebe6d4319 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:46:13.913286 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1178/2372] 10.222.0.67 () {58 vars in 957 bytes} [Wed May 25 14:46:13 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 14:46:16.671208 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423ab09c-616e-4a0e-a834-ed63c0b2a654 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:46:16.671804 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423ab09c-616e-4a0e-a834-ed63c0b2a654 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:46:16.671804 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423ab09c-616e-4a0e-a834-ed63c0b2a654 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:46:16.692284 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-423ab09c-616e-4a0e-a834-ed63c0b2a654 None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:46:16.693756 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-423ab09c-616e-4a0e-a834-ed63c0b2a654 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:46:16.703932 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1195/2373] 10.222.0.91 () {58 vars in 1016 bytes} [Wed May 25 14:46:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:46:16.737945 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b12b40-13cc-4883-845f-c41ebe6d4319 None None] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:46:16.754318 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b12b40-13cc-4883-845f-c41ebe6d4319 None None] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:46:16.760305 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdf87d6-7dad-4966-844e-55db3b851c59 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '428ec99478284743943ed41e9d24a603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfe93ee8d32a441295efc0b885de4bd7', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:46:16.761223 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdf87d6-7dad-4966-844e-55db3b851c59 service nova] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:46:16.761593 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdf87d6-7dad-4966-844e-55db3b851c59 service nova] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:46:16.761948 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdf87d6-7dad-4966-844e-55db3b851c59 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:46:16.772268 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdf87d6-7dad-4966-844e-55db3b851c59 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:46:16.774295 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdf87d6-7dad-4966-844e-55db3b851c59 service nova] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:46:16.787932 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1179/2374] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 14:46:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:46:20.776279 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e01945-29fe-47a0-b1a8-9289e6c39f1d None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:46:20.776913 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e01945-29fe-47a0-b1a8-9289e6c39f1d None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:46:20.776913 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e01945-29fe-47a0-b1a8-9289e6c39f1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:46:20.798075 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-50e01945-29fe-47a0-b1a8-9289e6c39f1d None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:46:20.800068 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-50e01945-29fe-47a0-b1a8-9289e6c39f1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:46:20.811659 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1196/2375] 10.222.0.91 () {58 vars in 1016 bytes} [Wed May 25 14:46:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:46:20.846137 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdf87d6-7dad-4966-844e-55db3b851c59 service nova] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:46:20.847613 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-4cdf87d6-7dad-4966-844e-55db3b851c59 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:46:20.864379 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdf87d6-7dad-4966-844e-55db3b851c59 service nova] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:46:20.869938 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a76433-9acd-4f70-855f-50e009ab6278 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '428ec99478284743943ed41e9d24a603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfe93ee8d32a441295efc0b885de4bd7', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:46:20.870526 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a76433-9acd-4f70-855f-50e009ab6278 service nova] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:46:20.870813 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a76433-9acd-4f70-855f-50e009ab6278 service nova] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:46:20.871130 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a76433-9acd-4f70-855f-50e009ab6278 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:46:20.880889 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a76433-9acd-4f70-855f-50e009ab6278 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:46:20.882472 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a76433-9acd-4f70-855f-50e009ab6278 service nova] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:46:20.893217 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1180/2376] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 14:46:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 14:46:24.980815 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49f7d17-0e1b-4a33-9f28-eacb5f38fdce None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:46:24.981366 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49f7d17-0e1b-4a33-9f28-eacb5f38fdce None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:46:24.981366 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49f7d17-0e1b-4a33-9f28-eacb5f38fdce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:46:25.004343 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-a49f7d17-0e1b-4a33-9f28-eacb5f38fdce None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:46:25.005604 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-a49f7d17-0e1b-4a33-9f28-eacb5f38fdce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:46:25.022662 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1197/2377] 10.222.0.91 () {58 vars in 1016 bytes} [Wed May 25 14:46:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 14:46:25.046502 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a76433-9acd-4f70-855f-50e009ab6278 service nova] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:46:25.058640 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a76433-9acd-4f70-855f-50e009ab6278 service nova] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:46:25.067722 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274b4da6-0af2-4258-8f32-c8139f96c156 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '428ec99478284743943ed41e9d24a603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfe93ee8d32a441295efc0b885de4bd7', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:46:25.069045 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274b4da6-0af2-4258-8f32-c8139f96c156 service nova] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:46:25.069310 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274b4da6-0af2-4258-8f32-c8139f96c156 service nova] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:46:25.069595 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274b4da6-0af2-4258-8f32-c8139f96c156 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:46:25.082011 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274b4da6-0af2-4258-8f32-c8139f96c156 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:46:25.083711 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274b4da6-0af2-4258-8f32-c8139f96c156 service nova] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:46:25.095028 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1181/2378] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 14:46:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 14:46:29.203578 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d491963-76cb-4107-bfab-a2683d19c8b8 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:46:29.204186 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d491963-76cb-4107-bfab-a2683d19c8b8 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:46:29.204186 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d491963-76cb-4107-bfab-a2683d19c8b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:46:29.224397 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-7d491963-76cb-4107-bfab-a2683d19c8b8 None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:46:29.225613 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-7d491963-76cb-4107-bfab-a2683d19c8b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:46:29.234953 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1198/2379] 10.222.0.91 () {58 vars in 1016 bytes} [Wed May 25 14:46:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:46:29.270950 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274b4da6-0af2-4258-8f32-c8139f96c156 service nova] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:46:29.292022 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274b4da6-0af2-4258-8f32-c8139f96c156 service nova] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:46:29.298978 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc885b2b-ce5c-48c0-b77e-82a9f9b1b3a2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '428ec99478284743943ed41e9d24a603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfe93ee8d32a441295efc0b885de4bd7', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:46:29.299665 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc885b2b-ce5c-48c0-b77e-82a9f9b1b3a2 service nova] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:46:29.299949 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc885b2b-ce5c-48c0-b77e-82a9f9b1b3a2 service nova] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:46:29.300227 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc885b2b-ce5c-48c0-b77e-82a9f9b1b3a2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:46:29.309417 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc885b2b-ce5c-48c0-b77e-82a9f9b1b3a2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:46:29.311749 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc885b2b-ce5c-48c0-b77e-82a9f9b1b3a2 service nova] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:46:29.321680 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1182/2380] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 14:46:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:46:37.202304 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d491963-76cb-4107-bfab-a2683d19c8b8 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:46:37.204669 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-7d491963-76cb-4107-bfab-a2683d19c8b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:46:37.285901 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d491963-76cb-4107-bfab-a2683d19c8b8 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:46:37.290179 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670a5d42-7448-4e75-af64-e553107139d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b68eed985c7b49839bcdd173186ad4ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfe93ee8d32a441295efc0b885de4bd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:46:37.291028 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670a5d42-7448-4e75-af64-e553107139d3 service neutron] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:46:37.291316 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670a5d42-7448-4e75-af64-e553107139d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:46:37.291596 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670a5d42-7448-4e75-af64-e553107139d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:46:37.293643 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-670a5d42-7448-4e75-af64-e553107139d3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:46:37.310076 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670a5d42-7448-4e75-af64-e553107139d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:46:37.311814 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670a5d42-7448-4e75-af64-e553107139d3 service neutron] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:46:37.326583 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1199/2381] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 14:46:37 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:46:38.203300 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc885b2b-ce5c-48c0-b77e-82a9f9b1b3a2 service nova] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:46:38.204777 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-bc885b2b-ce5c-48c0-b77e-82a9f9b1b3a2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:46:38.218333 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc885b2b-ce5c-48c0-b77e-82a9f9b1b3a2 service nova] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:46:38.222112 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bed5b8-5663-4328-b18b-b631ea268254 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b68eed985c7b49839bcdd173186ad4ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfe93ee8d32a441295efc0b885de4bd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:46:38.222787 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bed5b8-5663-4328-b18b-b631ea268254 service neutron] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:46:38.223112 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bed5b8-5663-4328-b18b-b631ea268254 service neutron] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:46:38.223398 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bed5b8-5663-4328-b18b-b631ea268254 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:46:38.225276 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-b3bed5b8-5663-4328-b18b-b631ea268254 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:46:38.240080 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bed5b8-5663-4328-b18b-b631ea268254 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:46:38.241681 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bed5b8-5663-4328-b18b-b631ea268254 service neutron] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:46:38.255303 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1183/2382] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 14:46:38 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:46:45.209600 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc857d3-1b1a-47d7-a2f0-767395082f9c None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:46:45.210152 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc857d3-1b1a-47d7-a2f0-767395082f9c None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:46:45.210152 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc857d3-1b1a-47d7-a2f0-767395082f9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:46:45.216746 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=73 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:46:45.230967 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-efc857d3-1b1a-47d7-a2f0-767395082f9c None None] MFA Rules not processed for user `ff5a1f15e8d54a68946c8ccfdd4a3587`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:46:45.232887 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-efc857d3-1b1a-47d7-a2f0-767395082f9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:46:45.293345 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1200/2383] 10.222.0.67 () {58 vars in 957 bytes} [Wed May 25 14:46:45 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:46:45.965129 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bed5b8-5663-4328-b18b-b631ea268254 service neutron] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:46:45.967282 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-b3bed5b8-5663-4328-b18b-b631ea268254 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:46:45.973397 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=83 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:46:46.058237 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bed5b8-5663-4328-b18b-b631ea268254 service neutron] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:46:46.064202 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67da27a6-f03b-43cd-837f-eb42e7d82f90 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad2b99c2122a4311996364e982e1c801', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfe93ee8d32a441295efc0b885de4bd7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:46:46.064936 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67da27a6-f03b-43cd-837f-eb42e7d82f90 service placement] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:46:46.065282 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67da27a6-f03b-43cd-837f-eb42e7d82f90 service placement] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:46:46.065628 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67da27a6-f03b-43cd-837f-eb42e7d82f90 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:46:46.067607 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-67da27a6-f03b-43cd-837f-eb42e7d82f90 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:46:46.081015 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67da27a6-f03b-43cd-837f-eb42e7d82f90 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:46:46.082645 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67da27a6-f03b-43cd-837f-eb42e7d82f90 service placement] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:46:46.093437 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1184/2384] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 14:46:45 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:46:54.873122 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc857d3-1b1a-47d7-a2f0-767395082f9c None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:46:54.899494 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc857d3-1b1a-47d7-a2f0-767395082f9c None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:46:54.906392 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1b771b-3116-49f8-b616-f33a3888e215 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b68eed985c7b49839bcdd173186ad4ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfe93ee8d32a441295efc0b885de4bd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:46:54.908035 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1b771b-3116-49f8-b616-f33a3888e215 service neutron] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:46:54.908769 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1b771b-3116-49f8-b616-f33a3888e215 service neutron] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:46:54.909309 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1b771b-3116-49f8-b616-f33a3888e215 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:46:54.912848 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-2f1b771b-3116-49f8-b616-f33a3888e215 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:46:54.935653 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1b771b-3116-49f8-b616-f33a3888e215 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:46:54.939727 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1b771b-3116-49f8-b616-f33a3888e215 service neutron] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:46:54.950794 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1201/2385] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 14:46:54 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:46:55.894370 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67da27a6-f03b-43cd-837f-eb42e7d82f90 service placement] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:46:55.907198 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67da27a6-f03b-43cd-837f-eb42e7d82f90 service placement] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:46:55.912747 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cfcfff-c6b0-4361-8a9e-0512c2097301 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '428ec99478284743943ed41e9d24a603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfe93ee8d32a441295efc0b885de4bd7', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:46:55.913394 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cfcfff-c6b0-4361-8a9e-0512c2097301 service nova] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:46:55.913682 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cfcfff-c6b0-4361-8a9e-0512c2097301 service nova] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:46:55.913962 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cfcfff-c6b0-4361-8a9e-0512c2097301 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:46:55.915733 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-66cfcfff-c6b0-4361-8a9e-0512c2097301 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:46:55.926834 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66cfcfff-c6b0-4361-8a9e-0512c2097301 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:46:55.928446 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66cfcfff-c6b0-4361-8a9e-0512c2097301 service nova] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:46:55.938741 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1185/2386] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 14:46:55 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:46:56.891253 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1b771b-3116-49f8-b616-f33a3888e215 service neutron] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:46:56.905686 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1b771b-3116-49f8-b616-f33a3888e215 service neutron] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:46:56.911952 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce37799a-06a8-453d-bf93-684d7be63b7e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '428ec99478284743943ed41e9d24a603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfe93ee8d32a441295efc0b885de4bd7', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:46:56.913225 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce37799a-06a8-453d-bf93-684d7be63b7e service nova] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:46:56.913744 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce37799a-06a8-453d-bf93-684d7be63b7e service nova] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:46:56.914202 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce37799a-06a8-453d-bf93-684d7be63b7e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:46:56.916111 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-ce37799a-06a8-453d-bf93-684d7be63b7e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:46:56.929785 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce37799a-06a8-453d-bf93-684d7be63b7e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:46:56.931443 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce37799a-06a8-453d-bf93-684d7be63b7e service nova] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:46:56.941390 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1202/2387] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 14:46:56 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:47:00.056879 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d08e176-4f27-470c-83fd-0b42c9c4e396 None None] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:47:00.057328 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d08e176-4f27-470c-83fd-0b42c9c4e396 None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:47:00.057485 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d08e176-4f27-470c-83fd-0b42c9c4e396 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:47:00.082561 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.auth.core [None req-1d08e176-4f27-470c-83fd-0b42c9c4e396 None None] MFA Rules not processed for user `e03f5bb82ffb41a1b1dde935d093e6f4`. Rule list: `[]` (Enabled: `True`). {{(pid=80474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:47:00.084218 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-1d08e176-4f27-470c-83fd-0b42c9c4e396 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:47:00.175988 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1186/2388] 10.222.0.67 () {58 vars in 967 bytes} [Wed May 25 14:47:00 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:47:00.243463 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce37799a-06a8-453d-bf93-684d7be63b7e service nova] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:47:00.245129 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-ce37799a-06a8-453d-bf93-684d7be63b7e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:47:00.341856 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce37799a-06a8-453d-bf93-684d7be63b7e service nova] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:47:00.347948 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc10e90-ff7e-4538-a947-7029ec553315 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbe9e38881834198842a476889678096', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfe93ee8d32a441295efc0b885de4bd7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:47:00.350204 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc10e90-ff7e-4538-a947-7029ec553315 service swift] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:47:00.350204 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc10e90-ff7e-4538-a947-7029ec553315 service swift] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:47:00.350204 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc10e90-ff7e-4538-a947-7029ec553315 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:47:00.363703 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc10e90-ff7e-4538-a947-7029ec553315 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:47:00.366193 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc10e90-ff7e-4538-a947-7029ec553315 service swift] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:47:00.380388 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1203/2389] 10.222.0.67 () {60 vars in 1384 bytes} [Wed May 25 14:47:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 25 14:47:02.972473 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d08e176-4f27-470c-83fd-0b42c9c4e396 None None] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:47:03.012350 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d08e176-4f27-470c-83fd-0b42c9c4e396 None None] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:47:03.021795 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8320174f-e4d9-46aa-a69e-3589b3f1e458 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad2b99c2122a4311996364e982e1c801', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfe93ee8d32a441295efc0b885de4bd7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:47:03.022820 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8320174f-e4d9-46aa-a69e-3589b3f1e458 service placement] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:47:03.027554 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8320174f-e4d9-46aa-a69e-3589b3f1e458 service placement] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:47:03.028668 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8320174f-e4d9-46aa-a69e-3589b3f1e458 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:47:03.034543 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-8320174f-e4d9-46aa-a69e-3589b3f1e458 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:47:03.066090 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8320174f-e4d9-46aa-a69e-3589b3f1e458 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:47:03.068117 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8320174f-e4d9-46aa-a69e-3589b3f1e458 service placement] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:47:03.097637 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc10e90-ff7e-4538-a947-7029ec553315 service swift] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:47:03.100156 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-efc10e90-ff7e-4538-a947-7029ec553315 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:47:03.103469 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1187/2390] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 14:47:02 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:47:03.123729 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc10e90-ff7e-4538-a947-7029ec553315 service swift] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:47:03.129613 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5b2ef5-957e-407e-982f-84db4d7ca0bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:47:03.130895 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5b2ef5-957e-407e-982f-84db4d7ca0bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:47:03.131450 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5b2ef5-957e-407e-982f-84db4d7ca0bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:47:03.131890 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5b2ef5-957e-407e-982f-84db4d7ca0bd admin admin] PATH_INFO: `/v3/users/2aacb4ee87124e21ba9f2f811f3c65a4` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:47:03.133714 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5b2ef5-957e-407e-982f-84db4d7ca0bd admin admin] RBAC: Authorizing `identity:delete_user(user_id=2aacb4ee87124e21ba9f2f811f3c65a4)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:47:03.137064 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5b2ef5-957e-407e-982f-84db4d7ca0bd admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:47:03.228339 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-4f5b2ef5-957e-407e-982f-84db4d7ca0bd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2aacb4ee87124e21ba9f2f811f3c65a4'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:47:03.241906 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-4f5b2ef5-957e-407e-982f-84db4d7ca0bd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2aacb4ee87124e21ba9f2f811f3c65a4'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:47:03.243248 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-4f5b2ef5-957e-407e-982f-84db4d7ca0bd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2aacb4ee87124e21ba9f2f811f3c65a4'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:47:03.261475 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-4f5b2ef5-957e-407e-982f-84db4d7ca0bd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2aacb4ee87124e21ba9f2f811f3c65a4'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:47:03.270721 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:47:03.301477 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-4f5b2ef5-957e-407e-982f-84db4d7ca0bd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2aacb4ee87124e21ba9f2f811f3c65a4'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:47:03.326849 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1204/2391] 10.222.0.67 () {58 vars in 1223 bytes} [Wed May 25 14:47:03 2022] DELETE /identity/v3/users/2aacb4ee87124e21ba9f2f811f3c65a4 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:47:03.616609 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8320174f-e4d9-46aa-a69e-3589b3f1e458 service placement] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:47:03.633879 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8320174f-e4d9-46aa-a69e-3589b3f1e458 service placement] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:47:03.718039 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5ef088-42dc-4cd1-b596-1f48e98e9887 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:47:03.718039 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5ef088-42dc-4cd1-b596-1f48e98e9887 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:47:03.718416 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5ef088-42dc-4cd1-b596-1f48e98e9887 admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:47:03.718743 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5ef088-42dc-4cd1-b596-1f48e98e9887 admin admin] PATH_INFO: `/v3/projects/e98b5f547ab04825a70e0125c8e44d28` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:47:03.720577 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5ef088-42dc-4cd1-b596-1f48e98e9887 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e98b5f547ab04825a70e0125c8e44d28)` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:47:03.722609 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5ef088-42dc-4cd1-b596-1f48e98e9887 admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:47:03.736297 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:47:03.794528 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-cb5ef088-42dc-4cd1-b596-1f48e98e9887 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e98b5f547ab04825a70e0125c8e44d28', 'request_id': 'req-cb5ef088-42dc-4cd1-b596-1f48e98e9887'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:47:03.804764 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-cb5ef088-42dc-4cd1-b596-1f48e98e9887 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e98b5f547ab04825a70e0125c8e44d28', 'request_id': 'req-cb5ef088-42dc-4cd1-b596-1f48e98e9887'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:47:03.814859 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-cb5ef088-42dc-4cd1-b596-1f48e98e9887 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e98b5f547ab04825a70e0125c8e44d28', 'request_id': 'req-cb5ef088-42dc-4cd1-b596-1f48e98e9887'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:47:03.844992 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-cb5ef088-42dc-4cd1-b596-1f48e98e9887 admin admin] The token cache is being invalidate because project e98b5f547ab04825a70e0125c8e44d28 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80474) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 14:47:03.845286 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-cb5ef088-42dc-4cd1-b596-1f48e98e9887 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:47:03.845949 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-cb5ef088-42dc-4cd1-b596-1f48e98e9887 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:47:03.847795 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1188/2392] 10.222.0.67 () {58 vars in 1232 bytes} [Wed May 25 14:47:03 2022] DELETE /identity/v3/projects/e98b5f547ab04825a70e0125c8e44d28 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 14:47:03.852966 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf5970c-7e25-4a1e-8c97-ac373588614a None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:47:03.853380 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf5970c-7e25-4a1e-8c97-ac373588614a None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:47:03.853763 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf5970c-7e25-4a1e-8c97-ac373588614a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:47:03.876516 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-daf5970c-7e25-4a1e-8c97-ac373588614a None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:47:03.879155 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-daf5970c-7e25-4a1e-8c97-ac373588614a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:47:03.960008 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1205/2393] 10.222.0.67 () {58 vars in 957 bytes} [Wed May 25 14:47:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 14:47:03.968405 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a504eed5-1a44-443f-831e-810e049d19d2 None None] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:47:03.969470 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a504eed5-1a44-443f-831e-810e049d19d2 None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:47:03.969752 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a504eed5-1a44-443f-831e-810e049d19d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:47:03.989783 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.auth.core [None req-a504eed5-1a44-443f-831e-810e049d19d2 None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:47:03.991828 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-a504eed5-1a44-443f-831e-810e049d19d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:47:04.002730 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1189/2394] 10.222.0.67 () {58 vars in 957 bytes} [Wed May 25 14:47:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:47:04.007912 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf5970c-7e25-4a1e-8c97-ac373588614a None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:47:04.020739 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf5970c-7e25-4a1e-8c97-ac373588614a None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:47:04.026480 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53055527-3f00-43e3-8761-3565d1f29f1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:47:04.027405 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53055527-3f00-43e3-8761-3565d1f29f1f admin admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:47:04.027935 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53055527-3f00-43e3-8761-3565d1f29f1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:47:04.028877 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53055527-3f00-43e3-8761-3565d1f29f1f admin admin] PATH_INFO: `/v3/domains` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:47:04.030396 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53055527-3f00-43e3-8761-3565d1f29f1f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:47:04.030396 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53055527-3f00-43e3-8761-3565d1f29f1f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:47:04.031878 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53055527-3f00-43e3-8761-3565d1f29f1f admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:47:04.051451 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1206/2395] 10.222.0.67 () {58 vars in 1152 bytes} [Wed May 25 14:47:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:47:04.052514 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a504eed5-1a44-443f-831e-810e049d19d2 None None] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:47:04.068834 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a504eed5-1a44-443f-831e-810e049d19d2 None None] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:47:04.074459 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d0cced-d43a-44e5-83fc-7fb41f8ca5aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:47:04.075431 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d0cced-d43a-44e5-83fc-7fb41f8ca5aa admin admin] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:47:04.075831 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d0cced-d43a-44e5-83fc-7fb41f8ca5aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:47:04.076380 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d0cced-d43a-44e5-83fc-7fb41f8ca5aa admin admin] PATH_INFO: `/v3/projects` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:47:04.077840 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d0cced-d43a-44e5-83fc-7fb41f8ca5aa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:47:04.079931 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d0cced-d43a-44e5-83fc-7fb41f8ca5aa admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:47:04.115234 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1190/2396] 10.222.0.67 () {60 vars in 1152 bytes} [Wed May 25 14:47:04 2022] POST /identity/v3/projects => generated 371 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:47:04.118932 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53055527-3f00-43e3-8761-3565d1f29f1f admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:47:04.134228 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53055527-3f00-43e3-8761-3565d1f29f1f admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:47:04.276100 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e40691-20a8-4905-9957-7b805930b83e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:47:04.277484 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e40691-20a8-4905-9957-7b805930b83e admin admin] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:47:04.277775 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e40691-20a8-4905-9957-7b805930b83e admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:47:04.279623 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e40691-20a8-4905-9957-7b805930b83e admin admin] PATH_INFO: `/v3/users` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:47:04.281592 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e40691-20a8-4905-9957-7b805930b83e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:47:04.283834 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e40691-20a8-4905-9957-7b805930b83e admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:47:04.318115 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1207/2397] 10.222.0.67 () {60 vars in 1143 bytes} [Wed May 25 14:47:04 2022] POST /identity/v3/users => generated 286 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:47:04.323372 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d0cced-d43a-44e5-83fc-7fb41f8ca5aa admin admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:47:04.363624 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d0cced-d43a-44e5-83fc-7fb41f8ca5aa admin admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:47:04.369923 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d05b4d-9530-4a7b-81d4-1b3a2ea83181 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:47:04.371099 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d05b4d-9530-4a7b-81d4-1b3a2ea83181 admin admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:47:04.371580 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d05b4d-9530-4a7b-81d4-1b3a2ea83181 admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:47:04.372394 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d05b4d-9530-4a7b-81d4-1b3a2ea83181 admin admin] PATH_INFO: `/v3/roles` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:47:04.374029 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d05b4d-9530-4a7b-81d4-1b3a2ea83181 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:47:04.377402 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d05b4d-9530-4a7b-81d4-1b3a2ea83181 admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:47:04.391275 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1191/2398] 10.222.0.67 () {58 vars in 1121 bytes} [Wed May 25 14:47:04 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:47:04.395218 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e40691-20a8-4905-9957-7b805930b83e admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:47:04.406981 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e40691-20a8-4905-9957-7b805930b83e admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:47:04.413298 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76057c70-76f2-4838-afe9-8c696a86d990 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:47:04.414134 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76057c70-76f2-4838-afe9-8c696a86d990 admin admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:47:04.414559 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76057c70-76f2-4838-afe9-8c696a86d990 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:47:04.414941 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76057c70-76f2-4838-afe9-8c696a86d990 admin admin] PATH_INFO: `/v3/roles` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:47:04.416634 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76057c70-76f2-4838-afe9-8c696a86d990 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:47:04.420503 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76057c70-76f2-4838-afe9-8c696a86d990 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:47:04.433412 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1208/2399] 10.222.0.67 () {58 vars in 1121 bytes} [Wed May 25 14:47:04 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:47:04.438351 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d05b4d-9530-4a7b-81d4-1b3a2ea83181 admin admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:47:04.452096 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d05b4d-9530-4a7b-81d4-1b3a2ea83181 admin admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:47:04.459967 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0771b09-044c-4f1c-8fe4-2eb11af52124 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:47:04.461639 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0771b09-044c-4f1c-8fe4-2eb11af52124 admin admin] REQUEST_METHOD: `PUT` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:47:04.462143 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0771b09-044c-4f1c-8fe4-2eb11af52124 admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:47:04.462439 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0771b09-044c-4f1c-8fe4-2eb11af52124 admin admin] PATH_INFO: `/v3/projects/539a6be5a2584df1ac3d9acb0cba4dba/users/8413124333524161a13a8a25ccc094b8/roles/48808901834b4d5eab2c7e6b5b03791e` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:47:04.480733 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0771b09-044c-4f1c-8fe4-2eb11af52124 admin admin] RBAC: Authorizing `identity:create_grant(project_id=539a6be5a2584df1ac3d9acb0cba4dba, user_id=8413124333524161a13a8a25ccc094b8, role_id=48808901834b4d5eab2c7e6b5b03791e)` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:47:04.484062 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0771b09-044c-4f1c-8fe4-2eb11af52124 admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:47:04.509399 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1192/2400] 10.222.0.67 () {60 vars in 1482 bytes} [Wed May 25 14:47:04 2022] PUT /identity/v3/projects/539a6be5a2584df1ac3d9acb0cba4dba/users/8413124333524161a13a8a25ccc094b8/roles/48808901834b4d5eab2c7e6b5b03791e => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 14:47:04.515206 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3405ff63-0b65-4979-b63b-7fe854b76d11 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:47:04.515726 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3405ff63-0b65-4979-b63b-7fe854b76d11 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:47:04.516060 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3405ff63-0b65-4979-b63b-7fe854b76d11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:47:04.540735 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-3405ff63-0b65-4979-b63b-7fe854b76d11 None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:47:04.542221 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-3405ff63-0b65-4979-b63b-7fe854b76d11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:47:04.603745 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:47:04.641670 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1209/2401] 10.222.0.67 () {58 vars in 957 bytes} [Wed May 25 14:47:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:47:04.654226 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0771b09-044c-4f1c-8fe4-2eb11af52124 admin admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:47:04.655273 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-b0771b09-044c-4f1c-8fe4-2eb11af52124 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:47:04.742685 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0771b09-044c-4f1c-8fe4-2eb11af52124 admin admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:47:04.747912 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacdf47e-f4e4-43e0-bd41-1abe46728f08 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b68eed985c7b49839bcdd173186ad4ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfe93ee8d32a441295efc0b885de4bd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:47:04.749331 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacdf47e-f4e4-43e0-bd41-1abe46728f08 service neutron] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:47:04.749622 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacdf47e-f4e4-43e0-bd41-1abe46728f08 service neutron] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:47:04.749902 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacdf47e-f4e4-43e0-bd41-1abe46728f08 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:47:04.774085 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dacdf47e-f4e4-43e0-bd41-1abe46728f08 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:47:04.776015 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dacdf47e-f4e4-43e0-bd41-1abe46728f08 service neutron] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:47:04.792495 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1193/2402] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 14:47:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 14:47:05.284856 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3405ff63-0b65-4979-b63b-7fe854b76d11 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:47:05.286604 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-3405ff63-0b65-4979-b63b-7fe854b76d11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:47:05.398164 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3405ff63-0b65-4979-b63b-7fe854b76d11 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:47:05.421323 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6bf21f-7853-4384-98ae-bdcdf3022cbb service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad2b99c2122a4311996364e982e1c801', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfe93ee8d32a441295efc0b885de4bd7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:47:05.422158 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6bf21f-7853-4384-98ae-bdcdf3022cbb service placement] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:47:05.422587 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6bf21f-7853-4384-98ae-bdcdf3022cbb service placement] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:47:05.423139 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6bf21f-7853-4384-98ae-bdcdf3022cbb service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:47:05.439978 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-aa6bf21f-7853-4384-98ae-bdcdf3022cbb service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:47:05.454104 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6bf21f-7853-4384-98ae-bdcdf3022cbb service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:47:05.456017 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6bf21f-7853-4384-98ae-bdcdf3022cbb service placement] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:47:05.469524 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1210/2403] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 14:47:05 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:47:11.600625 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8441bb50-3bfb-408f-b816-affc89ad8ec9 None None] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:47:11.600625 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8441bb50-3bfb-408f-b816-affc89ad8ec9 None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:47:11.600625 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8441bb50-3bfb-408f-b816-affc89ad8ec9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:47:11.654856 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.auth.core [None req-8441bb50-3bfb-408f-b816-affc89ad8ec9 None None] MFA Rules not processed for user `8413124333524161a13a8a25ccc094b8`. Rule list: `[]` (Enabled: `True`). {{(pid=80474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:47:11.656506 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-8441bb50-3bfb-408f-b816-affc89ad8ec9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:47:11.743571 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:47:11.796111 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1194/2404] 10.222.0.67 () {58 vars in 957 bytes} [Wed May 25 14:47:11 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:47:11.800195 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6bf21f-7853-4384-98ae-bdcdf3022cbb service placement] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:47:11.818114 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6bf21f-7853-4384-98ae-bdcdf3022cbb service placement] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:47:11.851540 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4481ae60-a89d-4ae0-8e1b-a96de072dbad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:47:11.852330 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4481ae60-a89d-4ae0-8e1b-a96de072dbad admin admin] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:47:11.852620 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4481ae60-a89d-4ae0-8e1b-a96de072dbad admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:47:11.852929 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4481ae60-a89d-4ae0-8e1b-a96de072dbad admin admin] PATH_INFO: `/v3/projects` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:47:11.853614 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4481ae60-a89d-4ae0-8e1b-a96de072dbad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:47:11.855622 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4481ae60-a89d-4ae0-8e1b-a96de072dbad admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:47:11.912189 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1211/2405] 10.222.0.67 () {60 vars in 1152 bytes} [Wed May 25 14:47:11 2022] POST /identity/v3/projects => generated 373 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:47:11.922639 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8441bb50-3bfb-408f-b816-affc89ad8ec9 None None] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:47:11.937759 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8441bb50-3bfb-408f-b816-affc89ad8ec9 None None] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:47:12.048227 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945f298b-06ee-4deb-8f28-dddb92066752 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:47:12.049194 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945f298b-06ee-4deb-8f28-dddb92066752 admin admin] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:47:12.049934 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945f298b-06ee-4deb-8f28-dddb92066752 admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:47:12.050218 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945f298b-06ee-4deb-8f28-dddb92066752 admin admin] PATH_INFO: `/v3/users` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:47:12.051265 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945f298b-06ee-4deb-8f28-dddb92066752 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:47:12.053775 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945f298b-06ee-4deb-8f28-dddb92066752 admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:47:12.092917 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1195/2406] 10.222.0.67 () {60 vars in 1143 bytes} [Wed May 25 14:47:11 2022] POST /identity/v3/users => generated 293 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:47:12.101540 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4481ae60-a89d-4ae0-8e1b-a96de072dbad admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:47:12.114210 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4481ae60-a89d-4ae0-8e1b-a96de072dbad admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:47:12.119625 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf33c60-55f3-45cf-a836-3d95b393ff1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:47:12.120670 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf33c60-55f3-45cf-a836-3d95b393ff1e admin admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:47:12.121143 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf33c60-55f3-45cf-a836-3d95b393ff1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:47:12.122229 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf33c60-55f3-45cf-a836-3d95b393ff1e admin admin] PATH_INFO: `/v3/roles` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:47:12.123363 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf33c60-55f3-45cf-a836-3d95b393ff1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:47:12.125169 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf33c60-55f3-45cf-a836-3d95b393ff1e admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:47:12.139423 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1212/2407] 10.222.0.67 () {58 vars in 1121 bytes} [Wed May 25 14:47:12 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 25 14:47:12.143966 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945f298b-06ee-4deb-8f28-dddb92066752 admin admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:47:12.157060 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945f298b-06ee-4deb-8f28-dddb92066752 admin admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:47:12.171993 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11570c2-5dc8-4edc-85bc-932c89b65f25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:47:12.173569 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11570c2-5dc8-4edc-85bc-932c89b65f25 admin admin] REQUEST_METHOD: `PUT` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:47:12.173861 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11570c2-5dc8-4edc-85bc-932c89b65f25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:47:12.174141 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11570c2-5dc8-4edc-85bc-932c89b65f25 admin admin] PATH_INFO: `/v3/projects/f90292b386044d93be967371ce5b51c6/users/26064829e934426ba891c7f517705d75/roles/399893e19eac4ab5a8e596f7c07be13c` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:47:12.202425 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11570c2-5dc8-4edc-85bc-932c89b65f25 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f90292b386044d93be967371ce5b51c6, user_id=26064829e934426ba891c7f517705d75, role_id=399893e19eac4ab5a8e596f7c07be13c)` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:47:12.210916 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11570c2-5dc8-4edc-85bc-932c89b65f25 admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:47:12.236138 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1196/2408] 10.222.0.67 () {60 vars in 1482 bytes} [Wed May 25 14:47:12 2022] PUT /identity/v3/projects/f90292b386044d93be967371ce5b51c6/users/26064829e934426ba891c7f517705d75/roles/399893e19eac4ab5a8e596f7c07be13c => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:47:12.244434 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf33c60-55f3-45cf-a836-3d95b393ff1e admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:47:12.257321 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf33c60-55f3-45cf-a836-3d95b393ff1e admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:47:12.364084 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371d42ce-7ce2-4f53-afcc-a59fcd5cfd3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:47:12.369530 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371d42ce-7ce2-4f53-afcc-a59fcd5cfd3c admin admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:47:12.370090 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371d42ce-7ce2-4f53-afcc-a59fcd5cfd3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:47:12.370435 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371d42ce-7ce2-4f53-afcc-a59fcd5cfd3c admin admin] PATH_INFO: `/v3/roles` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:47:12.371327 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371d42ce-7ce2-4f53-afcc-a59fcd5cfd3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:47:12.373839 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371d42ce-7ce2-4f53-afcc-a59fcd5cfd3c admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:47:12.395811 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1213/2409] 10.222.0.67 () {58 vars in 1121 bytes} [Wed May 25 14:47:12 2022] GET /identity/v3/roles => generated 1420 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:47:12.399676 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11570c2-5dc8-4edc-85bc-932c89b65f25 admin admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:47:12.413122 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11570c2-5dc8-4edc-85bc-932c89b65f25 admin admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:47:12.420209 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcee662b-f439-44d8-98f5-7d4b0be0d12e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:47:12.421367 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcee662b-f439-44d8-98f5-7d4b0be0d12e admin admin] REQUEST_METHOD: `PUT` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:47:12.421882 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcee662b-f439-44d8-98f5-7d4b0be0d12e admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:47:12.422334 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcee662b-f439-44d8-98f5-7d4b0be0d12e admin admin] PATH_INFO: `/v3/projects/f90292b386044d93be967371ce5b51c6/users/26064829e934426ba891c7f517705d75/roles/399893e19eac4ab5a8e596f7c07be13c` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:47:12.427191 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcee662b-f439-44d8-98f5-7d4b0be0d12e admin admin] RBAC: Authorizing `identity:create_grant(project_id=f90292b386044d93be967371ce5b51c6, user_id=26064829e934426ba891c7f517705d75, role_id=399893e19eac4ab5a8e596f7c07be13c)` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:47:12.438493 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcee662b-f439-44d8-98f5-7d4b0be0d12e admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:47:12.456268 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1197/2410] 10.222.0.67 () {60 vars in 1482 bytes} [Wed May 25 14:47:12 2022] PUT /identity/v3/projects/f90292b386044d93be967371ce5b51c6/users/26064829e934426ba891c7f517705d75/roles/399893e19eac4ab5a8e596f7c07be13c => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:47:12.898975 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371d42ce-7ce2-4f53-afcc-a59fcd5cfd3c admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:47:12.901316 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-371d42ce-7ce2-4f53-afcc-a59fcd5cfd3c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:47:12.915826 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371d42ce-7ce2-4f53-afcc-a59fcd5cfd3c admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:47:12.999336 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:47:13.037622 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d28bf23-9dd2-463b-9d97-178d3167331b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:47:13.038427 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d28bf23-9dd2-463b-9d97-178d3167331b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:47:13.038887 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d28bf23-9dd2-463b-9d97-178d3167331b admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:47:13.039342 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d28bf23-9dd2-463b-9d97-178d3167331b admin admin] PATH_INFO: `/v3/users/1cdbd342d59548118ade365d352d2eaa` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:47:13.040930 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d28bf23-9dd2-463b-9d97-178d3167331b admin admin] RBAC: Authorizing `identity:delete_user(user_id=1cdbd342d59548118ade365d352d2eaa)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:47:13.042934 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d28bf23-9dd2-463b-9d97-178d3167331b admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:47:13.122555 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-2d28bf23-9dd2-463b-9d97-178d3167331b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1cdbd342d59548118ade365d352d2eaa'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:47:13.133502 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-2d28bf23-9dd2-463b-9d97-178d3167331b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1cdbd342d59548118ade365d352d2eaa'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:47:13.134365 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-2d28bf23-9dd2-463b-9d97-178d3167331b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1cdbd342d59548118ade365d352d2eaa'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:47:13.146184 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-2d28bf23-9dd2-463b-9d97-178d3167331b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1cdbd342d59548118ade365d352d2eaa'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:47:13.170641 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-2d28bf23-9dd2-463b-9d97-178d3167331b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1cdbd342d59548118ade365d352d2eaa'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:47:13.187681 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1214/2411] 10.222.0.67 () {58 vars in 1223 bytes} [Wed May 25 14:47:12 2022] DELETE /identity/v3/users/1cdbd342d59548118ade365d352d2eaa => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:47:13.420163 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcee662b-f439-44d8-98f5-7d4b0be0d12e admin admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:47:13.423591 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-bcee662b-f439-44d8-98f5-7d4b0be0d12e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:47:13.462115 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcee662b-f439-44d8-98f5-7d4b0be0d12e admin admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:47:13.578844 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f912848-0122-4f12-b665-48b032bf444c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:47:13.579797 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f912848-0122-4f12-b665-48b032bf444c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:47:13.580086 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f912848-0122-4f12-b665-48b032bf444c admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:47:13.580365 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f912848-0122-4f12-b665-48b032bf444c admin admin] PATH_INFO: `/v3/projects/af7847039e574008a372279c28d9200f` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:47:13.582602 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f912848-0122-4f12-b665-48b032bf444c admin admin] RBAC: Authorizing `identity:delete_project(project_id=af7847039e574008a372279c28d9200f)` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:47:13.585907 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f912848-0122-4f12-b665-48b032bf444c admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:47:13.652524 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=94,keystone:INSERT=5,keystone:DELETE=1 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:47:13.702114 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-0f912848-0122-4f12-b665-48b032bf444c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'af7847039e574008a372279c28d9200f', 'request_id': 'req-0f912848-0122-4f12-b665-48b032bf444c'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:47:13.714164 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-0f912848-0122-4f12-b665-48b032bf444c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'af7847039e574008a372279c28d9200f', 'request_id': 'req-0f912848-0122-4f12-b665-48b032bf444c'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:47:13.728712 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-0f912848-0122-4f12-b665-48b032bf444c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'af7847039e574008a372279c28d9200f', 'request_id': 'req-0f912848-0122-4f12-b665-48b032bf444c'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:47:13.749299 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-0f912848-0122-4f12-b665-48b032bf444c admin admin] The token cache is being invalidate because project af7847039e574008a372279c28d9200f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80474) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 14:47:13.749852 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-0f912848-0122-4f12-b665-48b032bf444c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:47:13.751367 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-0f912848-0122-4f12-b665-48b032bf444c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:47:13.753973 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1198/2412] 10.222.0.67 () {58 vars in 1232 bytes} [Wed May 25 14:47:13 2022] DELETE /identity/v3/projects/af7847039e574008a372279c28d9200f => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:47:13.758389 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d28bf23-9dd2-463b-9d97-178d3167331b admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:47:13.774574 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d28bf23-9dd2-463b-9d97-178d3167331b admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:47:13.905179 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a827663-aef6-40cd-bb97-759692e0a369 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:47:13.906153 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a827663-aef6-40cd-bb97-759692e0a369 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:47:13.906501 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a827663-aef6-40cd-bb97-759692e0a369 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:47:13.906842 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a827663-aef6-40cd-bb97-759692e0a369 admin admin] PATH_INFO: `/v3/users/5b6fbc2e38034543aae97b06854f5042` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:47:13.908362 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a827663-aef6-40cd-bb97-759692e0a369 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5b6fbc2e38034543aae97b06854f5042)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:47:13.910390 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a827663-aef6-40cd-bb97-759692e0a369 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:47:13.986424 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-7a827663-aef6-40cd-bb97-759692e0a369 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5b6fbc2e38034543aae97b06854f5042'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:47:13.997894 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-7a827663-aef6-40cd-bb97-759692e0a369 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5b6fbc2e38034543aae97b06854f5042'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:47:13.998885 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-7a827663-aef6-40cd-bb97-759692e0a369 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5b6fbc2e38034543aae97b06854f5042'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:47:14.013828 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-7a827663-aef6-40cd-bb97-759692e0a369 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5b6fbc2e38034543aae97b06854f5042'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:47:14.015905 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=80,keystone:DELETE=18,keystone:INSERT=2 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:47:14.039751 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-7a827663-aef6-40cd-bb97-759692e0a369 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5b6fbc2e38034543aae97b06854f5042'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:47:14.047229 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1215/2413] 10.222.0.67 () {58 vars in 1223 bytes} [Wed May 25 14:47:13 2022] DELETE /identity/v3/users/5b6fbc2e38034543aae97b06854f5042 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:47:14.337235 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f912848-0122-4f12-b665-48b032bf444c admin admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:47:14.338824 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-0f912848-0122-4f12-b665-48b032bf444c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:47:14.364341 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f912848-0122-4f12-b665-48b032bf444c admin admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:47:14.498268 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07153007-85ce-4feb-89d5-9d6c913e99bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:47:14.499175 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07153007-85ce-4feb-89d5-9d6c913e99bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:47:14.499463 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07153007-85ce-4feb-89d5-9d6c913e99bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:47:14.499741 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07153007-85ce-4feb-89d5-9d6c913e99bb admin admin] PATH_INFO: `/v3/projects/59a4afdc9aa14cea895992e027b80c86` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:47:14.504333 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07153007-85ce-4feb-89d5-9d6c913e99bb admin admin] RBAC: Authorizing `identity:delete_project(project_id=59a4afdc9aa14cea895992e027b80c86)` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:47:14.508888 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07153007-85ce-4feb-89d5-9d6c913e99bb admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:47:14.621682 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-07153007-85ce-4feb-89d5-9d6c913e99bb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '59a4afdc9aa14cea895992e027b80c86', 'request_id': 'req-07153007-85ce-4feb-89d5-9d6c913e99bb'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:47:14.644584 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-07153007-85ce-4feb-89d5-9d6c913e99bb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '59a4afdc9aa14cea895992e027b80c86', 'request_id': 'req-07153007-85ce-4feb-89d5-9d6c913e99bb'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:47:14.669213 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-07153007-85ce-4feb-89d5-9d6c913e99bb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '59a4afdc9aa14cea895992e027b80c86', 'request_id': 'req-07153007-85ce-4feb-89d5-9d6c913e99bb'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:47:14.698144 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-07153007-85ce-4feb-89d5-9d6c913e99bb admin admin] The token cache is being invalidate because project 59a4afdc9aa14cea895992e027b80c86 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80474) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 14:47:14.698439 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-07153007-85ce-4feb-89d5-9d6c913e99bb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:47:14.700006 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-07153007-85ce-4feb-89d5-9d6c913e99bb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:47:14.720618 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1199/2414] 10.222.0.67 () {58 vars in 1232 bytes} [Wed May 25 14:47:14 2022] DELETE /identity/v3/projects/59a4afdc9aa14cea895992e027b80c86 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:47:16.784519 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a827663-aef6-40cd-bb97-759692e0a369 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:47:16.786177 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-7a827663-aef6-40cd-bb97-759692e0a369 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:47:16.961012 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a827663-aef6-40cd-bb97-759692e0a369 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:47:17.143407 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d743bb-31f6-42d5-ad5a-209c59d1776f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '428ec99478284743943ed41e9d24a603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfe93ee8d32a441295efc0b885de4bd7', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:47:17.154085 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d743bb-31f6-42d5-ad5a-209c59d1776f service nova] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:47:17.154845 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d743bb-31f6-42d5-ad5a-209c59d1776f service nova] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:47:17.155337 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d743bb-31f6-42d5-ad5a-209c59d1776f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:47:17.158391 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-69d743bb-31f6-42d5-ad5a-209c59d1776f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:47:17.188816 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d743bb-31f6-42d5-ad5a-209c59d1776f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:47:17.190505 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d743bb-31f6-42d5-ad5a-209c59d1776f service nova] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:47:17.241870 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1216/2415] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 14:47:16 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 458 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:47:17.620173 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07153007-85ce-4feb-89d5-9d6c913e99bb admin admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:47:17.620861 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-07153007-85ce-4feb-89d5-9d6c913e99bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:47:17.663845 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07153007-85ce-4feb-89d5-9d6c913e99bb admin admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:47:17.672941 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91b54e2-3c85-4eb5-a2b5-b90eff63ee70 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '428ec99478284743943ed41e9d24a603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfe93ee8d32a441295efc0b885de4bd7', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:47:17.674261 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91b54e2-3c85-4eb5-a2b5-b90eff63ee70 service nova] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:47:17.676045 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91b54e2-3c85-4eb5-a2b5-b90eff63ee70 service nova] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:47:17.676472 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91b54e2-3c85-4eb5-a2b5-b90eff63ee70 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:47:17.678639 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-d91b54e2-3c85-4eb5-a2b5-b90eff63ee70 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:47:17.797608 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:47:17.828713 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91b54e2-3c85-4eb5-a2b5-b90eff63ee70 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:47:17.831160 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91b54e2-3c85-4eb5-a2b5-b90eff63ee70 service nova] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:47:17.862722 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1200/2416] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 14:47:17 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:47:18.429508 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d743bb-31f6-42d5-ad5a-209c59d1776f service nova] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:47:18.431921 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-69d743bb-31f6-42d5-ad5a-209c59d1776f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:47:18.516403 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d743bb-31f6-42d5-ad5a-209c59d1776f service nova] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:47:18.521957 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc56901-ae49-4173-97d9-cd4bacf547b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b68eed985c7b49839bcdd173186ad4ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfe93ee8d32a441295efc0b885de4bd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:47:18.522859 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc56901-ae49-4173-97d9-cd4bacf547b1 service neutron] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:47:18.523197 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc56901-ae49-4173-97d9-cd4bacf547b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:47:18.523912 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc56901-ae49-4173-97d9-cd4bacf547b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:47:18.525411 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-8bc56901-ae49-4173-97d9-cd4bacf547b1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:47:18.551315 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:47:18.616926 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc56901-ae49-4173-97d9-cd4bacf547b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:47:18.618477 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc56901-ae49-4173-97d9-cd4bacf547b1 service neutron] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:47:18.634590 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1217/2417] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 14:47:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:47:19.049181 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0ba8f5-e93b-4c02-a9ac-78d8fd0b1f3d None None] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:47:19.051777 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0ba8f5-e93b-4c02-a9ac-78d8fd0b1f3d None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:47:19.052057 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0ba8f5-e93b-4c02-a9ac-78d8fd0b1f3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:47:19.089700 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.auth.core [None req-fd0ba8f5-e93b-4c02-a9ac-78d8fd0b1f3d None None] MFA Rules not processed for user `26064829e934426ba891c7f517705d75`. Rule list: `[]` (Enabled: `True`). {{(pid=80474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:47:19.091343 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-fd0ba8f5-e93b-4c02-a9ac-78d8fd0b1f3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:47:19.199588 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1201/2418] 10.222.0.67 () {58 vars in 957 bytes} [Wed May 25 14:47:19 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:47:19.211306 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc56901-ae49-4173-97d9-cd4bacf547b1 service neutron] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:47:19.226860 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc56901-ae49-4173-97d9-cd4bacf547b1 service neutron] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:47:19.235725 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226786e3-9f59-436e-af16-1cbdda8df0bc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '428ec99478284743943ed41e9d24a603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfe93ee8d32a441295efc0b885de4bd7', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:47:19.237069 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226786e3-9f59-436e-af16-1cbdda8df0bc service nova] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:47:19.237675 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226786e3-9f59-436e-af16-1cbdda8df0bc service nova] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:47:19.238258 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226786e3-9f59-436e-af16-1cbdda8df0bc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:47:19.242016 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-226786e3-9f59-436e-af16-1cbdda8df0bc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:47:19.321859 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226786e3-9f59-436e-af16-1cbdda8df0bc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:47:19.329951 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226786e3-9f59-436e-af16-1cbdda8df0bc service nova] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:47:19.337909 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1218/2419] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 14:47:19 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:47:21.037685 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323913b7-8815-43fa-a181-6a6bd9f4866e None None] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:47:21.038551 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323913b7-8815-43fa-a181-6a6bd9f4866e None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:47:21.038551 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323913b7-8815-43fa-a181-6a6bd9f4866e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:47:21.067775 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.auth.core [None req-323913b7-8815-43fa-a181-6a6bd9f4866e None None] MFA Rules not processed for user `8413124333524161a13a8a25ccc094b8`. Rule list: `[]` (Enabled: `True`). {{(pid=80474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:47:21.069525 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-323913b7-8815-43fa-a181-6a6bd9f4866e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:47:21.077361 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1202/2420] 10.222.0.67 () {58 vars in 957 bytes} [Wed May 25 14:47:21 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:47:22.951398 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226786e3-9f59-436e-af16-1cbdda8df0bc service nova] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:47:22.953106 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-226786e3-9f59-436e-af16-1cbdda8df0bc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:47:22.973947 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226786e3-9f59-436e-af16-1cbdda8df0bc service nova] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:47:22.978863 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8109caff-45b3-40cc-a5df-648301018995 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:47:22.979869 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8109caff-45b3-40cc-a5df-648301018995 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:47:22.980241 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8109caff-45b3-40cc-a5df-648301018995 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:47:22.980522 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8109caff-45b3-40cc-a5df-648301018995 admin admin] PATH_INFO: `/v3/users/54a9a5bdd9674c1f9700800609062675` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:47:22.982400 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8109caff-45b3-40cc-a5df-648301018995 admin admin] RBAC: Authorizing `identity:delete_user(user_id=54a9a5bdd9674c1f9700800609062675)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:47:22.984396 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8109caff-45b3-40cc-a5df-648301018995 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:47:23.045993 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-8109caff-45b3-40cc-a5df-648301018995 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '54a9a5bdd9674c1f9700800609062675'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:47:23.057969 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-8109caff-45b3-40cc-a5df-648301018995 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '54a9a5bdd9674c1f9700800609062675'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:47:23.058593 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-8109caff-45b3-40cc-a5df-648301018995 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '54a9a5bdd9674c1f9700800609062675'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:47:23.077554 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-8109caff-45b3-40cc-a5df-648301018995 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '54a9a5bdd9674c1f9700800609062675'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:47:23.093118 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-8109caff-45b3-40cc-a5df-648301018995 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '54a9a5bdd9674c1f9700800609062675'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:47:23.105383 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1219/2421] 10.222.0.67 () {58 vars in 1223 bytes} [Wed May 25 14:47:22 2022] DELETE /identity/v3/users/54a9a5bdd9674c1f9700800609062675 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:47:23.344068 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323913b7-8815-43fa-a181-6a6bd9f4866e None None] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:47:23.365715 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323913b7-8815-43fa-a181-6a6bd9f4866e None None] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:47:23.457841 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ad7a4c-a283-461f-9913-fcdcad7d2362 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:47:23.458832 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ad7a4c-a283-461f-9913-fcdcad7d2362 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:47:23.459238 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ad7a4c-a283-461f-9913-fcdcad7d2362 admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:47:23.459563 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ad7a4c-a283-461f-9913-fcdcad7d2362 admin admin] PATH_INFO: `/v3/projects/74161898e72940608775a2ce35bcd6b0` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:47:23.460985 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ad7a4c-a283-461f-9913-fcdcad7d2362 admin admin] RBAC: Authorizing `identity:delete_project(project_id=74161898e72940608775a2ce35bcd6b0)` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:47:23.463243 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ad7a4c-a283-461f-9913-fcdcad7d2362 admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:47:23.550179 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-72ad7a4c-a283-461f-9913-fcdcad7d2362 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '74161898e72940608775a2ce35bcd6b0', 'request_id': 'req-72ad7a4c-a283-461f-9913-fcdcad7d2362'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:47:23.567832 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-72ad7a4c-a283-461f-9913-fcdcad7d2362 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '74161898e72940608775a2ce35bcd6b0', 'request_id': 'req-72ad7a4c-a283-461f-9913-fcdcad7d2362'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:47:23.577398 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-72ad7a4c-a283-461f-9913-fcdcad7d2362 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '74161898e72940608775a2ce35bcd6b0', 'request_id': 'req-72ad7a4c-a283-461f-9913-fcdcad7d2362'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:47:23.578886 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:47:23.592595 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-72ad7a4c-a283-461f-9913-fcdcad7d2362 admin admin] The token cache is being invalidate because project 74161898e72940608775a2ce35bcd6b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80474) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 14:47:23.592903 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-72ad7a4c-a283-461f-9913-fcdcad7d2362 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:47:23.593637 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-72ad7a4c-a283-461f-9913-fcdcad7d2362 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:47:23.598527 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1203/2422] 10.222.0.67 () {58 vars in 1232 bytes} [Wed May 25 14:47:23 2022] DELETE /identity/v3/projects/74161898e72940608775a2ce35bcd6b0 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:47:23.600876 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad8c60f-ae92-4399-b4d6-52f9d4cb6052 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:47:23.601171 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad8c60f-ae92-4399-b4d6-52f9d4cb6052 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:47:23.601451 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad8c60f-ae92-4399-b4d6-52f9d4cb6052 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:47:23.626460 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-4ad8c60f-ae92-4399-b4d6-52f9d4cb6052 None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:47:23.627913 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-4ad8c60f-ae92-4399-b4d6-52f9d4cb6052 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:47:23.653451 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:47:23.734437 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1220/2423] 10.222.0.67 () {58 vars in 957 bytes} [Wed May 25 14:47:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:47:23.743264 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f261816-8ae3-47b4-bc3d-5addee38c37d None None] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:47:23.743832 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f261816-8ae3-47b4-bc3d-5addee38c37d None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:47:23.744123 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f261816-8ae3-47b4-bc3d-5addee38c37d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:47:23.765839 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.auth.core [None req-3f261816-8ae3-47b4-bc3d-5addee38c37d None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:47:23.767463 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-3f261816-8ae3-47b4-bc3d-5addee38c37d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:47:23.776087 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1204/2424] 10.222.0.67 () {58 vars in 957 bytes} [Wed May 25 14:47:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:47:23.782956 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad8c60f-ae92-4399-b4d6-52f9d4cb6052 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:47:23.799654 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad8c60f-ae92-4399-b4d6-52f9d4cb6052 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:47:23.806503 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b002cf9-6fa7-47ab-92c3-83b92c2b8765 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:47:23.808090 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b002cf9-6fa7-47ab-92c3-83b92c2b8765 admin admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:47:23.808447 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b002cf9-6fa7-47ab-92c3-83b92c2b8765 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:47:23.809708 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b002cf9-6fa7-47ab-92c3-83b92c2b8765 admin admin] PATH_INFO: `/v3/domains` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:47:23.811230 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b002cf9-6fa7-47ab-92c3-83b92c2b8765 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:47:23.811802 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b002cf9-6fa7-47ab-92c3-83b92c2b8765 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:47:23.814608 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b002cf9-6fa7-47ab-92c3-83b92c2b8765 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:47:23.843852 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1221/2425] 10.222.0.67 () {58 vars in 1152 bytes} [Wed May 25 14:47:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:47:23.849800 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f261816-8ae3-47b4-bc3d-5addee38c37d None None] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:47:23.862540 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f261816-8ae3-47b4-bc3d-5addee38c37d None None] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:47:23.869681 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7f28d9-6d6e-4e16-aaf3-e0617060a1a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:47:23.870204 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7f28d9-6d6e-4e16-aaf3-e0617060a1a0 admin admin] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:47:23.871106 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7f28d9-6d6e-4e16-aaf3-e0617060a1a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:47:23.872520 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7f28d9-6d6e-4e16-aaf3-e0617060a1a0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:47:23.874182 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7f28d9-6d6e-4e16-aaf3-e0617060a1a0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:47:23.877048 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7f28d9-6d6e-4e16-aaf3-e0617060a1a0 admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:47:23.919586 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1205/2426] 10.222.0.67 () {60 vars in 1152 bytes} [Wed May 25 14:47:23 2022] POST /identity/v3/projects => generated 379 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:47:23.932301 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b002cf9-6fa7-47ab-92c3-83b92c2b8765 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:47:23.947971 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b002cf9-6fa7-47ab-92c3-83b92c2b8765 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:47:24.042207 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a222cea-7b16-4808-8b82-035f2d668510 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:47:24.043347 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a222cea-7b16-4808-8b82-035f2d668510 admin admin] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:47:24.043879 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a222cea-7b16-4808-8b82-035f2d668510 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:47:24.044361 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a222cea-7b16-4808-8b82-035f2d668510 admin admin] PATH_INFO: `/v3/users` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:47:24.045488 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a222cea-7b16-4808-8b82-035f2d668510 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:47:24.048908 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a222cea-7b16-4808-8b82-035f2d668510 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:47:24.077741 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1222/2427] 10.222.0.67 () {60 vars in 1143 bytes} [Wed May 25 14:47:23 2022] POST /identity/v3/users => generated 290 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:47:24.082167 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7f28d9-6d6e-4e16-aaf3-e0617060a1a0 admin admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:47:24.096505 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7f28d9-6d6e-4e16-aaf3-e0617060a1a0 admin admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:47:24.101578 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93de9602-5864-4646-b4a7-07fe475f1207 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:47:24.102293 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93de9602-5864-4646-b4a7-07fe475f1207 admin admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:47:24.102579 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93de9602-5864-4646-b4a7-07fe475f1207 admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:47:24.102858 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93de9602-5864-4646-b4a7-07fe475f1207 admin admin] PATH_INFO: `/v3/roles` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:47:24.103673 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93de9602-5864-4646-b4a7-07fe475f1207 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:47:24.105327 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93de9602-5864-4646-b4a7-07fe475f1207 admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:47:24.119538 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1206/2428] 10.222.0.67 () {58 vars in 1121 bytes} [Wed May 25 14:47:24 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:47:24.123444 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a222cea-7b16-4808-8b82-035f2d668510 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:47:24.133821 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a222cea-7b16-4808-8b82-035f2d668510 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:47:24.138933 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e0b07f-a1a9-49db-80aa-0bd5ed2b110b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:47:24.139650 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e0b07f-a1a9-49db-80aa-0bd5ed2b110b admin admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:47:24.139940 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e0b07f-a1a9-49db-80aa-0bd5ed2b110b admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:47:24.140226 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e0b07f-a1a9-49db-80aa-0bd5ed2b110b admin admin] PATH_INFO: `/v3/roles` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:47:24.140972 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e0b07f-a1a9-49db-80aa-0bd5ed2b110b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:47:24.142620 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e0b07f-a1a9-49db-80aa-0bd5ed2b110b admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:47:24.154715 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1223/2429] 10.222.0.67 () {58 vars in 1121 bytes} [Wed May 25 14:47:24 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 25 14:47:24.161086 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93de9602-5864-4646-b4a7-07fe475f1207 admin admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:47:24.174881 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93de9602-5864-4646-b4a7-07fe475f1207 admin admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:47:24.179815 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382ec362-f9c1-4766-981b-b8bea78f6c59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:47:24.180719 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382ec362-f9c1-4766-981b-b8bea78f6c59 admin admin] REQUEST_METHOD: `PUT` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:47:24.181002 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382ec362-f9c1-4766-981b-b8bea78f6c59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:47:24.181279 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382ec362-f9c1-4766-981b-b8bea78f6c59 admin admin] PATH_INFO: `/v3/projects/10199e992aff41acb01ef7eb64f2cee3/users/1261dd8cd38d468baa6ffdd283f775f7/roles/48808901834b4d5eab2c7e6b5b03791e` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:47:24.202408 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382ec362-f9c1-4766-981b-b8bea78f6c59 admin admin] RBAC: Authorizing `identity:create_grant(project_id=10199e992aff41acb01ef7eb64f2cee3, user_id=1261dd8cd38d468baa6ffdd283f775f7, role_id=48808901834b4d5eab2c7e6b5b03791e)` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:47:24.203530 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382ec362-f9c1-4766-981b-b8bea78f6c59 admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:47:24.219982 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1207/2430] 10.222.0.67 () {60 vars in 1482 bytes} [Wed May 25 14:47:24 2022] PUT /identity/v3/projects/10199e992aff41acb01ef7eb64f2cee3/users/1261dd8cd38d468baa6ffdd283f775f7/roles/48808901834b4d5eab2c7e6b5b03791e => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:47:24.233458 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19b8667-a713-4cb4-8225-a90b7dbfd010 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:47:24.233817 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19b8667-a713-4cb4-8225-a90b7dbfd010 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:47:24.234110 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19b8667-a713-4cb4-8225-a90b7dbfd010 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:47:24.271750 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-e19b8667-a713-4cb4-8225-a90b7dbfd010 None None] MFA Rules not processed for user `1261dd8cd38d468baa6ffdd283f775f7`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:47:24.273002 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-e19b8667-a713-4cb4-8225-a90b7dbfd010 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:47:24.367941 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1224/2431] 10.222.0.67 () {58 vars in 957 bytes} [Wed May 25 14:47:24 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:47:24.372708 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382ec362-f9c1-4766-981b-b8bea78f6c59 admin admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:47:24.473994 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382ec362-f9c1-4766-981b-b8bea78f6c59 admin admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:47:24.481317 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6725ab02-68e4-4010-865f-b8eba8c970de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:47:24.483040 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6725ab02-68e4-4010-865f-b8eba8c970de admin admin] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:47:24.483695 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6725ab02-68e4-4010-865f-b8eba8c970de admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:47:24.484161 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6725ab02-68e4-4010-865f-b8eba8c970de admin admin] PATH_INFO: `/v3/projects` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:47:24.485057 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6725ab02-68e4-4010-865f-b8eba8c970de admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:47:24.487273 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6725ab02-68e4-4010-865f-b8eba8c970de admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:47:24.539513 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1208/2432] 10.222.0.67 () {60 vars in 1152 bytes} [Wed May 25 14:47:24 2022] POST /identity/v3/projects => generated 379 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:47:24.543006 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19b8667-a713-4cb4-8225-a90b7dbfd010 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:47:24.568958 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19b8667-a713-4cb4-8225-a90b7dbfd010 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:47:24.592969 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:47:24.684741 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048bf65a-ec5e-431f-b1eb-d3c135e30234 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:47:24.685891 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048bf65a-ec5e-431f-b1eb-d3c135e30234 admin admin] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:47:24.686085 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048bf65a-ec5e-431f-b1eb-d3c135e30234 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:47:24.686441 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048bf65a-ec5e-431f-b1eb-d3c135e30234 admin admin] PATH_INFO: `/v3/users` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:47:24.687287 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048bf65a-ec5e-431f-b1eb-d3c135e30234 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:47:24.690896 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048bf65a-ec5e-431f-b1eb-d3c135e30234 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:47:24.721042 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1225/2433] 10.222.0.67 () {60 vars in 1143 bytes} [Wed May 25 14:47:24 2022] POST /identity/v3/users => generated 296 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:47:24.725175 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6725ab02-68e4-4010-865f-b8eba8c970de admin admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:47:24.741226 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6725ab02-68e4-4010-865f-b8eba8c970de admin admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:47:24.747478 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffe9c20-5a45-4268-a0bf-c06b628e05df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:47:24.748497 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffe9c20-5a45-4268-a0bf-c06b628e05df admin admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:47:24.748884 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffe9c20-5a45-4268-a0bf-c06b628e05df admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:47:24.749229 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffe9c20-5a45-4268-a0bf-c06b628e05df admin admin] PATH_INFO: `/v3/roles` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:47:24.750086 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffe9c20-5a45-4268-a0bf-c06b628e05df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:47:24.751906 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffe9c20-5a45-4268-a0bf-c06b628e05df admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:47:24.764006 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1209/2434] 10.222.0.67 () {58 vars in 1121 bytes} [Wed May 25 14:47:24 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:47:24.770245 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048bf65a-ec5e-431f-b1eb-d3c135e30234 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:47:24.782122 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048bf65a-ec5e-431f-b1eb-d3c135e30234 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:47:24.786885 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8813941b-f3db-4595-bf64-0fc402ae45b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:47:24.787833 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8813941b-f3db-4595-bf64-0fc402ae45b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:47:24.788115 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8813941b-f3db-4595-bf64-0fc402ae45b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:47:24.788552 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8813941b-f3db-4595-bf64-0fc402ae45b1 admin admin] PATH_INFO: `/v3/projects/3ef5d5c807514bc0be51b60335112286/users/3ba350d1a20048c2b86bbfb6a792dee6/roles/399893e19eac4ab5a8e596f7c07be13c` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:47:24.816482 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8813941b-f3db-4595-bf64-0fc402ae45b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ef5d5c807514bc0be51b60335112286, user_id=3ba350d1a20048c2b86bbfb6a792dee6, role_id=399893e19eac4ab5a8e596f7c07be13c)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:47:24.819207 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8813941b-f3db-4595-bf64-0fc402ae45b1 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:47:24.851355 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1226/2435] 10.222.0.67 () {60 vars in 1482 bytes} [Wed May 25 14:47:24 2022] PUT /identity/v3/projects/3ef5d5c807514bc0be51b60335112286/users/3ba350d1a20048c2b86bbfb6a792dee6/roles/399893e19eac4ab5a8e596f7c07be13c => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:47:24.852639 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffe9c20-5a45-4268-a0bf-c06b628e05df admin admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:47:24.864491 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffe9c20-5a45-4268-a0bf-c06b628e05df admin admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:47:25.005236 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093f1b93-7eab-4a61-987e-5f2036f0482b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:47:25.006074 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093f1b93-7eab-4a61-987e-5f2036f0482b admin admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:47:25.006360 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093f1b93-7eab-4a61-987e-5f2036f0482b admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:47:25.007532 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093f1b93-7eab-4a61-987e-5f2036f0482b admin admin] PATH_INFO: `/v3/roles` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:47:25.007532 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093f1b93-7eab-4a61-987e-5f2036f0482b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:47:25.009545 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093f1b93-7eab-4a61-987e-5f2036f0482b admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:47:25.011667 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:DELETE=2,keystone:SELECT=95,keystone:INSERT=3 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:47:25.035144 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1210/2436] 10.222.0.67 () {58 vars in 1121 bytes} [Wed May 25 14:47:24 2022] GET /identity/v3/roles => generated 1420 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 25 14:47:25.040991 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8813941b-f3db-4595-bf64-0fc402ae45b1 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:47:25.061023 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8813941b-f3db-4595-bf64-0fc402ae45b1 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:47:25.083091 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40591c02-fe0c-4f68-aa5c-3a15c02afe98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:47:25.083091 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40591c02-fe0c-4f68-aa5c-3a15c02afe98 admin admin] REQUEST_METHOD: `PUT` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:47:25.083754 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40591c02-fe0c-4f68-aa5c-3a15c02afe98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:47:25.084333 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40591c02-fe0c-4f68-aa5c-3a15c02afe98 admin admin] PATH_INFO: `/v3/projects/3ef5d5c807514bc0be51b60335112286/users/3ba350d1a20048c2b86bbfb6a792dee6/roles/399893e19eac4ab5a8e596f7c07be13c` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:47:25.089444 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40591c02-fe0c-4f68-aa5c-3a15c02afe98 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ef5d5c807514bc0be51b60335112286, user_id=3ba350d1a20048c2b86bbfb6a792dee6, role_id=399893e19eac4ab5a8e596f7c07be13c)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:47:25.095359 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40591c02-fe0c-4f68-aa5c-3a15c02afe98 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:47:25.127283 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1227/2437] 10.222.0.67 () {60 vars in 1482 bytes} [Wed May 25 14:47:25 2022] PUT /identity/v3/projects/3ef5d5c807514bc0be51b60335112286/users/3ba350d1a20048c2b86bbfb6a792dee6/roles/399893e19eac4ab5a8e596f7c07be13c => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:47:25.136429 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cac8be-cd26-420d-b9b3-b56eb6801e1b None None] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:47:25.136721 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cac8be-cd26-420d-b9b3-b56eb6801e1b None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:47:25.137066 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cac8be-cd26-420d-b9b3-b56eb6801e1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:47:25.177777 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.auth.core [None req-74cac8be-cd26-420d-b9b3-b56eb6801e1b None None] MFA Rules not processed for user `3ba350d1a20048c2b86bbfb6a792dee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:47:25.179112 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-74cac8be-cd26-420d-b9b3-b56eb6801e1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:47:25.279068 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1211/2438] 10.222.0.67 () {58 vars in 957 bytes} [Wed May 25 14:47:25 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:47:25.290836 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40591c02-fe0c-4f68-aa5c-3a15c02afe98 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:47:25.292696 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-40591c02-fe0c-4f68-aa5c-3a15c02afe98 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:47:25.393655 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40591c02-fe0c-4f68-aa5c-3a15c02afe98 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:47:25.397999 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39d0c5a-cd47-40ca-888d-5487fd01aaca service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e462acc9da84a61bb23998dd54e1858', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfe93ee8d32a441295efc0b885de4bd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:47:25.398695 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39d0c5a-cd47-40ca-888d-5487fd01aaca service cinder] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:47:25.399014 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39d0c5a-cd47-40ca-888d-5487fd01aaca service cinder] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:47:25.399335 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39d0c5a-cd47-40ca-888d-5487fd01aaca service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:47:25.424812 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39d0c5a-cd47-40ca-888d-5487fd01aaca service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:47:25.426098 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39d0c5a-cd47-40ca-888d-5487fd01aaca service cinder] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:47:25.451057 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1228/2439] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 14:47:25 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:47:25.589258 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cac8be-cd26-420d-b9b3-b56eb6801e1b None None] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:47:25.603633 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cac8be-cd26-420d-b9b3-b56eb6801e1b None None] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:47:25.616200 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426fefe9-54da-4d91-9742-a516a30875bf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e462acc9da84a61bb23998dd54e1858', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfe93ee8d32a441295efc0b885de4bd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:47:25.618459 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426fefe9-54da-4d91-9742-a516a30875bf service cinder] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:47:25.621059 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426fefe9-54da-4d91-9742-a516a30875bf service cinder] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:47:25.621059 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426fefe9-54da-4d91-9742-a516a30875bf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:47:25.758547 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426fefe9-54da-4d91-9742-a516a30875bf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:47:25.760669 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426fefe9-54da-4d91-9742-a516a30875bf service cinder] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:47:25.774853 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1212/2440] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 14:47:25 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:47:32.886604 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39d0c5a-cd47-40ca-888d-5487fd01aaca service cinder] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:47:32.969437 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39d0c5a-cd47-40ca-888d-5487fd01aaca service cinder] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:47:32.974762 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87e45cb-2ab5-4f95-94e5-ce14e4c22059 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:47:32.975684 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87e45cb-2ab5-4f95-94e5-ce14e4c22059 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:47:32.975966 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87e45cb-2ab5-4f95-94e5-ce14e4c22059 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:47:32.976239 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87e45cb-2ab5-4f95-94e5-ce14e4c22059 admin admin] PATH_INFO: `/v3/users/1261dd8cd38d468baa6ffdd283f775f7` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:47:32.977552 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87e45cb-2ab5-4f95-94e5-ce14e4c22059 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1261dd8cd38d468baa6ffdd283f775f7)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:47:32.979502 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87e45cb-2ab5-4f95-94e5-ce14e4c22059 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:47:33.001044 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=94,keystone:INSERT=5,keystone:DELETE=1 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:47:33.041710 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-f87e45cb-2ab5-4f95-94e5-ce14e4c22059 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1261dd8cd38d468baa6ffdd283f775f7'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:47:33.051237 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-f87e45cb-2ab5-4f95-94e5-ce14e4c22059 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1261dd8cd38d468baa6ffdd283f775f7'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:47:33.051892 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-f87e45cb-2ab5-4f95-94e5-ce14e4c22059 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1261dd8cd38d468baa6ffdd283f775f7'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:47:33.061047 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-f87e45cb-2ab5-4f95-94e5-ce14e4c22059 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1261dd8cd38d468baa6ffdd283f775f7'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:47:33.073231 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-f87e45cb-2ab5-4f95-94e5-ce14e4c22059 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1261dd8cd38d468baa6ffdd283f775f7'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:47:33.079917 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1229/2441] 10.222.0.67 () {58 vars in 1223 bytes} [Wed May 25 14:47:32 2022] DELETE /identity/v3/users/1261dd8cd38d468baa6ffdd283f775f7 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:47:33.084451 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ec6f1e-244d-4b82-95f9-59410ec65e71 None None] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:47:33.084951 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ec6f1e-244d-4b82-95f9-59410ec65e71 None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:47:33.085061 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ec6f1e-244d-4b82-95f9-59410ec65e71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:47:33.102360 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.auth.core [None req-46ec6f1e-244d-4b82-95f9-59410ec65e71 None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:47:33.103603 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-46ec6f1e-244d-4b82-95f9-59410ec65e71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:47:33.167369 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1213/2442] 10.222.0.67 () {58 vars in 957 bytes} [Wed May 25 14:47:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:47:33.179622 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87e45cb-2ab5-4f95-94e5-ce14e4c22059 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:47:33.181013 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-f87e45cb-2ab5-4f95-94e5-ce14e4c22059 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:47:33.251517 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87e45cb-2ab5-4f95-94e5-ce14e4c22059 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:47:33.255293 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a57f64c-be25-4f94-9186-25e3439b15ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b68eed985c7b49839bcdd173186ad4ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfe93ee8d32a441295efc0b885de4bd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:47:33.255941 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a57f64c-be25-4f94-9186-25e3439b15ec service neutron] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:47:33.256258 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a57f64c-be25-4f94-9186-25e3439b15ec service neutron] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:47:33.256531 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a57f64c-be25-4f94-9186-25e3439b15ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:47:33.266433 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a57f64c-be25-4f94-9186-25e3439b15ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:47:33.267908 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a57f64c-be25-4f94-9186-25e3439b15ec service neutron] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:47:33.278400 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1230/2443] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 14:47:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:47:33.580787 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ec6f1e-244d-4b82-95f9-59410ec65e71 None None] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:47:33.582549 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-46ec6f1e-244d-4b82-95f9-59410ec65e71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:47:33.595899 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ec6f1e-244d-4b82-95f9-59410ec65e71 None None] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:47:33.600738 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096d1e61-d924-423a-9cff-54c039c8b5ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:47:33.601955 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096d1e61-d924-423a-9cff-54c039c8b5ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:47:33.602236 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096d1e61-d924-423a-9cff-54c039c8b5ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:47:33.602511 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096d1e61-d924-423a-9cff-54c039c8b5ec admin admin] PATH_INFO: `/v3/projects/10199e992aff41acb01ef7eb64f2cee3` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:47:33.604400 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096d1e61-d924-423a-9cff-54c039c8b5ec admin admin] RBAC: Authorizing `identity:delete_project(project_id=10199e992aff41acb01ef7eb64f2cee3)` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:47:33.606484 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096d1e61-d924-423a-9cff-54c039c8b5ec admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:47:33.634340 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:47:33.667278 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-096d1e61-d924-423a-9cff-54c039c8b5ec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '10199e992aff41acb01ef7eb64f2cee3', 'request_id': 'req-096d1e61-d924-423a-9cff-54c039c8b5ec'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:47:33.675479 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-096d1e61-d924-423a-9cff-54c039c8b5ec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '10199e992aff41acb01ef7eb64f2cee3', 'request_id': 'req-096d1e61-d924-423a-9cff-54c039c8b5ec'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:47:33.682429 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-096d1e61-d924-423a-9cff-54c039c8b5ec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '10199e992aff41acb01ef7eb64f2cee3', 'request_id': 'req-096d1e61-d924-423a-9cff-54c039c8b5ec'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:47:33.695168 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-096d1e61-d924-423a-9cff-54c039c8b5ec admin admin] The token cache is being invalidate because project 10199e992aff41acb01ef7eb64f2cee3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80474) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 14:47:33.695459 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-096d1e61-d924-423a-9cff-54c039c8b5ec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:47:33.696151 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-096d1e61-d924-423a-9cff-54c039c8b5ec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:47:33.697707 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1214/2444] 10.222.0.67 () {58 vars in 1232 bytes} [Wed May 25 14:47:33 2022] DELETE /identity/v3/projects/10199e992aff41acb01ef7eb64f2cee3 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:47:33.703008 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a57f64c-be25-4f94-9186-25e3439b15ec service neutron] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:47:33.713957 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a57f64c-be25-4f94-9186-25e3439b15ec service neutron] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:47:33.772206 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd9d354-6ff7-46b9-a1c0-9c0f872ae1cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:47:33.773279 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd9d354-6ff7-46b9-a1c0-9c0f872ae1cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:47:33.773605 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd9d354-6ff7-46b9-a1c0-9c0f872ae1cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:47:33.773935 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd9d354-6ff7-46b9-a1c0-9c0f872ae1cd admin admin] PATH_INFO: `/v3/users/3ba350d1a20048c2b86bbfb6a792dee6` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:47:33.775797 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd9d354-6ff7-46b9-a1c0-9c0f872ae1cd admin admin] RBAC: Authorizing `identity:delete_user(user_id=3ba350d1a20048c2b86bbfb6a792dee6)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:47:33.777874 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd9d354-6ff7-46b9-a1c0-9c0f872ae1cd admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:47:33.819697 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:DELETE=14,keystone:SELECT=85,keystone:INSERT=1 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:47:33.827241 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-cdd9d354-6ff7-46b9-a1c0-9c0f872ae1cd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3ba350d1a20048c2b86bbfb6a792dee6'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:47:33.836334 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-cdd9d354-6ff7-46b9-a1c0-9c0f872ae1cd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3ba350d1a20048c2b86bbfb6a792dee6'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:47:33.837037 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-cdd9d354-6ff7-46b9-a1c0-9c0f872ae1cd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3ba350d1a20048c2b86bbfb6a792dee6'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:47:33.844633 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-cdd9d354-6ff7-46b9-a1c0-9c0f872ae1cd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3ba350d1a20048c2b86bbfb6a792dee6'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:47:33.857710 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-cdd9d354-6ff7-46b9-a1c0-9c0f872ae1cd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3ba350d1a20048c2b86bbfb6a792dee6'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:47:33.863885 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1231/2445] 10.222.0.67 () {58 vars in 1223 bytes} [Wed May 25 14:47:33 2022] DELETE /identity/v3/users/3ba350d1a20048c2b86bbfb6a792dee6 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:47:34.172973 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096d1e61-d924-423a-9cff-54c039c8b5ec admin admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:47:34.174497 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-096d1e61-d924-423a-9cff-54c039c8b5ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:47:34.188659 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096d1e61-d924-423a-9cff-54c039c8b5ec admin admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:47:34.259605 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52812dc2-2eb0-47d0-a128-00343a7b2668 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:47:34.260766 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52812dc2-2eb0-47d0-a128-00343a7b2668 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:47:34.261055 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52812dc2-2eb0-47d0-a128-00343a7b2668 admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:47:34.261333 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52812dc2-2eb0-47d0-a128-00343a7b2668 admin admin] PATH_INFO: `/v3/projects/3ef5d5c807514bc0be51b60335112286` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:47:34.262594 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52812dc2-2eb0-47d0-a128-00343a7b2668 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3ef5d5c807514bc0be51b60335112286)` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:47:34.264592 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52812dc2-2eb0-47d0-a128-00343a7b2668 admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:47:34.314831 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-52812dc2-2eb0-47d0-a128-00343a7b2668 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3ef5d5c807514bc0be51b60335112286', 'request_id': 'req-52812dc2-2eb0-47d0-a128-00343a7b2668'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:47:34.326710 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-52812dc2-2eb0-47d0-a128-00343a7b2668 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3ef5d5c807514bc0be51b60335112286', 'request_id': 'req-52812dc2-2eb0-47d0-a128-00343a7b2668'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:47:34.335056 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-52812dc2-2eb0-47d0-a128-00343a7b2668 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3ef5d5c807514bc0be51b60335112286', 'request_id': 'req-52812dc2-2eb0-47d0-a128-00343a7b2668'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:47:34.347229 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-52812dc2-2eb0-47d0-a128-00343a7b2668 admin admin] The token cache is being invalidate because project 3ef5d5c807514bc0be51b60335112286 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80474) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 14:47:34.347524 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-52812dc2-2eb0-47d0-a128-00343a7b2668 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:47:34.348198 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-52812dc2-2eb0-47d0-a128-00343a7b2668 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:47:34.349850 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1215/2446] 10.222.0.67 () {58 vars in 1232 bytes} [Wed May 25 14:47:34 2022] DELETE /identity/v3/projects/3ef5d5c807514bc0be51b60335112286 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 14:47:34.354879 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e92ddc-ac40-4f7c-99fd-aef94a7488cf None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:47:34.355387 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e92ddc-ac40-4f7c-99fd-aef94a7488cf None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:47:34.356077 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e92ddc-ac40-4f7c-99fd-aef94a7488cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:47:34.375951 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-d0e92ddc-ac40-4f7c-99fd-aef94a7488cf None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:47:34.377234 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-d0e92ddc-ac40-4f7c-99fd-aef94a7488cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:47:34.442270 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1232/2447] 10.222.0.67 () {58 vars in 957 bytes} [Wed May 25 14:47:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:47:34.450715 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795a9b99-58fd-49d8-a2ba-14764641eea3 None None] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:47:34.451047 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795a9b99-58fd-49d8-a2ba-14764641eea3 None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:47:34.451341 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795a9b99-58fd-49d8-a2ba-14764641eea3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:47:34.471452 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.auth.core [None req-795a9b99-58fd-49d8-a2ba-14764641eea3 None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:47:34.472690 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-795a9b99-58fd-49d8-a2ba-14764641eea3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:47:34.481892 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1216/2448] 10.222.0.67 () {58 vars in 957 bytes} [Wed May 25 14:47:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:47:34.485882 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e92ddc-ac40-4f7c-99fd-aef94a7488cf None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:47:34.497923 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e92ddc-ac40-4f7c-99fd-aef94a7488cf None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:47:34.503380 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c25d314-7ef0-4a05-a207-77fc6211a20f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:47:34.504071 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c25d314-7ef0-4a05-a207-77fc6211a20f admin admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:47:34.504359 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c25d314-7ef0-4a05-a207-77fc6211a20f admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:47:34.504634 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c25d314-7ef0-4a05-a207-77fc6211a20f admin admin] PATH_INFO: `/v3/domains` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:47:34.505379 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c25d314-7ef0-4a05-a207-77fc6211a20f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:47:34.505836 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c25d314-7ef0-4a05-a207-77fc6211a20f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:47:34.507623 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c25d314-7ef0-4a05-a207-77fc6211a20f admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:47:34.522006 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1233/2449] 10.222.0.67 () {58 vars in 1152 bytes} [Wed May 25 14:47:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:47:34.526426 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795a9b99-58fd-49d8-a2ba-14764641eea3 None None] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:47:34.546142 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795a9b99-58fd-49d8-a2ba-14764641eea3 None None] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:47:34.551901 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24c39c6-c68a-490b-a03c-d7fefd51ba66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:47:34.552588 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24c39c6-c68a-490b-a03c-d7fefd51ba66 admin admin] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:47:34.552881 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24c39c6-c68a-490b-a03c-d7fefd51ba66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:47:34.553161 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24c39c6-c68a-490b-a03c-d7fefd51ba66 admin admin] PATH_INFO: `/v3/projects` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:47:34.553895 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24c39c6-c68a-490b-a03c-d7fefd51ba66 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:47:34.555914 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24c39c6-c68a-490b-a03c-d7fefd51ba66 admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:47:34.586173 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:47:34.607363 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1217/2450] 10.222.0.67 () {60 vars in 1152 bytes} [Wed May 25 14:47:34 2022] POST /identity/v3/projects => generated 369 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:47:34.608843 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c25d314-7ef0-4a05-a207-77fc6211a20f admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:47:34.622131 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c25d314-7ef0-4a05-a207-77fc6211a20f admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:47:34.696730 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01459674-cef8-48bc-9cc5-afe070ae95e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:47:34.697495 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01459674-cef8-48bc-9cc5-afe070ae95e3 admin admin] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:47:34.697778 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01459674-cef8-48bc-9cc5-afe070ae95e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:47:34.698096 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01459674-cef8-48bc-9cc5-afe070ae95e3 admin admin] PATH_INFO: `/v3/users` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:47:34.698805 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01459674-cef8-48bc-9cc5-afe070ae95e3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:47:34.700833 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01459674-cef8-48bc-9cc5-afe070ae95e3 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:47:34.727936 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1234/2451] 10.222.0.67 () {60 vars in 1143 bytes} [Wed May 25 14:47:34 2022] POST /identity/v3/users => generated 285 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:47:34.733338 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24c39c6-c68a-490b-a03c-d7fefd51ba66 admin admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:47:34.744154 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24c39c6-c68a-490b-a03c-d7fefd51ba66 admin admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:47:34.758626 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de23c211-7289-4269-b54a-ffb02acd4190 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:47:34.759824 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de23c211-7289-4269-b54a-ffb02acd4190 admin admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:47:34.760626 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de23c211-7289-4269-b54a-ffb02acd4190 admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:47:34.761131 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de23c211-7289-4269-b54a-ffb02acd4190 admin admin] PATH_INFO: `/v3/roles` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:47:34.762580 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de23c211-7289-4269-b54a-ffb02acd4190 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:47:34.764318 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de23c211-7289-4269-b54a-ffb02acd4190 admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:47:34.775267 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1218/2452] 10.222.0.67 () {58 vars in 1121 bytes} [Wed May 25 14:47:34 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:47:34.780008 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01459674-cef8-48bc-9cc5-afe070ae95e3 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:47:34.790161 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01459674-cef8-48bc-9cc5-afe070ae95e3 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:47:34.795976 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced6cfb8-365d-46e3-990f-9e5855f157d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:47:34.796649 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced6cfb8-365d-46e3-990f-9e5855f157d3 admin admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:47:34.796932 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced6cfb8-365d-46e3-990f-9e5855f157d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:47:34.797206 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced6cfb8-365d-46e3-990f-9e5855f157d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:47:34.797942 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced6cfb8-365d-46e3-990f-9e5855f157d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:47:34.800983 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced6cfb8-365d-46e3-990f-9e5855f157d3 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:47:34.812684 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1235/2453] 10.222.0.67 () {58 vars in 1121 bytes} [Wed May 25 14:47:34 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 25 14:47:34.816979 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de23c211-7289-4269-b54a-ffb02acd4190 admin admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:47:34.835179 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de23c211-7289-4269-b54a-ffb02acd4190 admin admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:47:34.841095 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874a8119-2507-498e-83ad-e2eef3dc5a11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:47:34.842012 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874a8119-2507-498e-83ad-e2eef3dc5a11 admin admin] REQUEST_METHOD: `PUT` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:47:34.842301 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874a8119-2507-498e-83ad-e2eef3dc5a11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:47:34.842585 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874a8119-2507-498e-83ad-e2eef3dc5a11 admin admin] PATH_INFO: `/v3/projects/a167e9ed1db541a9835e9c26eae4a856/users/61ac68c0419f42debc62caa6cfab4625/roles/48808901834b4d5eab2c7e6b5b03791e` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:47:34.860948 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874a8119-2507-498e-83ad-e2eef3dc5a11 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a167e9ed1db541a9835e9c26eae4a856, user_id=61ac68c0419f42debc62caa6cfab4625, role_id=48808901834b4d5eab2c7e6b5b03791e)` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:47:34.863678 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874a8119-2507-498e-83ad-e2eef3dc5a11 admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:47:34.882403 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1219/2454] 10.222.0.67 () {60 vars in 1482 bytes} [Wed May 25 14:47:34 2022] PUT /identity/v3/projects/a167e9ed1db541a9835e9c26eae4a856/users/61ac68c0419f42debc62caa6cfab4625/roles/48808901834b4d5eab2c7e6b5b03791e => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 14:47:34.893209 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ef1f84-4ec0-4acf-9ebd-c6c4fd348f39 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:47:34.893497 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ef1f84-4ec0-4acf-9ebd-c6c4fd348f39 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:47:34.893771 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ef1f84-4ec0-4acf-9ebd-c6c4fd348f39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:47:34.928415 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-93ef1f84-4ec0-4acf-9ebd-c6c4fd348f39 None None] MFA Rules not processed for user `61ac68c0419f42debc62caa6cfab4625`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:47:34.929875 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-93ef1f84-4ec0-4acf-9ebd-c6c4fd348f39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:47:34.950036 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:DELETE=5,keystone:SELECT=91,keystone:INSERT=4 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:47:35.020810 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1236/2455] 10.222.0.67 () {58 vars in 957 bytes} [Wed May 25 14:47:34 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:47:35.025421 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874a8119-2507-498e-83ad-e2eef3dc5a11 admin admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:47:35.095491 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874a8119-2507-498e-83ad-e2eef3dc5a11 admin admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:47:35.100243 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62548a47-1026-4f16-b82f-4ca903ecb6c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:47:35.100910 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62548a47-1026-4f16-b82f-4ca903ecb6c3 admin admin] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:47:35.101195 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62548a47-1026-4f16-b82f-4ca903ecb6c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:47:35.101475 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62548a47-1026-4f16-b82f-4ca903ecb6c3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:47:35.102185 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62548a47-1026-4f16-b82f-4ca903ecb6c3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:47:35.104117 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62548a47-1026-4f16-b82f-4ca903ecb6c3 admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:47:35.132326 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1220/2456] 10.222.0.67 () {60 vars in 1152 bytes} [Wed May 25 14:47:35 2022] POST /identity/v3/projects => generated 367 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:47:35.136688 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ef1f84-4ec0-4acf-9ebd-c6c4fd348f39 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:47:35.148273 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ef1f84-4ec0-4acf-9ebd-c6c4fd348f39 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:47:35.210482 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c2833d-4909-43a2-b4e8-74fe10c896d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:47:35.211119 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c2833d-4909-43a2-b4e8-74fe10c896d9 admin admin] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:47:35.211406 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c2833d-4909-43a2-b4e8-74fe10c896d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:47:35.211681 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c2833d-4909-43a2-b4e8-74fe10c896d9 admin admin] PATH_INFO: `/v3/users` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:47:35.212893 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c2833d-4909-43a2-b4e8-74fe10c896d9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:47:35.214737 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c2833d-4909-43a2-b4e8-74fe10c896d9 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:47:35.247051 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1237/2457] 10.222.0.67 () {60 vars in 1143 bytes} [Wed May 25 14:47:35 2022] POST /identity/v3/users => generated 290 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:47:35.251255 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62548a47-1026-4f16-b82f-4ca903ecb6c3 admin admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:47:35.263396 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62548a47-1026-4f16-b82f-4ca903ecb6c3 admin admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:47:35.268159 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807a9420-0787-479b-ac67-9c305f9d6486 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:47:35.268842 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807a9420-0787-479b-ac67-9c305f9d6486 admin admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:47:35.269130 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807a9420-0787-479b-ac67-9c305f9d6486 admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:47:35.269412 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807a9420-0787-479b-ac67-9c305f9d6486 admin admin] PATH_INFO: `/v3/roles` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:47:35.270191 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807a9420-0787-479b-ac67-9c305f9d6486 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:47:35.272023 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807a9420-0787-479b-ac67-9c305f9d6486 admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:47:35.287316 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1221/2458] 10.222.0.67 () {58 vars in 1121 bytes} [Wed May 25 14:47:35 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:47:35.289515 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c2833d-4909-43a2-b4e8-74fe10c896d9 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:47:35.299900 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c2833d-4909-43a2-b4e8-74fe10c896d9 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:47:35.304712 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea204642-a425-4305-8577-a3e60c0b0fcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:47:35.305604 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea204642-a425-4305-8577-a3e60c0b0fcc admin admin] REQUEST_METHOD: `PUT` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:47:35.305889 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea204642-a425-4305-8577-a3e60c0b0fcc admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:47:35.306163 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea204642-a425-4305-8577-a3e60c0b0fcc admin admin] PATH_INFO: `/v3/projects/692f6c9467564ab2bcd709096897fb2f/users/00a1a885cd2c4776b05b3e7ac74340f2/roles/399893e19eac4ab5a8e596f7c07be13c` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:47:35.322959 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea204642-a425-4305-8577-a3e60c0b0fcc admin admin] RBAC: Authorizing `identity:create_grant(project_id=692f6c9467564ab2bcd709096897fb2f, user_id=00a1a885cd2c4776b05b3e7ac74340f2, role_id=399893e19eac4ab5a8e596f7c07be13c)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:47:35.326158 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea204642-a425-4305-8577-a3e60c0b0fcc admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:47:35.342668 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1238/2459] 10.222.0.67 () {60 vars in 1482 bytes} [Wed May 25 14:47:35 2022] PUT /identity/v3/projects/692f6c9467564ab2bcd709096897fb2f/users/00a1a885cd2c4776b05b3e7ac74340f2/roles/399893e19eac4ab5a8e596f7c07be13c => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:47:35.347037 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807a9420-0787-479b-ac67-9c305f9d6486 admin admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:47:35.358255 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807a9420-0787-479b-ac67-9c305f9d6486 admin admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:47:35.415196 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75e1fcd-8a16-4cbd-aa67-e70b76e96d9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:47:35.415864 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75e1fcd-8a16-4cbd-aa67-e70b76e96d9e admin admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:47:35.416153 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75e1fcd-8a16-4cbd-aa67-e70b76e96d9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:47:35.416437 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75e1fcd-8a16-4cbd-aa67-e70b76e96d9e admin admin] PATH_INFO: `/v3/roles` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:47:35.417165 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75e1fcd-8a16-4cbd-aa67-e70b76e96d9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:47:35.419159 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75e1fcd-8a16-4cbd-aa67-e70b76e96d9e admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:47:35.428647 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1222/2460] 10.222.0.67 () {58 vars in 1121 bytes} [Wed May 25 14:47:35 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:47:35.432860 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea204642-a425-4305-8577-a3e60c0b0fcc admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:47:35.443925 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea204642-a425-4305-8577-a3e60c0b0fcc admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:47:35.448621 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f08be58-1865-497d-a52a-079a68e983bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:47:35.450222 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f08be58-1865-497d-a52a-079a68e983bb admin admin] REQUEST_METHOD: `PUT` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:47:35.450509 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f08be58-1865-497d-a52a-079a68e983bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:47:35.450787 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f08be58-1865-497d-a52a-079a68e983bb admin admin] PATH_INFO: `/v3/projects/692f6c9467564ab2bcd709096897fb2f/users/00a1a885cd2c4776b05b3e7ac74340f2/roles/399893e19eac4ab5a8e596f7c07be13c` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:47:35.452790 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f08be58-1865-497d-a52a-079a68e983bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=692f6c9467564ab2bcd709096897fb2f, user_id=00a1a885cd2c4776b05b3e7ac74340f2, role_id=399893e19eac4ab5a8e596f7c07be13c)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:47:35.455468 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f08be58-1865-497d-a52a-079a68e983bb admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:47:35.465852 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1239/2461] 10.222.0.67 () {60 vars in 1482 bytes} [Wed May 25 14:47:35 2022] PUT /identity/v3/projects/692f6c9467564ab2bcd709096897fb2f/users/00a1a885cd2c4776b05b3e7ac74340f2/roles/399893e19eac4ab5a8e596f7c07be13c => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:47:35.476874 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0137f4a0-c463-431b-b99f-6a6fa2cb70d6 None None] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:47:35.477170 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0137f4a0-c463-431b-b99f-6a6fa2cb70d6 None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:47:35.477455 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0137f4a0-c463-431b-b99f-6a6fa2cb70d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:47:35.504485 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.auth.core [None req-0137f4a0-c463-431b-b99f-6a6fa2cb70d6 None None] MFA Rules not processed for user `00a1a885cd2c4776b05b3e7ac74340f2`. Rule list: `[]` (Enabled: `True`). {{(pid=80474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:47:35.505706 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-0137f4a0-c463-431b-b99f-6a6fa2cb70d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:47:35.524641 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:47:35.583750 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1223/2462] 10.222.0.67 () {58 vars in 957 bytes} [Wed May 25 14:47:35 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:47:35.601893 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f08be58-1865-497d-a52a-079a68e983bb admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:47:35.603736 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-9f08be58-1865-497d-a52a-079a68e983bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:47:35.667222 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f08be58-1865-497d-a52a-079a68e983bb admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:47:35.671615 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90afab73-978e-4878-b5f3-d191d813f3d1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e462acc9da84a61bb23998dd54e1858', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfe93ee8d32a441295efc0b885de4bd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:47:35.672308 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90afab73-978e-4878-b5f3-d191d813f3d1 service cinder] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:47:35.672619 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90afab73-978e-4878-b5f3-d191d813f3d1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:47:35.672900 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90afab73-978e-4878-b5f3-d191d813f3d1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:47:35.684364 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90afab73-978e-4878-b5f3-d191d813f3d1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:47:35.686289 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90afab73-978e-4878-b5f3-d191d813f3d1 service cinder] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:47:35.696421 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1240/2463] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 14:47:35 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:47:37.007776 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0137f4a0-c463-431b-b99f-6a6fa2cb70d6 None None] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:47:37.009171 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-0137f4a0-c463-431b-b99f-6a6fa2cb70d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:47:37.073241 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0137f4a0-c463-431b-b99f-6a6fa2cb70d6 None None] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:47:37.077640 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067ba8ae-ca94-49f5-a249-e61f54f146e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b68eed985c7b49839bcdd173186ad4ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfe93ee8d32a441295efc0b885de4bd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:47:37.078531 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067ba8ae-ca94-49f5-a249-e61f54f146e9 service neutron] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:47:37.078822 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067ba8ae-ca94-49f5-a249-e61f54f146e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:47:37.079135 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067ba8ae-ca94-49f5-a249-e61f54f146e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:47:37.081142 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-067ba8ae-ca94-49f5-a249-e61f54f146e9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:47:37.092774 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067ba8ae-ca94-49f5-a249-e61f54f146e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:47:37.101399 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067ba8ae-ca94-49f5-a249-e61f54f146e9 service neutron] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:47:37.111732 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1224/2464] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 14:47:37 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:47:37.115676 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90afab73-978e-4878-b5f3-d191d813f3d1 service cinder] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:47:37.128365 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:47:37.185737 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90afab73-978e-4878-b5f3-d191d813f3d1 service cinder] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:47:37.190468 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3462b1-bb6f-4c21-8259-5f013d59754d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:47:37.191362 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3462b1-bb6f-4c21-8259-5f013d59754d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:47:37.191646 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3462b1-bb6f-4c21-8259-5f013d59754d admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:47:37.191979 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3462b1-bb6f-4c21-8259-5f013d59754d admin admin] PATH_INFO: `/v3/users/61ac68c0419f42debc62caa6cfab4625` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:47:37.193263 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3462b1-bb6f-4c21-8259-5f013d59754d admin admin] RBAC: Authorizing `identity:delete_user(user_id=61ac68c0419f42debc62caa6cfab4625)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:47:37.195213 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3462b1-bb6f-4c21-8259-5f013d59754d admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:47:37.252507 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-af3462b1-bb6f-4c21-8259-5f013d59754d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '61ac68c0419f42debc62caa6cfab4625'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:47:37.261597 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-af3462b1-bb6f-4c21-8259-5f013d59754d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '61ac68c0419f42debc62caa6cfab4625'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:47:37.262257 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-af3462b1-bb6f-4c21-8259-5f013d59754d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '61ac68c0419f42debc62caa6cfab4625'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:47:37.270399 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-af3462b1-bb6f-4c21-8259-5f013d59754d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '61ac68c0419f42debc62caa6cfab4625'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:47:37.285267 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-af3462b1-bb6f-4c21-8259-5f013d59754d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '61ac68c0419f42debc62caa6cfab4625'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:47:37.291843 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1241/2465] 10.222.0.67 () {58 vars in 1223 bytes} [Wed May 25 14:47:37 2022] DELETE /identity/v3/users/61ac68c0419f42debc62caa6cfab4625 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 14:47:37.296907 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a683fee5-0a02-45e9-9e6b-e458a2c5118f None None] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:47:37.297199 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a683fee5-0a02-45e9-9e6b-e458a2c5118f None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:47:37.297484 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a683fee5-0a02-45e9-9e6b-e458a2c5118f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:47:37.317842 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.auth.core [None req-a683fee5-0a02-45e9-9e6b-e458a2c5118f None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:47:37.319065 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-a683fee5-0a02-45e9-9e6b-e458a2c5118f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:47:37.382683 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1225/2466] 10.222.0.67 () {58 vars in 957 bytes} [Wed May 25 14:47:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:47:37.392865 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3462b1-bb6f-4c21-8259-5f013d59754d admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:47:37.394439 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-af3462b1-bb6f-4c21-8259-5f013d59754d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:47:37.463856 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3462b1-bb6f-4c21-8259-5f013d59754d admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:47:37.469413 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a1c9f9-ba88-45a3-86b9-abe681cd47e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b68eed985c7b49839bcdd173186ad4ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfe93ee8d32a441295efc0b885de4bd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:47:37.470164 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a1c9f9-ba88-45a3-86b9-abe681cd47e3 service neutron] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:47:37.470449 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a1c9f9-ba88-45a3-86b9-abe681cd47e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:47:37.470727 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a1c9f9-ba88-45a3-86b9-abe681cd47e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:47:37.482224 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a1c9f9-ba88-45a3-86b9-abe681cd47e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:47:37.483965 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a1c9f9-ba88-45a3-86b9-abe681cd47e3 service neutron] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:47:37.495116 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1242/2467] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 14:47:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:47:37.892485 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a683fee5-0a02-45e9-9e6b-e458a2c5118f None None] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:47:37.894049 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-a683fee5-0a02-45e9-9e6b-e458a2c5118f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:47:37.908042 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a683fee5-0a02-45e9-9e6b-e458a2c5118f None None] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:47:37.915416 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f38d583-8913-4e5c-a77d-782d20b42dff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:47:37.916306 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f38d583-8913-4e5c-a77d-782d20b42dff admin admin] REQUEST_METHOD: `DELETE` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:47:37.916591 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f38d583-8913-4e5c-a77d-782d20b42dff admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:47:37.916869 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f38d583-8913-4e5c-a77d-782d20b42dff admin admin] PATH_INFO: `/v3/projects/a167e9ed1db541a9835e9c26eae4a856` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:47:37.918902 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f38d583-8913-4e5c-a77d-782d20b42dff admin admin] RBAC: Authorizing `identity:delete_project(project_id=a167e9ed1db541a9835e9c26eae4a856)` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:47:37.920794 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f38d583-8913-4e5c-a77d-782d20b42dff admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:47:37.983095 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-6f38d583-8913-4e5c-a77d-782d20b42dff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a167e9ed1db541a9835e9c26eae4a856', 'request_id': 'req-6f38d583-8913-4e5c-a77d-782d20b42dff'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:47:37.987687 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:47:37.992354 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-6f38d583-8913-4e5c-a77d-782d20b42dff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a167e9ed1db541a9835e9c26eae4a856', 'request_id': 'req-6f38d583-8913-4e5c-a77d-782d20b42dff'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:47:38.000873 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-6f38d583-8913-4e5c-a77d-782d20b42dff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a167e9ed1db541a9835e9c26eae4a856', 'request_id': 'req-6f38d583-8913-4e5c-a77d-782d20b42dff'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:47:38.013451 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-6f38d583-8913-4e5c-a77d-782d20b42dff admin admin] The token cache is being invalidate because project a167e9ed1db541a9835e9c26eae4a856 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80474) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 14:47:38.014155 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-6f38d583-8913-4e5c-a77d-782d20b42dff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:47:38.015182 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-6f38d583-8913-4e5c-a77d-782d20b42dff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:47:38.019735 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1226/2468] 10.222.0.67 () {58 vars in 1232 bytes} [Wed May 25 14:47:37 2022] DELETE /identity/v3/projects/a167e9ed1db541a9835e9c26eae4a856 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:47:38.021134 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a1c9f9-ba88-45a3-86b9-abe681cd47e3 service neutron] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:47:38.033139 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a1c9f9-ba88-45a3-86b9-abe681cd47e3 service neutron] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:47:38.061152 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:47:38.103445 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4653d8f2-c17e-4f15-8256-a2aa15c5b346 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:47:38.104352 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4653d8f2-c17e-4f15-8256-a2aa15c5b346 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:47:38.104640 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4653d8f2-c17e-4f15-8256-a2aa15c5b346 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:47:38.104919 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4653d8f2-c17e-4f15-8256-a2aa15c5b346 admin admin] PATH_INFO: `/v3/users/00a1a885cd2c4776b05b3e7ac74340f2` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:47:38.106764 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4653d8f2-c17e-4f15-8256-a2aa15c5b346 admin admin] RBAC: Authorizing `identity:delete_user(user_id=00a1a885cd2c4776b05b3e7ac74340f2)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:47:38.108824 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4653d8f2-c17e-4f15-8256-a2aa15c5b346 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:47:38.172093 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-4653d8f2-c17e-4f15-8256-a2aa15c5b346 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '00a1a885cd2c4776b05b3e7ac74340f2'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:47:38.180407 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-4653d8f2-c17e-4f15-8256-a2aa15c5b346 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '00a1a885cd2c4776b05b3e7ac74340f2'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:47:38.181285 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-4653d8f2-c17e-4f15-8256-a2aa15c5b346 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '00a1a885cd2c4776b05b3e7ac74340f2'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:47:38.190128 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-4653d8f2-c17e-4f15-8256-a2aa15c5b346 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '00a1a885cd2c4776b05b3e7ac74340f2'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:47:38.205779 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-4653d8f2-c17e-4f15-8256-a2aa15c5b346 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '00a1a885cd2c4776b05b3e7ac74340f2'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:47:38.211935 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1243/2469] 10.222.0.67 () {58 vars in 1223 bytes} [Wed May 25 14:47:38 2022] DELETE /identity/v3/users/00a1a885cd2c4776b05b3e7ac74340f2 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:47:38.525269 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f38d583-8913-4e5c-a77d-782d20b42dff admin admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:47:38.527157 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-6f38d583-8913-4e5c-a77d-782d20b42dff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:47:38.550204 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f38d583-8913-4e5c-a77d-782d20b42dff admin admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:47:38.613949 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5840a198-091e-48f2-b544-b7b47b73786e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:47:38.614736 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5840a198-091e-48f2-b544-b7b47b73786e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:47:38.615050 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5840a198-091e-48f2-b544-b7b47b73786e admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:47:38.615333 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5840a198-091e-48f2-b544-b7b47b73786e admin admin] PATH_INFO: `/v3/projects/692f6c9467564ab2bcd709096897fb2f` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:47:38.616544 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5840a198-091e-48f2-b544-b7b47b73786e admin admin] RBAC: Authorizing `identity:delete_project(project_id=692f6c9467564ab2bcd709096897fb2f)` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:47:38.618478 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5840a198-091e-48f2-b544-b7b47b73786e admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:47:38.676506 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-5840a198-091e-48f2-b544-b7b47b73786e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '692f6c9467564ab2bcd709096897fb2f', 'request_id': 'req-5840a198-091e-48f2-b544-b7b47b73786e'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:47:38.685418 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-5840a198-091e-48f2-b544-b7b47b73786e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '692f6c9467564ab2bcd709096897fb2f', 'request_id': 'req-5840a198-091e-48f2-b544-b7b47b73786e'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:47:38.695499 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-5840a198-091e-48f2-b544-b7b47b73786e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '692f6c9467564ab2bcd709096897fb2f', 'request_id': 'req-5840a198-091e-48f2-b544-b7b47b73786e'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:47:38.708437 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-5840a198-091e-48f2-b544-b7b47b73786e admin admin] The token cache is being invalidate because project 692f6c9467564ab2bcd709096897fb2f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80474) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 14:47:38.708437 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-5840a198-091e-48f2-b544-b7b47b73786e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:47:38.709097 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-5840a198-091e-48f2-b544-b7b47b73786e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:47:38.710658 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1227/2470] 10.222.0.67 () {58 vars in 1232 bytes} [Wed May 25 14:47:38 2022] DELETE /identity/v3/projects/692f6c9467564ab2bcd709096897fb2f => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:47:38.717073 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d924ff-2b85-44ba-a9d8-56c592cd05b0 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:47:38.717450 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d924ff-2b85-44ba-a9d8-56c592cd05b0 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:47:38.717764 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d924ff-2b85-44ba-a9d8-56c592cd05b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:47:38.739242 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-02d924ff-2b85-44ba-a9d8-56c592cd05b0 None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:47:38.740455 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-02d924ff-2b85-44ba-a9d8-56c592cd05b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:47:38.822882 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1244/2471] 10.222.0.67 () {58 vars in 957 bytes} [Wed May 25 14:47:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:47:38.830781 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2f262b-074b-415d-9489-c701875fd024 None None] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:47:38.831101 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2f262b-074b-415d-9489-c701875fd024 None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:47:38.831383 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2f262b-074b-415d-9489-c701875fd024 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:47:38.867524 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.auth.core [None req-4b2f262b-074b-415d-9489-c701875fd024 None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:47:38.869316 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-4b2f262b-074b-415d-9489-c701875fd024 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:47:38.881082 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1228/2472] 10.222.0.67 () {58 vars in 957 bytes} [Wed May 25 14:47:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:47:38.886156 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d924ff-2b85-44ba-a9d8-56c592cd05b0 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:47:38.901437 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d924ff-2b85-44ba-a9d8-56c592cd05b0 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:47:38.907235 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74518c59-7159-480f-b885-1b73a1128af8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:47:38.907931 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74518c59-7159-480f-b885-1b73a1128af8 admin admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:47:38.908213 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74518c59-7159-480f-b885-1b73a1128af8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:47:38.908495 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74518c59-7159-480f-b885-1b73a1128af8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:47:38.909253 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74518c59-7159-480f-b885-1b73a1128af8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:47:38.909554 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74518c59-7159-480f-b885-1b73a1128af8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:47:38.911279 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74518c59-7159-480f-b885-1b73a1128af8 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:47:38.931336 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1245/2473] 10.222.0.67 () {58 vars in 1152 bytes} [Wed May 25 14:47:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:47:38.938075 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2f262b-074b-415d-9489-c701875fd024 None None] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:47:38.956337 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2f262b-074b-415d-9489-c701875fd024 None None] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:47:38.962227 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e85b38-fe27-4c76-af7b-f71cf7fac5ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:47:38.963191 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e85b38-fe27-4c76-af7b-f71cf7fac5ab admin admin] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:47:38.963484 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e85b38-fe27-4c76-af7b-f71cf7fac5ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:47:38.963761 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e85b38-fe27-4c76-af7b-f71cf7fac5ab admin admin] PATH_INFO: `/v3/projects` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:47:38.964493 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e85b38-fe27-4c76-af7b-f71cf7fac5ab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:47:38.966648 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e85b38-fe27-4c76-af7b-f71cf7fac5ab admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:47:39.006551 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1229/2474] 10.222.0.67 () {60 vars in 1152 bytes} [Wed May 25 14:47:38 2022] POST /identity/v3/projects => generated 377 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:47:39.011373 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74518c59-7159-480f-b885-1b73a1128af8 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:47:39.030442 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74518c59-7159-480f-b885-1b73a1128af8 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:47:39.071774 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:47:39.123367 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec1aa0d-19d9-4585-8949-12406812d27d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:47:39.124821 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec1aa0d-19d9-4585-8949-12406812d27d admin admin] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:47:39.127485 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec1aa0d-19d9-4585-8949-12406812d27d admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:47:39.128172 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec1aa0d-19d9-4585-8949-12406812d27d admin admin] PATH_INFO: `/v3/users` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:47:39.129277 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec1aa0d-19d9-4585-8949-12406812d27d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:47:39.131841 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec1aa0d-19d9-4585-8949-12406812d27d admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:47:39.165005 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e85b38-fe27-4c76-af7b-f71cf7fac5ab admin admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:47:39.166811 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1246/2475] 10.222.0.67 () {60 vars in 1143 bytes} [Wed May 25 14:47:39 2022] POST /identity/v3/users => generated 289 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 14:47:39.180117 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e85b38-fe27-4c76-af7b-f71cf7fac5ab admin admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:47:39.189360 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d227035-91b2-4aea-aa7e-6c27b20fc0cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:47:39.190097 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d227035-91b2-4aea-aa7e-6c27b20fc0cd admin admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:47:39.190387 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d227035-91b2-4aea-aa7e-6c27b20fc0cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:47:39.190665 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d227035-91b2-4aea-aa7e-6c27b20fc0cd admin admin] PATH_INFO: `/v3/roles` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:47:39.191672 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d227035-91b2-4aea-aa7e-6c27b20fc0cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:47:39.193435 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d227035-91b2-4aea-aa7e-6c27b20fc0cd admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:47:39.206389 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1230/2476] 10.222.0.67 () {58 vars in 1121 bytes} [Wed May 25 14:47:39 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:47:39.211040 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec1aa0d-19d9-4585-8949-12406812d27d admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:47:39.223427 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec1aa0d-19d9-4585-8949-12406812d27d admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:47:39.228923 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9138a592-6297-4035-88a0-5e12ee85e6ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:47:39.229753 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9138a592-6297-4035-88a0-5e12ee85e6ae admin admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:47:39.230103 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9138a592-6297-4035-88a0-5e12ee85e6ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:47:39.230492 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9138a592-6297-4035-88a0-5e12ee85e6ae admin admin] PATH_INFO: `/v3/roles` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:47:39.232136 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9138a592-6297-4035-88a0-5e12ee85e6ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:47:39.233933 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9138a592-6297-4035-88a0-5e12ee85e6ae admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:47:39.252157 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1247/2477] 10.222.0.67 () {58 vars in 1121 bytes} [Wed May 25 14:47:39 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:47:39.253149 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d227035-91b2-4aea-aa7e-6c27b20fc0cd admin admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:47:39.272839 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d227035-91b2-4aea-aa7e-6c27b20fc0cd admin admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:47:39.285267 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230fba00-5f93-4e4c-8642-7d02ab785c72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:47:39.285267 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230fba00-5f93-4e4c-8642-7d02ab785c72 admin admin] REQUEST_METHOD: `PUT` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:47:39.285267 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230fba00-5f93-4e4c-8642-7d02ab785c72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:47:39.285267 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230fba00-5f93-4e4c-8642-7d02ab785c72 admin admin] PATH_INFO: `/v3/projects/c2c1a3d9b8c440afba4937e28b985bc5/users/45c99c4e1bbd496ea968f24695a9823e/roles/48808901834b4d5eab2c7e6b5b03791e` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:47:39.309898 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230fba00-5f93-4e4c-8642-7d02ab785c72 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c2c1a3d9b8c440afba4937e28b985bc5, user_id=45c99c4e1bbd496ea968f24695a9823e, role_id=48808901834b4d5eab2c7e6b5b03791e)` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:47:39.312948 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230fba00-5f93-4e4c-8642-7d02ab785c72 admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:47:39.330925 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6231a1-99ee-4d83-b5a9-f1fdf9547462 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:47:39.331351 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6231a1-99ee-4d83-b5a9-f1fdf9547462 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:47:39.331697 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6231a1-99ee-4d83-b5a9-f1fdf9547462 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:47:39.333907 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1231/2478] 10.222.0.67 () {60 vars in 1482 bytes} [Wed May 25 14:47:39 2022] PUT /identity/v3/projects/c2c1a3d9b8c440afba4937e28b985bc5/users/45c99c4e1bbd496ea968f24695a9823e/roles/48808901834b4d5eab2c7e6b5b03791e => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:47:39.345248 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d183e7-acdc-4c86-8fbe-c9c4030b4616 None None] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:47:39.345499 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d183e7-acdc-4c86-8fbe-c9c4030b4616 None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:47:39.345999 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d183e7-acdc-4c86-8fbe-c9c4030b4616 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:47:39.363626 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-2c6231a1-99ee-4d83-b5a9-f1fdf9547462 None None] MFA Rules not processed for user `e03f5bb82ffb41a1b1dde935d093e6f4`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:47:39.370025 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-2c6231a1-99ee-4d83-b5a9-f1fdf9547462 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:47:39.379240 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=88,keystone:DELETE=9,keystone:INSERT=3 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:47:39.409150 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.auth.core [None req-57d183e7-acdc-4c86-8fbe-c9c4030b4616 None None] MFA Rules not processed for user `45c99c4e1bbd496ea968f24695a9823e`. Rule list: `[]` (Enabled: `True`). {{(pid=80474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:47:39.410893 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-57d183e7-acdc-4c86-8fbe-c9c4030b4616 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:47:39.488985 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1248/2479] 10.222.0.67 () {58 vars in 1009 bytes} [Wed May 25 14:47:39 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 14:47:39.503955 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6231a1-99ee-4d83-b5a9-f1fdf9547462 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:47:39.505536 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-2c6231a1-99ee-4d83-b5a9-f1fdf9547462 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:47:39.513320 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1232/2480] 10.222.0.67 () {58 vars in 957 bytes} [Wed May 25 14:47:39 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 14:47:39.517514 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d183e7-acdc-4c86-8fbe-c9c4030b4616 None None] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:47:39.626795 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d183e7-acdc-4c86-8fbe-c9c4030b4616 None None] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:47:39.641454 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e7682f-f391-4259-afcd-04ef30e0fe69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:47:39.643349 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e7682f-f391-4259-afcd-04ef30e0fe69 admin admin] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:47:39.643812 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e7682f-f391-4259-afcd-04ef30e0fe69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:47:39.644265 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e7682f-f391-4259-afcd-04ef30e0fe69 admin admin] PATH_INFO: `/v3/projects` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:47:39.645471 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e7682f-f391-4259-afcd-04ef30e0fe69 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:47:39.647453 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e7682f-f391-4259-afcd-04ef30e0fe69 admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:47:39.647735 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6231a1-99ee-4d83-b5a9-f1fdf9547462 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:47:39.656931 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d49e24-d0aa-432d-9251-51791bcdcd9e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbe9e38881834198842a476889678096', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfe93ee8d32a441295efc0b885de4bd7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:47:39.657609 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d49e24-d0aa-432d-9251-51791bcdcd9e service swift] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:47:39.657898 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d49e24-d0aa-432d-9251-51791bcdcd9e service swift] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:47:39.658175 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d49e24-d0aa-432d-9251-51791bcdcd9e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:47:39.675285 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d49e24-d0aa-432d-9251-51791bcdcd9e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:47:39.676975 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d49e24-d0aa-432d-9251-51791bcdcd9e service swift] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:47:39.685015 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1233/2481] 10.222.0.67 () {60 vars in 1152 bytes} [Wed May 25 14:47:39 2022] POST /identity/v3/projects => generated 377 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:47:39.690089 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e7682f-f391-4259-afcd-04ef30e0fe69 admin admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:47:39.693160 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1249/2482] 10.222.0.67 () {60 vars in 1384 bytes} [Wed May 25 14:47:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 25 14:47:39.927058 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e7682f-f391-4259-afcd-04ef30e0fe69 admin admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:47:39.940024 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f87a649-88ac-4b42-880b-89b89c731a84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:47:39.941177 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f87a649-88ac-4b42-880b-89b89c731a84 admin admin] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:47:39.946469 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f87a649-88ac-4b42-880b-89b89c731a84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:47:39.947163 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f87a649-88ac-4b42-880b-89b89c731a84 admin admin] PATH_INFO: `/v3/users` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:47:39.948550 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f87a649-88ac-4b42-880b-89b89c731a84 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:47:39.952752 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f87a649-88ac-4b42-880b-89b89c731a84 admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:47:39.991899 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1234/2483] 10.222.0.67 () {60 vars in 1143 bytes} [Wed May 25 14:47:39 2022] POST /identity/v3/users => generated 295 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 14:47:39.996741 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d49e24-d0aa-432d-9251-51791bcdcd9e service swift] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:47:40.019721 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d49e24-d0aa-432d-9251-51791bcdcd9e service swift] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:47:40.036086 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb0a53e-1d4f-47ec-ace1-fa3df569e2da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:47:40.037102 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb0a53e-1d4f-47ec-ace1-fa3df569e2da admin admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:47:40.037549 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb0a53e-1d4f-47ec-ace1-fa3df569e2da admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:47:40.037989 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb0a53e-1d4f-47ec-ace1-fa3df569e2da admin admin] PATH_INFO: `/v3/roles` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:47:40.038940 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb0a53e-1d4f-47ec-ace1-fa3df569e2da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:47:40.040896 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb0a53e-1d4f-47ec-ace1-fa3df569e2da admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:47:40.067867 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1250/2484] 10.222.0.67 () {58 vars in 1121 bytes} [Wed May 25 14:47:39 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 25 14:47:40.072254 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f87a649-88ac-4b42-880b-89b89c731a84 admin admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:47:40.085883 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f87a649-88ac-4b42-880b-89b89c731a84 admin admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:47:40.094653 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38dc8568-1aba-44f9-b613-624726ac3707 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:47:40.095903 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dc8568-1aba-44f9-b613-624726ac3707 admin admin] REQUEST_METHOD: `PUT` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:47:40.096320 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dc8568-1aba-44f9-b613-624726ac3707 admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:47:40.096960 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dc8568-1aba-44f9-b613-624726ac3707 admin admin] PATH_INFO: `/v3/projects/0a153903e3a24502b004aa8be7ce4925/users/bd286312b6264c72af6df16a06fa7d91/roles/399893e19eac4ab5a8e596f7c07be13c` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:47:40.114581 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:47:40.119984 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38dc8568-1aba-44f9-b613-624726ac3707 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a153903e3a24502b004aa8be7ce4925, user_id=bd286312b6264c72af6df16a06fa7d91, role_id=399893e19eac4ab5a8e596f7c07be13c)` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:47:40.124553 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38dc8568-1aba-44f9-b613-624726ac3707 admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:47:40.157339 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb0a53e-1d4f-47ec-ace1-fa3df569e2da admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:47:40.157873 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1235/2485] 10.222.0.67 () {60 vars in 1482 bytes} [Wed May 25 14:47:40 2022] PUT /identity/v3/projects/0a153903e3a24502b004aa8be7ce4925/users/bd286312b6264c72af6df16a06fa7d91/roles/399893e19eac4ab5a8e596f7c07be13c => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:47:40.185402 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb0a53e-1d4f-47ec-ace1-fa3df569e2da admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:47:40.248191 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:47:40.304661 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd5b57b-a1f0-4008-8456-de073b5daf66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:47:40.306104 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd5b57b-a1f0-4008-8456-de073b5daf66 admin admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:47:40.306688 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd5b57b-a1f0-4008-8456-de073b5daf66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:47:40.307130 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd5b57b-a1f0-4008-8456-de073b5daf66 admin admin] PATH_INFO: `/v3/roles` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:47:40.308262 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd5b57b-a1f0-4008-8456-de073b5daf66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:47:40.311960 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd5b57b-a1f0-4008-8456-de073b5daf66 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:47:40.332935 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38dc8568-1aba-44f9-b613-624726ac3707 admin admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:47:40.334585 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1251/2486] 10.222.0.67 () {58 vars in 1121 bytes} [Wed May 25 14:47:40 2022] GET /identity/v3/roles => generated 1420 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:47:40.347956 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38dc8568-1aba-44f9-b613-624726ac3707 admin admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:47:40.361932 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdbba74-0619-4fc7-8ef0-0f0b4623cf63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:47:40.363768 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdbba74-0619-4fc7-8ef0-0f0b4623cf63 admin admin] REQUEST_METHOD: `PUT` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:47:40.364355 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdbba74-0619-4fc7-8ef0-0f0b4623cf63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:47:40.365006 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdbba74-0619-4fc7-8ef0-0f0b4623cf63 admin admin] PATH_INFO: `/v3/projects/0a153903e3a24502b004aa8be7ce4925/users/bd286312b6264c72af6df16a06fa7d91/roles/399893e19eac4ab5a8e596f7c07be13c` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:47:40.369573 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdbba74-0619-4fc7-8ef0-0f0b4623cf63 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a153903e3a24502b004aa8be7ce4925, user_id=bd286312b6264c72af6df16a06fa7d91, role_id=399893e19eac4ab5a8e596f7c07be13c)` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:47:40.375351 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdbba74-0619-4fc7-8ef0-0f0b4623cf63 admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:47:40.410600 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c308a7-c288-4651-a776-40d4f83284cb None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:47:40.411360 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c308a7-c288-4651-a776-40d4f83284cb None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:47:40.411974 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c308a7-c288-4651-a776-40d4f83284cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:47:40.419203 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1236/2487] 10.222.0.67 () {60 vars in 1482 bytes} [Wed May 25 14:47:40 2022] PUT /identity/v3/projects/0a153903e3a24502b004aa8be7ce4925/users/bd286312b6264c72af6df16a06fa7d91/roles/399893e19eac4ab5a8e596f7c07be13c => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:47:40.455696 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-23c308a7-c288-4651-a776-40d4f83284cb None None] MFA Rules not processed for user `bd286312b6264c72af6df16a06fa7d91`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:47:40.457272 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-23c308a7-c288-4651-a776-40d4f83284cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:47:40.573404 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1252/2488] 10.222.0.67 () {58 vars in 957 bytes} [Wed May 25 14:47:40 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 14:47:40.607164 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdbba74-0619-4fc7-8ef0-0f0b4623cf63 admin admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:47:40.608226 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c308a7-c288-4651-a776-40d4f83284cb None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:47:40.610444 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-5bdbba74-0619-4fc7-8ef0-0f0b4623cf63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:47:40.611894 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-23c308a7-c288-4651-a776-40d4f83284cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:47:40.849227 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdbba74-0619-4fc7-8ef0-0f0b4623cf63 admin admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:47:40.862275 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ca7c9c-30f7-4be3-807f-b8f10398d049 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e462acc9da84a61bb23998dd54e1858', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfe93ee8d32a441295efc0b885de4bd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:47:40.863212 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ca7c9c-30f7-4be3-807f-b8f10398d049 service cinder] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:47:40.863595 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ca7c9c-30f7-4be3-807f-b8f10398d049 service cinder] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:47:40.866735 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ca7c9c-30f7-4be3-807f-b8f10398d049 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:47:40.893947 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c308a7-c288-4651-a776-40d4f83284cb None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:47:40.909120 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3d075a-09ea-46cb-92b9-aecd70847b8e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '428ec99478284743943ed41e9d24a603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfe93ee8d32a441295efc0b885de4bd7', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:47:40.909799 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3d075a-09ea-46cb-92b9-aecd70847b8e service nova] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:47:40.910142 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3d075a-09ea-46cb-92b9-aecd70847b8e service nova] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:47:40.910543 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3d075a-09ea-46cb-92b9-aecd70847b8e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:47:40.913894 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-ec3d075a-09ea-46cb-92b9-aecd70847b8e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:47:40.940376 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3d075a-09ea-46cb-92b9-aecd70847b8e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:47:40.942817 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3d075a-09ea-46cb-92b9-aecd70847b8e service nova] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:47:40.960539 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ca7c9c-30f7-4be3-807f-b8f10398d049 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:47:40.962295 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ca7c9c-30f7-4be3-807f-b8f10398d049 service cinder] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:47:40.975523 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1253/2489] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 14:47:40 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:47:40.988004 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1237/2490] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 14:47:40 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:47:42.583654 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3d075a-09ea-46cb-92b9-aecd70847b8e service nova] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:47:42.585284 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-ec3d075a-09ea-46cb-92b9-aecd70847b8e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:47:42.598573 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3d075a-09ea-46cb-92b9-aecd70847b8e service nova] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:47:42.603420 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9e6db9-acf3-46cf-b561-bd6cf1205a65 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e462acc9da84a61bb23998dd54e1858', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfe93ee8d32a441295efc0b885de4bd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:47:42.604081 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9e6db9-acf3-46cf-b561-bd6cf1205a65 service cinder] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:47:42.604369 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9e6db9-acf3-46cf-b561-bd6cf1205a65 service cinder] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:47:42.604795 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9e6db9-acf3-46cf-b561-bd6cf1205a65 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:47:42.617137 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9e6db9-acf3-46cf-b561-bd6cf1205a65 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:47:42.618619 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9e6db9-acf3-46cf-b561-bd6cf1205a65 service cinder] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:47:42.630468 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1254/2491] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 14:47:42 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:47:46.802833 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ca7c9c-30f7-4be3-807f-b8f10398d049 service cinder] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:47:46.885160 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ca7c9c-30f7-4be3-807f-b8f10398d049 service cinder] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:47:46.890586 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2d5fd9-80e1-4318-ab33-6ffa662514e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:47:46.892200 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2d5fd9-80e1-4318-ab33-6ffa662514e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:47:46.892495 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2d5fd9-80e1-4318-ab33-6ffa662514e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:47:46.892877 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2d5fd9-80e1-4318-ab33-6ffa662514e9 admin admin] PATH_INFO: `/v3/users/45c99c4e1bbd496ea968f24695a9823e` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:47:46.895194 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2d5fd9-80e1-4318-ab33-6ffa662514e9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=45c99c4e1bbd496ea968f24695a9823e)` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:47:46.897474 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2d5fd9-80e1-4318-ab33-6ffa662514e9 admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:47:46.958172 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:DELETE=5 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:47:46.977252 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-cc2d5fd9-80e1-4318-ab33-6ffa662514e9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '45c99c4e1bbd496ea968f24695a9823e'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:47:46.978099 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-cc2d5fd9-80e1-4318-ab33-6ffa662514e9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '45c99c4e1bbd496ea968f24695a9823e'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:47:46.978833 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-cc2d5fd9-80e1-4318-ab33-6ffa662514e9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '45c99c4e1bbd496ea968f24695a9823e'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:47:46.994650 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-cc2d5fd9-80e1-4318-ab33-6ffa662514e9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '45c99c4e1bbd496ea968f24695a9823e'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:47:47.004355 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-cc2d5fd9-80e1-4318-ab33-6ffa662514e9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '45c99c4e1bbd496ea968f24695a9823e'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:47:47.024362 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1238/2492] 10.222.0.67 () {58 vars in 1223 bytes} [Wed May 25 14:47:46 2022] DELETE /identity/v3/users/45c99c4e1bbd496ea968f24695a9823e => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:47:47.025967 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8811f7c-4e14-41eb-beeb-d0e082a195a7 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:47:47.026767 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8811f7c-4e14-41eb-beeb-d0e082a195a7 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:47:47.027076 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8811f7c-4e14-41eb-beeb-d0e082a195a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:47:47.050879 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-a8811f7c-4e14-41eb-beeb-d0e082a195a7 None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:47:47.052657 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-a8811f7c-4e14-41eb-beeb-d0e082a195a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:47:47.091568 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:47:47.141996 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1255/2493] 10.222.0.67 () {58 vars in 957 bytes} [Wed May 25 14:47:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:47:47.151801 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2d5fd9-80e1-4318-ab33-6ffa662514e9 admin admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:47:47.153969 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-cc2d5fd9-80e1-4318-ab33-6ffa662514e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:47:47.228917 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2d5fd9-80e1-4318-ab33-6ffa662514e9 admin admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:47:47.234107 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3654ed19-dc6d-45a6-8ac0-ac5be45d0850 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b68eed985c7b49839bcdd173186ad4ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfe93ee8d32a441295efc0b885de4bd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:47:47.235183 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3654ed19-dc6d-45a6-8ac0-ac5be45d0850 service neutron] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:47:47.235707 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3654ed19-dc6d-45a6-8ac0-ac5be45d0850 service neutron] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:47:47.236057 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3654ed19-dc6d-45a6-8ac0-ac5be45d0850 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:47:47.250067 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3654ed19-dc6d-45a6-8ac0-ac5be45d0850 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:47:47.251577 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3654ed19-dc6d-45a6-8ac0-ac5be45d0850 service neutron] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:47:47.265912 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1239/2494] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 14:47:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 14:47:47.637930 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8811f7c-4e14-41eb-beeb-d0e082a195a7 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:47:47.640258 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-a8811f7c-4e14-41eb-beeb-d0e082a195a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:47:47.663684 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8811f7c-4e14-41eb-beeb-d0e082a195a7 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:47:47.677585 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3764e5e-625c-415b-9254-698ae51726c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:47:47.678473 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3764e5e-625c-415b-9254-698ae51726c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:47:47.678761 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3764e5e-625c-415b-9254-698ae51726c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:47:47.679060 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3764e5e-625c-415b-9254-698ae51726c2 admin admin] PATH_INFO: `/v3/projects/c2c1a3d9b8c440afba4937e28b985bc5` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:47:47.680384 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3764e5e-625c-415b-9254-698ae51726c2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c2c1a3d9b8c440afba4937e28b985bc5)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:47:47.682486 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3764e5e-625c-415b-9254-698ae51726c2 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:47:47.758411 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-c3764e5e-625c-415b-9254-698ae51726c2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c2c1a3d9b8c440afba4937e28b985bc5', 'request_id': 'req-c3764e5e-625c-415b-9254-698ae51726c2'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:47:47.766753 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-c3764e5e-625c-415b-9254-698ae51726c2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c2c1a3d9b8c440afba4937e28b985bc5', 'request_id': 'req-c3764e5e-625c-415b-9254-698ae51726c2'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:47:47.783962 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-c3764e5e-625c-415b-9254-698ae51726c2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c2c1a3d9b8c440afba4937e28b985bc5', 'request_id': 'req-c3764e5e-625c-415b-9254-698ae51726c2'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:47:47.802860 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-c3764e5e-625c-415b-9254-698ae51726c2 admin admin] The token cache is being invalidate because project c2c1a3d9b8c440afba4937e28b985bc5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80475) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 14:47:47.803222 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-c3764e5e-625c-415b-9254-698ae51726c2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:47:47.803925 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-c3764e5e-625c-415b-9254-698ae51726c2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:47:47.809146 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1256/2495] 10.222.0.67 () {58 vars in 1232 bytes} [Wed May 25 14:47:47 2022] DELETE /identity/v3/projects/c2c1a3d9b8c440afba4937e28b985bc5 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:47:47.810917 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3654ed19-dc6d-45a6-8ac0-ac5be45d0850 service neutron] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:47:47.825282 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3654ed19-dc6d-45a6-8ac0-ac5be45d0850 service neutron] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:47:47.934690 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c13a5d-8229-4abc-9a0d-3412d7fd132d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:47:47.935815 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c13a5d-8229-4abc-9a0d-3412d7fd132d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:47:47.936186 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c13a5d-8229-4abc-9a0d-3412d7fd132d admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:47:47.936685 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c13a5d-8229-4abc-9a0d-3412d7fd132d admin admin] PATH_INFO: `/v3/users/bd286312b6264c72af6df16a06fa7d91` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:47:47.938058 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c13a5d-8229-4abc-9a0d-3412d7fd132d admin admin] RBAC: Authorizing `identity:delete_user(user_id=bd286312b6264c72af6df16a06fa7d91)` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:47:47.940109 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c13a5d-8229-4abc-9a0d-3412d7fd132d admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:47:48.013751 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-a9c13a5d-8229-4abc-9a0d-3412d7fd132d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bd286312b6264c72af6df16a06fa7d91'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:47:48.014500 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-a9c13a5d-8229-4abc-9a0d-3412d7fd132d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bd286312b6264c72af6df16a06fa7d91'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:47:48.015205 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-a9c13a5d-8229-4abc-9a0d-3412d7fd132d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bd286312b6264c72af6df16a06fa7d91'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:47:48.022726 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:47:48.047024 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-a9c13a5d-8229-4abc-9a0d-3412d7fd132d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bd286312b6264c72af6df16a06fa7d91'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:47:48.056399 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-a9c13a5d-8229-4abc-9a0d-3412d7fd132d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bd286312b6264c72af6df16a06fa7d91'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:47:48.083475 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1240/2496] 10.222.0.67 () {58 vars in 1223 bytes} [Wed May 25 14:47:47 2022] DELETE /identity/v3/users/bd286312b6264c72af6df16a06fa7d91 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:47:48.629040 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3764e5e-625c-415b-9254-698ae51726c2 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:47:48.630579 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-c3764e5e-625c-415b-9254-698ae51726c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:47:48.648744 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3764e5e-625c-415b-9254-698ae51726c2 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:47:48.730594 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f5e01d-9e79-4bbd-8a7d-c7ade86dbeb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:47:48.731554 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f5e01d-9e79-4bbd-8a7d-c7ade86dbeb3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:47:48.731916 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f5e01d-9e79-4bbd-8a7d-c7ade86dbeb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:47:48.732272 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f5e01d-9e79-4bbd-8a7d-c7ade86dbeb3 admin admin] PATH_INFO: `/v3/projects/0a153903e3a24502b004aa8be7ce4925` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:47:48.733647 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f5e01d-9e79-4bbd-8a7d-c7ade86dbeb3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0a153903e3a24502b004aa8be7ce4925)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:47:48.735651 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f5e01d-9e79-4bbd-8a7d-c7ade86dbeb3 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:47:48.789814 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-d9f5e01d-9e79-4bbd-8a7d-c7ade86dbeb3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a153903e3a24502b004aa8be7ce4925', 'request_id': 'req-d9f5e01d-9e79-4bbd-8a7d-c7ade86dbeb3'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:47:48.797436 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:47:48.798943 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-d9f5e01d-9e79-4bbd-8a7d-c7ade86dbeb3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a153903e3a24502b004aa8be7ce4925', 'request_id': 'req-d9f5e01d-9e79-4bbd-8a7d-c7ade86dbeb3'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:47:48.807044 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-d9f5e01d-9e79-4bbd-8a7d-c7ade86dbeb3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a153903e3a24502b004aa8be7ce4925', 'request_id': 'req-d9f5e01d-9e79-4bbd-8a7d-c7ade86dbeb3'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:47:48.829167 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-d9f5e01d-9e79-4bbd-8a7d-c7ade86dbeb3 admin admin] The token cache is being invalidate because project 0a153903e3a24502b004aa8be7ce4925 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80475) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 14:47:48.830320 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-d9f5e01d-9e79-4bbd-8a7d-c7ade86dbeb3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:47:48.831628 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-d9f5e01d-9e79-4bbd-8a7d-c7ade86dbeb3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:47:48.838149 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1257/2497] 10.222.0.67 () {58 vars in 1232 bytes} [Wed May 25 14:47:48 2022] DELETE /identity/v3/projects/0a153903e3a24502b004aa8be7ce4925 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:47:48.840728 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88171792-8e20-4d3b-b80f-533dc485b767 None None] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:47:48.843092 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88171792-8e20-4d3b-b80f-533dc485b767 None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:47:48.843092 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88171792-8e20-4d3b-b80f-533dc485b767 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:47:48.869405 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.auth.core [None req-88171792-8e20-4d3b-b80f-533dc485b767 None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:47:48.870675 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-88171792-8e20-4d3b-b80f-533dc485b767 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:47:48.975466 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1241/2498] 10.222.0.67 () {58 vars in 957 bytes} [Wed May 25 14:47:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:47:48.984180 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba70db3-507c-46e5-9310-4f085a6c1829 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:47:48.984834 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba70db3-507c-46e5-9310-4f085a6c1829 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:47:48.985361 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba70db3-507c-46e5-9310-4f085a6c1829 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:47:49.019559 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-bba70db3-507c-46e5-9310-4f085a6c1829 None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:47:49.024438 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-bba70db3-507c-46e5-9310-4f085a6c1829 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:47:49.042596 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1258/2499] 10.222.0.67 () {58 vars in 957 bytes} [Wed May 25 14:47:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:47:49.046802 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88171792-8e20-4d3b-b80f-533dc485b767 None None] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:47:49.057022 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88171792-8e20-4d3b-b80f-533dc485b767 None None] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:47:49.063147 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c5469b-c864-42c0-9a42-17f923f92048 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:47:49.063841 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c5469b-c864-42c0-9a42-17f923f92048 admin admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:47:49.064133 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c5469b-c864-42c0-9a42-17f923f92048 admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:47:49.064416 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c5469b-c864-42c0-9a42-17f923f92048 admin admin] PATH_INFO: `/v3/domains` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:47:49.065378 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c5469b-c864-42c0-9a42-17f923f92048 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:47:49.065701 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c5469b-c864-42c0-9a42-17f923f92048 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:47:49.068558 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c5469b-c864-42c0-9a42-17f923f92048 admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:47:49.083246 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1242/2500] 10.222.0.67 () {58 vars in 1152 bytes} [Wed May 25 14:47:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:47:49.087761 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba70db3-507c-46e5-9310-4f085a6c1829 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:47:49.099643 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba70db3-507c-46e5-9310-4f085a6c1829 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:47:49.106242 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9091657e-fbb8-4f2f-9725-53e2c4015323 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:47:49.106951 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9091657e-fbb8-4f2f-9725-53e2c4015323 admin admin] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:47:49.107300 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9091657e-fbb8-4f2f-9725-53e2c4015323 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:47:49.107586 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9091657e-fbb8-4f2f-9725-53e2c4015323 admin admin] PATH_INFO: `/v3/projects` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:47:49.108302 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9091657e-fbb8-4f2f-9725-53e2c4015323 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:47:49.110248 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9091657e-fbb8-4f2f-9725-53e2c4015323 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:47:49.155739 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1259/2501] 10.222.0.67 () {60 vars in 1152 bytes} [Wed May 25 14:47:49 2022] POST /identity/v3/projects => generated 389 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:47:49.160925 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c5469b-c864-42c0-9a42-17f923f92048 admin admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:47:49.175018 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c5469b-c864-42c0-9a42-17f923f92048 admin admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:47:49.296650 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6866b9ec-420a-4665-bfce-ada9db4fc6c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:47:49.298018 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6866b9ec-420a-4665-bfce-ada9db4fc6c0 admin admin] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:47:49.298469 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6866b9ec-420a-4665-bfce-ada9db4fc6c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:47:49.298906 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6866b9ec-420a-4665-bfce-ada9db4fc6c0 admin admin] PATH_INFO: `/v3/users` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:47:49.300588 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6866b9ec-420a-4665-bfce-ada9db4fc6c0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:47:49.302914 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6866b9ec-420a-4665-bfce-ada9db4fc6c0 admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:47:49.350050 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9091657e-fbb8-4f2f-9725-53e2c4015323 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:47:49.352773 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-9091657e-fbb8-4f2f-9725-53e2c4015323 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:47:49.356139 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1243/2502] 10.222.0.67 () {60 vars in 1143 bytes} [Wed May 25 14:47:49 2022] POST /identity/v3/users => generated 295 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:47:49.357087 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6866b9ec-420a-4665-bfce-ada9db4fc6c0 admin admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:47:49.371689 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6866b9ec-420a-4665-bfce-ada9db4fc6c0 admin admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:47:49.379960 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3722989b-a17e-4cff-a87e-6b01b08e0715 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:47:49.381196 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3722989b-a17e-4cff-a87e-6b01b08e0715 admin admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:47:49.381371 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3722989b-a17e-4cff-a87e-6b01b08e0715 admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:47:49.381662 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3722989b-a17e-4cff-a87e-6b01b08e0715 admin admin] PATH_INFO: `/v3/roles` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:47:49.383373 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3722989b-a17e-4cff-a87e-6b01b08e0715 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:47:49.386472 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3722989b-a17e-4cff-a87e-6b01b08e0715 admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:47:49.408241 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1244/2503] 10.222.0.67 () {58 vars in 1121 bytes} [Wed May 25 14:47:49 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:47:49.410216 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3722989b-a17e-4cff-a87e-6b01b08e0715 admin admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:47:49.426521 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3722989b-a17e-4cff-a87e-6b01b08e0715 admin admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:47:49.432913 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f22359-60b8-47ea-88d3-e8d4c5ab9535 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:47:49.433673 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f22359-60b8-47ea-88d3-e8d4c5ab9535 admin admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:47:49.433970 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f22359-60b8-47ea-88d3-e8d4c5ab9535 admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:47:49.434276 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f22359-60b8-47ea-88d3-e8d4c5ab9535 admin admin] PATH_INFO: `/v3/roles` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:47:49.435019 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f22359-60b8-47ea-88d3-e8d4c5ab9535 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:47:49.436650 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f22359-60b8-47ea-88d3-e8d4c5ab9535 admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:47:49.457758 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1245/2504] 10.222.0.67 () {58 vars in 1121 bytes} [Wed May 25 14:47:49 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:47:49.458880 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f22359-60b8-47ea-88d3-e8d4c5ab9535 admin admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:47:49.470253 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f22359-60b8-47ea-88d3-e8d4c5ab9535 admin admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:47:49.477845 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958a7829-ea20-4c18-a675-06e56d48e4ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:47:49.478973 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958a7829-ea20-4c18-a675-06e56d48e4ea admin admin] REQUEST_METHOD: `PUT` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:47:49.479315 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958a7829-ea20-4c18-a675-06e56d48e4ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:47:49.479599 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958a7829-ea20-4c18-a675-06e56d48e4ea admin admin] PATH_INFO: `/v3/projects/1d3684942f934cc891b06128982fbf99/users/be2e13982c5d482394e782683680724d/roles/48808901834b4d5eab2c7e6b5b03791e` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:47:49.486437 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9091657e-fbb8-4f2f-9725-53e2c4015323 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:47:49.491281 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6f65ae-36a6-49a3-85c0-010509e1346e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b68eed985c7b49839bcdd173186ad4ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfe93ee8d32a441295efc0b885de4bd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:47:49.492401 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6f65ae-36a6-49a3-85c0-010509e1346e service neutron] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:47:49.493119 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6f65ae-36a6-49a3-85c0-010509e1346e service neutron] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:47:49.493620 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6f65ae-36a6-49a3-85c0-010509e1346e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:47:49.509539 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958a7829-ea20-4c18-a675-06e56d48e4ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d3684942f934cc891b06128982fbf99, user_id=be2e13982c5d482394e782683680724d, role_id=48808901834b4d5eab2c7e6b5b03791e)` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:47:49.510237 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-fb6f65ae-36a6-49a3-85c0-010509e1346e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:47:49.512752 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958a7829-ea20-4c18-a675-06e56d48e4ea admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:47:49.543614 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1246/2505] 10.222.0.67 () {60 vars in 1482 bytes} [Wed May 25 14:47:49 2022] PUT /identity/v3/projects/1d3684942f934cc891b06128982fbf99/users/be2e13982c5d482394e782683680724d/roles/48808901834b4d5eab2c7e6b5b03791e => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:47:49.549806 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a53aade-29b3-4385-8b73-7aeee78732f3 None None] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:47:49.550124 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a53aade-29b3-4385-8b73-7aeee78732f3 None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:47:49.550581 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a53aade-29b3-4385-8b73-7aeee78732f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:47:49.558459 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=93,keystone:DELETE=2,keystone:INSERT=5 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:47:49.606689 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.auth.core [None req-0a53aade-29b3-4385-8b73-7aeee78732f3 None None] MFA Rules not processed for user `be2e13982c5d482394e782683680724d`. Rule list: `[]` (Enabled: `True`). {{(pid=80474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:47:49.608098 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-0a53aade-29b3-4385-8b73-7aeee78732f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:47:49.665105 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6f65ae-36a6-49a3-85c0-010509e1346e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:47:49.666689 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6f65ae-36a6-49a3-85c0-010509e1346e service neutron] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:47:49.677701 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1260/2506] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 14:47:49 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:47:49.732993 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1247/2507] 10.222.0.67 () {58 vars in 957 bytes} [Wed May 25 14:47:49 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:47:49.737093 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6f65ae-36a6-49a3-85c0-010509e1346e service neutron] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:47:49.749715 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6f65ae-36a6-49a3-85c0-010509e1346e service neutron] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:47:49.831399 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a3ec4a-3641-4045-83b8-50aa860d5fd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:47:49.832351 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a3ec4a-3641-4045-83b8-50aa860d5fd1 admin admin] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:47:49.832733 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a3ec4a-3641-4045-83b8-50aa860d5fd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:47:49.833190 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a3ec4a-3641-4045-83b8-50aa860d5fd1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:47:49.833917 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a3ec4a-3641-4045-83b8-50aa860d5fd1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:47:49.836671 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a3ec4a-3641-4045-83b8-50aa860d5fd1 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:47:49.853200 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:DELETE=1 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:47:49.879114 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1261/2508] 10.222.0.67 () {60 vars in 1152 bytes} [Wed May 25 14:47:49 2022] POST /identity/v3/projects => generated 387 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:47:49.882283 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a53aade-29b3-4385-8b73-7aeee78732f3 None None] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:47:49.904643 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a53aade-29b3-4385-8b73-7aeee78732f3 None None] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:47:49.994910 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2393cf-70fc-444d-ad0d-04b74315dad0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:47:49.995812 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2393cf-70fc-444d-ad0d-04b74315dad0 admin admin] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:47:49.996223 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2393cf-70fc-444d-ad0d-04b74315dad0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:47:49.996513 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2393cf-70fc-444d-ad0d-04b74315dad0 admin admin] PATH_INFO: `/v3/users` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:47:49.997449 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2393cf-70fc-444d-ad0d-04b74315dad0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:47:49.999564 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2393cf-70fc-444d-ad0d-04b74315dad0 admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:47:50.025977 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1248/2509] 10.222.0.67 () {60 vars in 1143 bytes} [Wed May 25 14:47:49 2022] POST /identity/v3/users => generated 300 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:47:50.031107 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a3ec4a-3641-4045-83b8-50aa860d5fd1 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:47:50.045477 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a3ec4a-3641-4045-83b8-50aa860d5fd1 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:47:50.053162 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca22ce06-4e5e-430b-8f92-2980677a89ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:47:50.054250 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca22ce06-4e5e-430b-8f92-2980677a89ae admin admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:47:50.054546 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca22ce06-4e5e-430b-8f92-2980677a89ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:47:50.054832 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca22ce06-4e5e-430b-8f92-2980677a89ae admin admin] PATH_INFO: `/v3/roles` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:47:50.056401 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca22ce06-4e5e-430b-8f92-2980677a89ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:47:50.058375 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca22ce06-4e5e-430b-8f92-2980677a89ae admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:47:50.078275 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1262/2510] 10.222.0.67 () {58 vars in 1121 bytes} [Wed May 25 14:47:50 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:47:50.079681 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2393cf-70fc-444d-ad0d-04b74315dad0 admin admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:47:50.095347 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2393cf-70fc-444d-ad0d-04b74315dad0 admin admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:47:50.100802 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506b707d-b5eb-40e8-9352-8f734040cf07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:47:50.101855 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506b707d-b5eb-40e8-9352-8f734040cf07 admin admin] REQUEST_METHOD: `PUT` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:47:50.102148 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506b707d-b5eb-40e8-9352-8f734040cf07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:47:50.102432 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506b707d-b5eb-40e8-9352-8f734040cf07 admin admin] PATH_INFO: `/v3/projects/6e9d939f1096429780582510a8c773b8/users/75675d40abd049dfb6bf18343a22ca71/roles/399893e19eac4ab5a8e596f7c07be13c` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:47:50.119396 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506b707d-b5eb-40e8-9352-8f734040cf07 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e9d939f1096429780582510a8c773b8, user_id=75675d40abd049dfb6bf18343a22ca71, role_id=399893e19eac4ab5a8e596f7c07be13c)` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:47:50.122293 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506b707d-b5eb-40e8-9352-8f734040cf07 admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:47:50.138295 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1249/2511] 10.222.0.67 () {60 vars in 1482 bytes} [Wed May 25 14:47:50 2022] PUT /identity/v3/projects/6e9d939f1096429780582510a8c773b8/users/75675d40abd049dfb6bf18343a22ca71/roles/399893e19eac4ab5a8e596f7c07be13c => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:47:50.142256 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca22ce06-4e5e-430b-8f92-2980677a89ae admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:47:50.156090 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca22ce06-4e5e-430b-8f92-2980677a89ae admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:47:50.245693 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48203182-9989-4bbd-90af-be58c477ab12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:47:50.246758 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48203182-9989-4bbd-90af-be58c477ab12 admin admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:47:50.247082 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48203182-9989-4bbd-90af-be58c477ab12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:47:50.247364 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48203182-9989-4bbd-90af-be58c477ab12 admin admin] PATH_INFO: `/v3/roles` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:47:50.248699 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48203182-9989-4bbd-90af-be58c477ab12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:47:50.250317 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48203182-9989-4bbd-90af-be58c477ab12 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:47:50.262797 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1263/2512] 10.222.0.67 () {58 vars in 1121 bytes} [Wed May 25 14:47:50 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 25 14:47:50.266919 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506b707d-b5eb-40e8-9352-8f734040cf07 admin admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:47:50.279614 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506b707d-b5eb-40e8-9352-8f734040cf07 admin admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:47:50.284801 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ad4637-2076-4dbf-bfe8-c78e0e809fe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:47:50.286030 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ad4637-2076-4dbf-bfe8-c78e0e809fe8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:47:50.286602 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ad4637-2076-4dbf-bfe8-c78e0e809fe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:47:50.287014 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ad4637-2076-4dbf-bfe8-c78e0e809fe8 admin admin] PATH_INFO: `/v3/projects/6e9d939f1096429780582510a8c773b8/users/75675d40abd049dfb6bf18343a22ca71/roles/399893e19eac4ab5a8e596f7c07be13c` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:47:50.289260 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ad4637-2076-4dbf-bfe8-c78e0e809fe8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e9d939f1096429780582510a8c773b8, user_id=75675d40abd049dfb6bf18343a22ca71, role_id=399893e19eac4ab5a8e596f7c07be13c)` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:47:50.292115 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ad4637-2076-4dbf-bfe8-c78e0e809fe8 admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:47:50.307974 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1250/2513] 10.222.0.67 () {60 vars in 1482 bytes} [Wed May 25 14:47:50 2022] PUT /identity/v3/projects/6e9d939f1096429780582510a8c773b8/users/75675d40abd049dfb6bf18343a22ca71/roles/399893e19eac4ab5a8e596f7c07be13c => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 14:47:50.319353 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2e2b23-10f4-48a7-9897-8e6594f1007d None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:47:50.319744 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2e2b23-10f4-48a7-9897-8e6594f1007d None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:47:50.320136 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2e2b23-10f4-48a7-9897-8e6594f1007d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:47:50.372638 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-df2e2b23-10f4-48a7-9897-8e6594f1007d None None] MFA Rules not processed for user `75675d40abd049dfb6bf18343a22ca71`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:47:50.375329 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-df2e2b23-10f4-48a7-9897-8e6594f1007d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:47:50.510113 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1264/2514] 10.222.0.67 () {58 vars in 957 bytes} [Wed May 25 14:47:50 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:47:50.522635 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ad4637-2076-4dbf-bfe8-c78e0e809fe8 admin admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:47:50.523964 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-37ad4637-2076-4dbf-bfe8-c78e0e809fe8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:47:50.587402 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:47:50.603040 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ad4637-2076-4dbf-bfe8-c78e0e809fe8 admin admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:47:50.607798 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78732f1c-249b-47ba-bdc8-8b3ab191e5e5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e462acc9da84a61bb23998dd54e1858', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfe93ee8d32a441295efc0b885de4bd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:47:50.608733 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78732f1c-249b-47ba-bdc8-8b3ab191e5e5 service cinder] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:47:50.609084 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78732f1c-249b-47ba-bdc8-8b3ab191e5e5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:47:50.609426 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78732f1c-249b-47ba-bdc8-8b3ab191e5e5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:47:50.622341 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78732f1c-249b-47ba-bdc8-8b3ab191e5e5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:47:50.624122 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78732f1c-249b-47ba-bdc8-8b3ab191e5e5 service cinder] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:47:50.636501 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1251/2515] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 14:47:50 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:47:50.831142 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2e2b23-10f4-48a7-9897-8e6594f1007d None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:47:50.928717 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2e2b23-10f4-48a7-9897-8e6594f1007d None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:47:50.933559 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca978a2-9220-4e4e-a8f2-2d367c175a9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:47:50.934683 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca978a2-9220-4e4e-a8f2-2d367c175a9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:47:50.934970 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca978a2-9220-4e4e-a8f2-2d367c175a9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:47:50.935279 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca978a2-9220-4e4e-a8f2-2d367c175a9c admin admin] PATH_INFO: `/v3/users/be2e13982c5d482394e782683680724d` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:47:50.936627 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca978a2-9220-4e4e-a8f2-2d367c175a9c admin admin] RBAC: Authorizing `identity:delete_user(user_id=be2e13982c5d482394e782683680724d)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:47:50.938651 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca978a2-9220-4e4e-a8f2-2d367c175a9c admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:47:50.942138 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:47:51.031787 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-6ca978a2-9220-4e4e-a8f2-2d367c175a9c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'be2e13982c5d482394e782683680724d'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:47:51.049704 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-6ca978a2-9220-4e4e-a8f2-2d367c175a9c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'be2e13982c5d482394e782683680724d'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:47:51.050542 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-6ca978a2-9220-4e4e-a8f2-2d367c175a9c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'be2e13982c5d482394e782683680724d'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:47:51.060320 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-6ca978a2-9220-4e4e-a8f2-2d367c175a9c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'be2e13982c5d482394e782683680724d'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:47:51.076331 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-6ca978a2-9220-4e4e-a8f2-2d367c175a9c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'be2e13982c5d482394e782683680724d'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:47:51.083700 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1265/2516] 10.222.0.67 () {58 vars in 1223 bytes} [Wed May 25 14:47:50 2022] DELETE /identity/v3/users/be2e13982c5d482394e782683680724d => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:47:51.088133 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d910df-e28a-4f2a-b016-f10da2d83368 None None] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:47:51.088709 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d910df-e28a-4f2a-b016-f10da2d83368 None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:47:51.088709 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d910df-e28a-4f2a-b016-f10da2d83368 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:47:51.109380 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.auth.core [None req-d0d910df-e28a-4f2a-b016-f10da2d83368 None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:47:51.110580 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-d0d910df-e28a-4f2a-b016-f10da2d83368 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:47:51.212882 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1252/2517] 10.222.0.67 () {58 vars in 957 bytes} [Wed May 25 14:47:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:47:51.223750 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca978a2-9220-4e4e-a8f2-2d367c175a9c admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:47:51.225279 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-6ca978a2-9220-4e4e-a8f2-2d367c175a9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:47:51.291918 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca978a2-9220-4e4e-a8f2-2d367c175a9c admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:47:51.296625 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248f9d2d-b19d-422d-ae5a-e444fb862b93 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b68eed985c7b49839bcdd173186ad4ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfe93ee8d32a441295efc0b885de4bd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:47:51.297511 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248f9d2d-b19d-422d-ae5a-e444fb862b93 service neutron] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:47:51.297802 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248f9d2d-b19d-422d-ae5a-e444fb862b93 service neutron] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:47:51.298395 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248f9d2d-b19d-422d-ae5a-e444fb862b93 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:47:51.309115 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248f9d2d-b19d-422d-ae5a-e444fb862b93 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:47:51.310608 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248f9d2d-b19d-422d-ae5a-e444fb862b93 service neutron] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:47:51.321631 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1266/2518] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 14:47:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:47:51.796636 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d910df-e28a-4f2a-b016-f10da2d83368 None None] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:47:51.798149 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-d0d910df-e28a-4f2a-b016-f10da2d83368 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:47:51.817797 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d910df-e28a-4f2a-b016-f10da2d83368 None None] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:47:51.825532 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ce121e-2589-4b70-a059-2caf2147c022 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:47:51.826684 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ce121e-2589-4b70-a059-2caf2147c022 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:47:51.826979 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ce121e-2589-4b70-a059-2caf2147c022 admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:47:51.827471 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ce121e-2589-4b70-a059-2caf2147c022 admin admin] PATH_INFO: `/v3/projects/1d3684942f934cc891b06128982fbf99` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:47:51.828652 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ce121e-2589-4b70-a059-2caf2147c022 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1d3684942f934cc891b06128982fbf99)` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:47:51.830540 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ce121e-2589-4b70-a059-2caf2147c022 admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:47:51.906515 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-53ce121e-2589-4b70-a059-2caf2147c022 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1d3684942f934cc891b06128982fbf99', 'request_id': 'req-53ce121e-2589-4b70-a059-2caf2147c022'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:47:51.922488 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-53ce121e-2589-4b70-a059-2caf2147c022 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1d3684942f934cc891b06128982fbf99', 'request_id': 'req-53ce121e-2589-4b70-a059-2caf2147c022'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:47:51.931467 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-53ce121e-2589-4b70-a059-2caf2147c022 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1d3684942f934cc891b06128982fbf99', 'request_id': 'req-53ce121e-2589-4b70-a059-2caf2147c022'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:47:51.945919 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-53ce121e-2589-4b70-a059-2caf2147c022 admin admin] The token cache is being invalidate because project 1d3684942f934cc891b06128982fbf99 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80474) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 14:47:51.946290 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-53ce121e-2589-4b70-a059-2caf2147c022 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:47:51.946916 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-53ce121e-2589-4b70-a059-2caf2147c022 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:47:51.949814 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1253/2519] 10.222.0.67 () {58 vars in 1232 bytes} [Wed May 25 14:47:51 2022] DELETE /identity/v3/projects/1d3684942f934cc891b06128982fbf99 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:47:51.953702 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248f9d2d-b19d-422d-ae5a-e444fb862b93 service neutron] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:47:51.964486 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248f9d2d-b19d-422d-ae5a-e444fb862b93 service neutron] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:47:52.051879 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c514a277-6fcb-4332-a15b-1eec4a4e2357 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:47:52.053146 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c514a277-6fcb-4332-a15b-1eec4a4e2357 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:47:52.054668 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c514a277-6fcb-4332-a15b-1eec4a4e2357 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:47:52.055196 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c514a277-6fcb-4332-a15b-1eec4a4e2357 admin admin] PATH_INFO: `/v3/users/75675d40abd049dfb6bf18343a22ca71` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:47:52.056945 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c514a277-6fcb-4332-a15b-1eec4a4e2357 admin admin] RBAC: Authorizing `identity:delete_user(user_id=75675d40abd049dfb6bf18343a22ca71)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:47:52.060958 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c514a277-6fcb-4332-a15b-1eec4a4e2357 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:47:52.102043 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:47:52.175800 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-c514a277-6fcb-4332-a15b-1eec4a4e2357 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '75675d40abd049dfb6bf18343a22ca71'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:47:52.200864 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-c514a277-6fcb-4332-a15b-1eec4a4e2357 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '75675d40abd049dfb6bf18343a22ca71'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:47:52.201542 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-c514a277-6fcb-4332-a15b-1eec4a4e2357 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '75675d40abd049dfb6bf18343a22ca71'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:47:52.218563 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-c514a277-6fcb-4332-a15b-1eec4a4e2357 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '75675d40abd049dfb6bf18343a22ca71'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:47:52.243626 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-c514a277-6fcb-4332-a15b-1eec4a4e2357 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '75675d40abd049dfb6bf18343a22ca71'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:47:52.263195 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1267/2520] 10.222.0.67 () {58 vars in 1223 bytes} [Wed May 25 14:47:51 2022] DELETE /identity/v3/users/75675d40abd049dfb6bf18343a22ca71 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:47:52.654568 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ce121e-2589-4b70-a059-2caf2147c022 admin admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:47:52.656789 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-53ce121e-2589-4b70-a059-2caf2147c022 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:47:52.705208 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ce121e-2589-4b70-a059-2caf2147c022 admin admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:47:52.801820 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7cd158-5572-460f-a8d8-d19f435be905 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:47:52.802813 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7cd158-5572-460f-a8d8-d19f435be905 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:47:52.803176 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7cd158-5572-460f-a8d8-d19f435be905 admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:47:52.803464 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7cd158-5572-460f-a8d8-d19f435be905 admin admin] PATH_INFO: `/v3/projects/6e9d939f1096429780582510a8c773b8` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:47:52.804783 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7cd158-5572-460f-a8d8-d19f435be905 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6e9d939f1096429780582510a8c773b8)` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:47:52.806813 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7cd158-5572-460f-a8d8-d19f435be905 admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:47:52.831079 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:47:52.891930 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-fa7cd158-5572-460f-a8d8-d19f435be905 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6e9d939f1096429780582510a8c773b8', 'request_id': 'req-fa7cd158-5572-460f-a8d8-d19f435be905'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:47:52.901949 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-fa7cd158-5572-460f-a8d8-d19f435be905 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6e9d939f1096429780582510a8c773b8', 'request_id': 'req-fa7cd158-5572-460f-a8d8-d19f435be905'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:47:52.910612 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-fa7cd158-5572-460f-a8d8-d19f435be905 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6e9d939f1096429780582510a8c773b8', 'request_id': 'req-fa7cd158-5572-460f-a8d8-d19f435be905'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:47:52.925151 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-fa7cd158-5572-460f-a8d8-d19f435be905 admin admin] The token cache is being invalidate because project 6e9d939f1096429780582510a8c773b8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80474) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 14:47:52.925471 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-fa7cd158-5572-460f-a8d8-d19f435be905 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:47:52.926284 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-fa7cd158-5572-460f-a8d8-d19f435be905 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:47:52.931326 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1254/2521] 10.222.0.67 () {58 vars in 1232 bytes} [Wed May 25 14:47:52 2022] DELETE /identity/v3/projects/6e9d939f1096429780582510a8c773b8 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:47:52.933280 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d94afda-7ef4-4dac-b704-c4f646dcfb99 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:47:52.934346 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d94afda-7ef4-4dac-b704-c4f646dcfb99 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:47:52.935607 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d94afda-7ef4-4dac-b704-c4f646dcfb99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:47:52.960845 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-4d94afda-7ef4-4dac-b704-c4f646dcfb99 None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:47:52.961984 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-4d94afda-7ef4-4dac-b704-c4f646dcfb99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:47:53.043082 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1268/2522] 10.222.0.67 () {58 vars in 957 bytes} [Wed May 25 14:47:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 14:47:53.052186 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35eb212d-3e22-4885-9afe-a8a9b2ce849f None None] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:47:53.053095 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35eb212d-3e22-4885-9afe-a8a9b2ce849f None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:47:53.053095 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35eb212d-3e22-4885-9afe-a8a9b2ce849f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:47:53.076636 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.auth.core [None req-35eb212d-3e22-4885-9afe-a8a9b2ce849f None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:47:53.077880 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-35eb212d-3e22-4885-9afe-a8a9b2ce849f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:47:53.091039 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1255/2523] 10.222.0.67 () {58 vars in 957 bytes} [Wed May 25 14:47:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:47:53.092030 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d94afda-7ef4-4dac-b704-c4f646dcfb99 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:47:53.108840 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d94afda-7ef4-4dac-b704-c4f646dcfb99 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:47:53.113800 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8386b3cd-eef1-421a-ab6d-408557658b25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:47:53.114669 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8386b3cd-eef1-421a-ab6d-408557658b25 admin admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:47:53.114965 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8386b3cd-eef1-421a-ab6d-408557658b25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:47:53.115504 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8386b3cd-eef1-421a-ab6d-408557658b25 admin admin] PATH_INFO: `/v3/domains` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:47:53.116889 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8386b3cd-eef1-421a-ab6d-408557658b25 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:47:53.117455 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8386b3cd-eef1-421a-ab6d-408557658b25 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:47:53.119800 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8386b3cd-eef1-421a-ab6d-408557658b25 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:47:53.151023 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1269/2524] 10.222.0.67 () {58 vars in 1152 bytes} [Wed May 25 14:47:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:47:53.156318 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35eb212d-3e22-4885-9afe-a8a9b2ce849f None None] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:47:53.166938 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35eb212d-3e22-4885-9afe-a8a9b2ce849f None None] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:47:53.172517 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39f50d9-53f1-4dec-83fc-6804460fab8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:47:53.173204 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39f50d9-53f1-4dec-83fc-6804460fab8c admin admin] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:47:53.173492 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39f50d9-53f1-4dec-83fc-6804460fab8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:47:53.173799 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39f50d9-53f1-4dec-83fc-6804460fab8c admin admin] PATH_INFO: `/v3/projects` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:47:53.174544 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39f50d9-53f1-4dec-83fc-6804460fab8c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:47:53.176531 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39f50d9-53f1-4dec-83fc-6804460fab8c admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:47:53.222790 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1256/2525] 10.222.0.67 () {60 vars in 1152 bytes} [Wed May 25 14:47:53 2022] POST /identity/v3/projects => generated 371 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:47:53.227069 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8386b3cd-eef1-421a-ab6d-408557658b25 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:47:53.240316 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8386b3cd-eef1-421a-ab6d-408557658b25 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:47:53.341754 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5794c7b7-8c8f-47a3-b0b0-15d435146250 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:47:53.342440 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5794c7b7-8c8f-47a3-b0b0-15d435146250 admin admin] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:47:53.342723 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5794c7b7-8c8f-47a3-b0b0-15d435146250 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:47:53.343030 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5794c7b7-8c8f-47a3-b0b0-15d435146250 admin admin] PATH_INFO: `/v3/users` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:47:53.344202 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5794c7b7-8c8f-47a3-b0b0-15d435146250 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:47:53.345682 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5794c7b7-8c8f-47a3-b0b0-15d435146250 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:47:53.381380 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1270/2526] 10.222.0.67 () {60 vars in 1143 bytes} [Wed May 25 14:47:53 2022] POST /identity/v3/users => generated 286 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:47:53.385715 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39f50d9-53f1-4dec-83fc-6804460fab8c admin admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:47:53.403691 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39f50d9-53f1-4dec-83fc-6804460fab8c admin admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:47:53.409500 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41158e9-50ba-400b-bcbe-9be2d8203cd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:47:53.410600 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41158e9-50ba-400b-bcbe-9be2d8203cd3 admin admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:47:53.411056 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41158e9-50ba-400b-bcbe-9be2d8203cd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:47:53.411056 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41158e9-50ba-400b-bcbe-9be2d8203cd3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:47:53.412028 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41158e9-50ba-400b-bcbe-9be2d8203cd3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:47:53.414349 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41158e9-50ba-400b-bcbe-9be2d8203cd3 admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:47:53.430442 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1257/2527] 10.222.0.67 () {58 vars in 1121 bytes} [Wed May 25 14:47:53 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:47:53.434793 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5794c7b7-8c8f-47a3-b0b0-15d435146250 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:47:53.445338 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5794c7b7-8c8f-47a3-b0b0-15d435146250 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:47:53.450576 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c138efd-4461-481e-b44d-41897a9060cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:47:53.451295 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c138efd-4461-481e-b44d-41897a9060cd admin admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:47:53.451577 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c138efd-4461-481e-b44d-41897a9060cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:47:53.451852 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c138efd-4461-481e-b44d-41897a9060cd admin admin] PATH_INFO: `/v3/roles` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:47:53.452952 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c138efd-4461-481e-b44d-41897a9060cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:47:53.454790 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c138efd-4461-481e-b44d-41897a9060cd admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:47:53.471156 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1271/2528] 10.222.0.67 () {58 vars in 1121 bytes} [Wed May 25 14:47:53 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 25 14:47:53.473969 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41158e9-50ba-400b-bcbe-9be2d8203cd3 admin admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:47:53.486274 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41158e9-50ba-400b-bcbe-9be2d8203cd3 admin admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:47:53.491109 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d42d47-38f1-441b-a34f-2b8c60773dac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:47:53.492021 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d42d47-38f1-441b-a34f-2b8c60773dac admin admin] REQUEST_METHOD: `PUT` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:47:53.492312 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d42d47-38f1-441b-a34f-2b8c60773dac admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:47:53.492592 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d42d47-38f1-441b-a34f-2b8c60773dac admin admin] PATH_INFO: `/v3/projects/a02f11b5adb64a7a9da72f8253e939ff/users/9db145d682684c65bd59668d98b8347d/roles/48808901834b4d5eab2c7e6b5b03791e` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:47:53.515323 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d42d47-38f1-441b-a34f-2b8c60773dac admin admin] RBAC: Authorizing `identity:create_grant(project_id=a02f11b5adb64a7a9da72f8253e939ff, user_id=9db145d682684c65bd59668d98b8347d, role_id=48808901834b4d5eab2c7e6b5b03791e)` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:47:53.518066 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d42d47-38f1-441b-a34f-2b8c60773dac admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:47:53.534420 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1258/2529] 10.222.0.67 () {60 vars in 1482 bytes} [Wed May 25 14:47:53 2022] PUT /identity/v3/projects/a02f11b5adb64a7a9da72f8253e939ff/users/9db145d682684c65bd59668d98b8347d/roles/48808901834b4d5eab2c7e6b5b03791e => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:47:53.546453 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40e1b24-ddf8-4d0b-9dc1-444999fb545a None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:47:53.546742 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40e1b24-ddf8-4d0b-9dc1-444999fb545a None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:47:53.547049 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40e1b24-ddf8-4d0b-9dc1-444999fb545a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:47:53.567503 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:47:53.578882 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-c40e1b24-ddf8-4d0b-9dc1-444999fb545a None None] MFA Rules not processed for user `9db145d682684c65bd59668d98b8347d`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:47:53.580795 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-c40e1b24-ddf8-4d0b-9dc1-444999fb545a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:47:53.656492 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1272/2530] 10.222.0.67 () {58 vars in 957 bytes} [Wed May 25 14:47:53 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:47:53.670103 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d42d47-38f1-441b-a34f-2b8c60773dac admin admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:47:53.672226 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-f6d42d47-38f1-441b-a34f-2b8c60773dac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:47:53.742614 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d42d47-38f1-441b-a34f-2b8c60773dac admin admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:47:53.746806 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e5d365-664c-4892-8c14-eb8ba4cab50a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e462acc9da84a61bb23998dd54e1858', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfe93ee8d32a441295efc0b885de4bd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:47:53.747511 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e5d365-664c-4892-8c14-eb8ba4cab50a service cinder] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:47:53.748307 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e5d365-664c-4892-8c14-eb8ba4cab50a service cinder] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:47:53.748587 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e5d365-664c-4892-8c14-eb8ba4cab50a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:47:53.757536 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e5d365-664c-4892-8c14-eb8ba4cab50a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:47:53.758953 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e5d365-664c-4892-8c14-eb8ba4cab50a service cinder] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:47:53.769169 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1259/2531] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 14:47:53 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:47:53.789941 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40e1b24-ddf8-4d0b-9dc1-444999fb545a None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:47:53.864980 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40e1b24-ddf8-4d0b-9dc1-444999fb545a None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:47:53.869677 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c3a2e2-0906-4080-8d26-b7cc617b4c3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:47:53.870613 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c3a2e2-0906-4080-8d26-b7cc617b4c3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:47:53.870947 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c3a2e2-0906-4080-8d26-b7cc617b4c3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:47:53.871249 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c3a2e2-0906-4080-8d26-b7cc617b4c3b admin admin] PATH_INFO: `/v3/users/9db145d682684c65bd59668d98b8347d` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:47:53.872500 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c3a2e2-0906-4080-8d26-b7cc617b4c3b admin admin] RBAC: Authorizing `identity:delete_user(user_id=9db145d682684c65bd59668d98b8347d)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:47:53.874455 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c3a2e2-0906-4080-8d26-b7cc617b4c3b admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:47:53.926596 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-85c3a2e2-0906-4080-8d26-b7cc617b4c3b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9db145d682684c65bd59668d98b8347d'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:47:53.935909 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-85c3a2e2-0906-4080-8d26-b7cc617b4c3b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9db145d682684c65bd59668d98b8347d'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:47:53.936540 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-85c3a2e2-0906-4080-8d26-b7cc617b4c3b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9db145d682684c65bd59668d98b8347d'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:47:53.946138 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-85c3a2e2-0906-4080-8d26-b7cc617b4c3b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9db145d682684c65bd59668d98b8347d'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:47:53.960215 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-85c3a2e2-0906-4080-8d26-b7cc617b4c3b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9db145d682684c65bd59668d98b8347d'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:47:53.968602 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1273/2532] 10.222.0.67 () {58 vars in 1223 bytes} [Wed May 25 14:47:53 2022] DELETE /identity/v3/users/9db145d682684c65bd59668d98b8347d => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:47:53.974279 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84f8700-cb23-41e3-97b6-acaf2621e8a0 None None] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:47:53.974598 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84f8700-cb23-41e3-97b6-acaf2621e8a0 None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:47:53.974887 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84f8700-cb23-41e3-97b6-acaf2621e8a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:47:53.995713 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.auth.core [None req-f84f8700-cb23-41e3-97b6-acaf2621e8a0 None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:47:53.996881 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-f84f8700-cb23-41e3-97b6-acaf2621e8a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:47:54.040083 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:47:54.073065 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1260/2533] 10.222.0.67 () {58 vars in 957 bytes} [Wed May 25 14:47:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:47:54.083188 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c3a2e2-0906-4080-8d26-b7cc617b4c3b admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:47:54.085160 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-85c3a2e2-0906-4080-8d26-b7cc617b4c3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:47:54.108679 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:47:54.165516 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c3a2e2-0906-4080-8d26-b7cc617b4c3b admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:47:54.170373 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f9fda1-b60f-4281-87ef-85584a96e188 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b68eed985c7b49839bcdd173186ad4ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfe93ee8d32a441295efc0b885de4bd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:47:54.171130 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f9fda1-b60f-4281-87ef-85584a96e188 service neutron] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:47:54.171416 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f9fda1-b60f-4281-87ef-85584a96e188 service neutron] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:47:54.171718 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f9fda1-b60f-4281-87ef-85584a96e188 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:47:54.182107 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f9fda1-b60f-4281-87ef-85584a96e188 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:47:54.183717 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f9fda1-b60f-4281-87ef-85584a96e188 service neutron] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:47:54.196904 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1274/2534] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 14:47:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:47:54.501240 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84f8700-cb23-41e3-97b6-acaf2621e8a0 None None] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:47:54.502718 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-f84f8700-cb23-41e3-97b6-acaf2621e8a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:47:54.523048 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84f8700-cb23-41e3-97b6-acaf2621e8a0 None None] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:47:54.528670 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a66d094-7c87-4382-bbb0-862f6e9436a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:47:54.529959 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a66d094-7c87-4382-bbb0-862f6e9436a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:47:54.530256 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a66d094-7c87-4382-bbb0-862f6e9436a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:47:54.530538 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a66d094-7c87-4382-bbb0-862f6e9436a2 admin admin] PATH_INFO: `/v3/projects/a02f11b5adb64a7a9da72f8253e939ff` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:47:54.531824 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a66d094-7c87-4382-bbb0-862f6e9436a2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a02f11b5adb64a7a9da72f8253e939ff)` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:47:54.533776 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a66d094-7c87-4382-bbb0-862f6e9436a2 admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:47:54.592309 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-4a66d094-7c87-4382-bbb0-862f6e9436a2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a02f11b5adb64a7a9da72f8253e939ff', 'request_id': 'req-4a66d094-7c87-4382-bbb0-862f6e9436a2'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:47:54.599752 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-4a66d094-7c87-4382-bbb0-862f6e9436a2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a02f11b5adb64a7a9da72f8253e939ff', 'request_id': 'req-4a66d094-7c87-4382-bbb0-862f6e9436a2'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:47:54.607104 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-4a66d094-7c87-4382-bbb0-862f6e9436a2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a02f11b5adb64a7a9da72f8253e939ff', 'request_id': 'req-4a66d094-7c87-4382-bbb0-862f6e9436a2'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:47:54.617777 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-4a66d094-7c87-4382-bbb0-862f6e9436a2 admin admin] The token cache is being invalidate because project a02f11b5adb64a7a9da72f8253e939ff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80474) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 14:47:54.618068 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-4a66d094-7c87-4382-bbb0-862f6e9436a2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:47:54.618726 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-4a66d094-7c87-4382-bbb0-862f6e9436a2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:47:54.620362 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1261/2535] 10.222.0.67 () {58 vars in 1232 bytes} [Wed May 25 14:47:54 2022] DELETE /identity/v3/projects/a02f11b5adb64a7a9da72f8253e939ff => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:47:54.626109 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0a051c-1b1d-4734-9af6-f4cc2fbdf735 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:47:54.626401 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0a051c-1b1d-4734-9af6-f4cc2fbdf735 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:47:54.626688 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0a051c-1b1d-4734-9af6-f4cc2fbdf735 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:47:54.645351 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-ff0a051c-1b1d-4734-9af6-f4cc2fbdf735 None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:47:54.646569 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-ff0a051c-1b1d-4734-9af6-f4cc2fbdf735 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:47:54.710245 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1275/2536] 10.222.0.67 () {58 vars in 957 bytes} [Wed May 25 14:47:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:47:54.718919 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9cede6-63b4-42d6-9f59-8fa41a50fbcb None None] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:47:54.719453 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9cede6-63b4-42d6-9f59-8fa41a50fbcb None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:47:54.719573 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9cede6-63b4-42d6-9f59-8fa41a50fbcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:47:54.739251 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.auth.core [None req-4f9cede6-63b4-42d6-9f59-8fa41a50fbcb None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:47:54.740500 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-4f9cede6-63b4-42d6-9f59-8fa41a50fbcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:47:54.749150 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1262/2537] 10.222.0.67 () {58 vars in 957 bytes} [Wed May 25 14:47:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:47:54.753581 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0a051c-1b1d-4734-9af6-f4cc2fbdf735 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:47:54.763661 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0a051c-1b1d-4734-9af6-f4cc2fbdf735 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:47:54.768299 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e270fbed-bf49-4d67-9567-9519aae13cbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:47:54.768957 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e270fbed-bf49-4d67-9567-9519aae13cbb admin admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:47:54.769239 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e270fbed-bf49-4d67-9567-9519aae13cbb admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:47:54.769510 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e270fbed-bf49-4d67-9567-9519aae13cbb admin admin] PATH_INFO: `/v3/domains` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:47:54.770240 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e270fbed-bf49-4d67-9567-9519aae13cbb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:47:54.770543 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e270fbed-bf49-4d67-9567-9519aae13cbb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:47:54.772219 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e270fbed-bf49-4d67-9567-9519aae13cbb admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:47:54.785463 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1276/2538] 10.222.0.67 () {58 vars in 1152 bytes} [Wed May 25 14:47:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:47:54.789963 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9cede6-63b4-42d6-9f59-8fa41a50fbcb None None] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:47:54.800122 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9cede6-63b4-42d6-9f59-8fa41a50fbcb None None] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:47:54.804802 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74ad180-eaf1-4c69-8ecc-148370d6f451 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:47:54.805465 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74ad180-eaf1-4c69-8ecc-148370d6f451 admin admin] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:47:54.805751 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74ad180-eaf1-4c69-8ecc-148370d6f451 admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:47:54.806030 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74ad180-eaf1-4c69-8ecc-148370d6f451 admin admin] PATH_INFO: `/v3/projects` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:47:54.806730 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74ad180-eaf1-4c69-8ecc-148370d6f451 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:47:54.808705 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74ad180-eaf1-4c69-8ecc-148370d6f451 admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:47:54.844552 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1263/2539] 10.222.0.67 () {60 vars in 1152 bytes} [Wed May 25 14:47:54 2022] POST /identity/v3/projects => generated 383 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:47:54.846354 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e270fbed-bf49-4d67-9567-9519aae13cbb admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:47:54.857152 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e270fbed-bf49-4d67-9567-9519aae13cbb admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:47:54.918820 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6f7eac-255d-49e6-a89f-906aac7b1f9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:47:54.919526 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6f7eac-255d-49e6-a89f-906aac7b1f9f admin admin] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:47:54.919809 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6f7eac-255d-49e6-a89f-906aac7b1f9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:47:54.920087 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6f7eac-255d-49e6-a89f-906aac7b1f9f admin admin] PATH_INFO: `/v3/users` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:47:54.920828 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6f7eac-255d-49e6-a89f-906aac7b1f9f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:47:54.922766 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6f7eac-255d-49e6-a89f-906aac7b1f9f admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:47:54.942841 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1277/2540] 10.222.0.67 () {60 vars in 1143 bytes} [Wed May 25 14:47:54 2022] POST /identity/v3/users => generated 292 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:47:54.947184 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74ad180-eaf1-4c69-8ecc-148370d6f451 admin admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:47:54.958468 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74ad180-eaf1-4c69-8ecc-148370d6f451 admin admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:47:54.963178 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14172dcc-58e5-4e39-b5e6-dd69da094304 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:47:54.963842 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14172dcc-58e5-4e39-b5e6-dd69da094304 admin admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:47:54.964136 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14172dcc-58e5-4e39-b5e6-dd69da094304 admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:47:54.964419 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14172dcc-58e5-4e39-b5e6-dd69da094304 admin admin] PATH_INFO: `/v3/roles` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:47:54.965995 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14172dcc-58e5-4e39-b5e6-dd69da094304 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:47:54.967632 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14172dcc-58e5-4e39-b5e6-dd69da094304 admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:47:54.978470 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1264/2541] 10.222.0.67 () {58 vars in 1121 bytes} [Wed May 25 14:47:54 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:47:54.982539 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6f7eac-255d-49e6-a89f-906aac7b1f9f admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:47:54.993258 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6f7eac-255d-49e6-a89f-906aac7b1f9f admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:47:54.998221 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62a2f8e-7686-4de4-92f4-e1d287d1785c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:47:54.998937 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62a2f8e-7686-4de4-92f4-e1d287d1785c admin admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:47:54.999252 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62a2f8e-7686-4de4-92f4-e1d287d1785c admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:47:54.999537 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62a2f8e-7686-4de4-92f4-e1d287d1785c admin admin] PATH_INFO: `/v3/roles` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:47:55.000334 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62a2f8e-7686-4de4-92f4-e1d287d1785c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:47:55.002956 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62a2f8e-7686-4de4-92f4-e1d287d1785c admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:47:55.021399 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1278/2542] 10.222.0.67 () {58 vars in 1121 bytes} [Wed May 25 14:47:54 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:47:55.026119 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14172dcc-58e5-4e39-b5e6-dd69da094304 admin admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:47:55.042252 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14172dcc-58e5-4e39-b5e6-dd69da094304 admin admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:47:55.049520 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89964a1-6f17-4cd6-9e62-900ff7816efb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:47:55.050759 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89964a1-6f17-4cd6-9e62-900ff7816efb admin admin] REQUEST_METHOD: `PUT` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:47:55.051197 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89964a1-6f17-4cd6-9e62-900ff7816efb admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:47:55.051580 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89964a1-6f17-4cd6-9e62-900ff7816efb admin admin] PATH_INFO: `/v3/projects/f54b8b95dc14432f829531b5113290b0/users/f1af7553f7e24e59bb2cebe06da0c16d/roles/48808901834b4d5eab2c7e6b5b03791e` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:47:55.069124 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89964a1-6f17-4cd6-9e62-900ff7816efb admin admin] RBAC: Authorizing `identity:create_grant(project_id=f54b8b95dc14432f829531b5113290b0, user_id=f1af7553f7e24e59bb2cebe06da0c16d, role_id=48808901834b4d5eab2c7e6b5b03791e)` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:47:55.071999 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89964a1-6f17-4cd6-9e62-900ff7816efb admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:47:55.091763 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1265/2543] 10.222.0.67 () {60 vars in 1482 bytes} [Wed May 25 14:47:55 2022] PUT /identity/v3/projects/f54b8b95dc14432f829531b5113290b0/users/f1af7553f7e24e59bb2cebe06da0c16d/roles/48808901834b4d5eab2c7e6b5b03791e => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:47:55.102692 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ac19f8-cbca-42de-8412-83667a82c914 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:47:55.103066 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ac19f8-cbca-42de-8412-83667a82c914 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:47:55.103287 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ac19f8-cbca-42de-8412-83667a82c914 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:47:55.151225 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-95ac19f8-cbca-42de-8412-83667a82c914 None None] MFA Rules not processed for user `f1af7553f7e24e59bb2cebe06da0c16d`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:47:55.157704 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-95ac19f8-cbca-42de-8412-83667a82c914 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:47:55.189605 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:47:55.321063 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1279/2544] 10.222.0.67 () {58 vars in 957 bytes} [Wed May 25 14:47:55 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:47:55.326924 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89964a1-6f17-4cd6-9e62-900ff7816efb admin admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:47:55.449688 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89964a1-6f17-4cd6-9e62-900ff7816efb admin admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:47:55.456434 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7981668f-32e8-4f23-82e4-f8aa0d519bca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:47:55.457472 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7981668f-32e8-4f23-82e4-f8aa0d519bca admin admin] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:47:55.457918 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7981668f-32e8-4f23-82e4-f8aa0d519bca admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:47:55.458206 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7981668f-32e8-4f23-82e4-f8aa0d519bca admin admin] PATH_INFO: `/v3/projects` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:47:55.458919 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7981668f-32e8-4f23-82e4-f8aa0d519bca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:47:55.461564 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7981668f-32e8-4f23-82e4-f8aa0d519bca admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:47:55.468490 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:47:55.497471 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1266/2545] 10.222.0.67 () {60 vars in 1152 bytes} [Wed May 25 14:47:55 2022] POST /identity/v3/projects => generated 385 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:47:55.501657 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ac19f8-cbca-42de-8412-83667a82c914 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:47:55.513780 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ac19f8-cbca-42de-8412-83667a82c914 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:47:55.571050 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2848c9-c163-4912-8621-f653b35c6c73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:47:55.571639 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2848c9-c163-4912-8621-f653b35c6c73 admin admin] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:47:55.571922 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2848c9-c163-4912-8621-f653b35c6c73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:47:55.572193 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2848c9-c163-4912-8621-f653b35c6c73 admin admin] PATH_INFO: `/v3/users` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:47:55.572875 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2848c9-c163-4912-8621-f653b35c6c73 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:47:55.575539 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2848c9-c163-4912-8621-f653b35c6c73 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:47:55.597865 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1280/2546] 10.222.0.67 () {60 vars in 1143 bytes} [Wed May 25 14:47:55 2022] POST /identity/v3/users => generated 293 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 14:47:55.600632 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7981668f-32e8-4f23-82e4-f8aa0d519bca admin admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:47:55.611667 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7981668f-32e8-4f23-82e4-f8aa0d519bca admin admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:47:55.616429 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f510cf-7241-4500-90b0-750f4d09b476 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:47:55.617096 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f510cf-7241-4500-90b0-750f4d09b476 admin admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:47:55.617425 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f510cf-7241-4500-90b0-750f4d09b476 admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:47:55.617707 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f510cf-7241-4500-90b0-750f4d09b476 admin admin] PATH_INFO: `/v3/roles` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:47:55.618583 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f510cf-7241-4500-90b0-750f4d09b476 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:47:55.620246 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f510cf-7241-4500-90b0-750f4d09b476 admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:47:55.632414 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1267/2547] 10.222.0.67 () {58 vars in 1121 bytes} [Wed May 25 14:47:55 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:47:55.637329 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2848c9-c163-4912-8621-f653b35c6c73 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:47:55.648307 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2848c9-c163-4912-8621-f653b35c6c73 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:47:55.653554 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f875b5b3-a3c2-4769-acc6-d6af9e7a54a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:47:55.654231 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f875b5b3-a3c2-4769-acc6-d6af9e7a54a8 admin admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:47:55.654615 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f875b5b3-a3c2-4769-acc6-d6af9e7a54a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:47:55.654844 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f875b5b3-a3c2-4769-acc6-d6af9e7a54a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:47:55.655576 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f875b5b3-a3c2-4769-acc6-d6af9e7a54a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:47:55.657248 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f875b5b3-a3c2-4769-acc6-d6af9e7a54a8 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:47:55.669098 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1281/2548] 10.222.0.67 () {58 vars in 1121 bytes} [Wed May 25 14:47:55 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:47:55.675612 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f510cf-7241-4500-90b0-750f4d09b476 admin admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:47:55.691945 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f510cf-7241-4500-90b0-750f4d09b476 admin admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:47:55.698428 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a49847-904d-4cb5-991e-02f7483009df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:47:55.700615 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a49847-904d-4cb5-991e-02f7483009df admin admin] REQUEST_METHOD: `PUT` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:47:55.700615 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a49847-904d-4cb5-991e-02f7483009df admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:47:55.700615 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a49847-904d-4cb5-991e-02f7483009df admin admin] PATH_INFO: `/v3/projects/5de9d389820a4c52ab9c8cb20b029f72/users/f8c50dbd4a3e41b9b541cd08a4de6da1/roles/48808901834b4d5eab2c7e6b5b03791e` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:47:55.720871 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a49847-904d-4cb5-991e-02f7483009df admin admin] RBAC: Authorizing `identity:create_grant(project_id=5de9d389820a4c52ab9c8cb20b029f72, user_id=f8c50dbd4a3e41b9b541cd08a4de6da1, role_id=48808901834b4d5eab2c7e6b5b03791e)` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:47:55.723601 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a49847-904d-4cb5-991e-02f7483009df admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:47:55.739363 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1268/2549] 10.222.0.67 () {60 vars in 1482 bytes} [Wed May 25 14:47:55 2022] PUT /identity/v3/projects/5de9d389820a4c52ab9c8cb20b029f72/users/f8c50dbd4a3e41b9b541cd08a4de6da1/roles/48808901834b4d5eab2c7e6b5b03791e => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 14:47:55.752200 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3427385e-1cab-449d-8923-293de624a3b3 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:47:55.752563 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3427385e-1cab-449d-8923-293de624a3b3 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:47:55.752902 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3427385e-1cab-449d-8923-293de624a3b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:47:55.786970 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-3427385e-1cab-449d-8923-293de624a3b3 None None] MFA Rules not processed for user `f8c50dbd4a3e41b9b541cd08a4de6da1`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:47:55.788225 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-3427385e-1cab-449d-8923-293de624a3b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:47:55.864394 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1282/2550] 10.222.0.67 () {58 vars in 957 bytes} [Wed May 25 14:47:55 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:47:55.869536 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a49847-904d-4cb5-991e-02f7483009df admin admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:47:55.942634 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a49847-904d-4cb5-991e-02f7483009df admin admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:47:55.947683 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6fd5c3-0706-4fad-bdb3-fab23c26212b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:47:55.948349 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6fd5c3-0706-4fad-bdb3-fab23c26212b admin admin] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:47:55.948636 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6fd5c3-0706-4fad-bdb3-fab23c26212b admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:47:55.948925 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6fd5c3-0706-4fad-bdb3-fab23c26212b admin admin] PATH_INFO: `/v3/projects` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:47:55.950771 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6fd5c3-0706-4fad-bdb3-fab23c26212b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:47:55.952763 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6fd5c3-0706-4fad-bdb3-fab23c26212b admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:47:55.982691 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1269/2551] 10.222.0.67 () {60 vars in 1152 bytes} [Wed May 25 14:47:55 2022] POST /identity/v3/projects => generated 383 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:47:55.983824 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3427385e-1cab-449d-8923-293de624a3b3 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:47:55.997254 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3427385e-1cab-449d-8923-293de624a3b3 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:47:56.019525 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:47:56.061583 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de6e4e1-ded1-4e9b-bb06-fc30b0e2020a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:47:56.062177 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de6e4e1-ded1-4e9b-bb06-fc30b0e2020a admin admin] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:47:56.062458 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de6e4e1-ded1-4e9b-bb06-fc30b0e2020a admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:47:56.062730 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de6e4e1-ded1-4e9b-bb06-fc30b0e2020a admin admin] PATH_INFO: `/v3/users` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:47:56.063556 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de6e4e1-ded1-4e9b-bb06-fc30b0e2020a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:47:56.065602 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de6e4e1-ded1-4e9b-bb06-fc30b0e2020a admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:47:56.089030 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1283/2552] 10.222.0.67 () {60 vars in 1143 bytes} [Wed May 25 14:47:55 2022] POST /identity/v3/users => generated 298 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 14:47:56.093581 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6fd5c3-0706-4fad-bdb3-fab23c26212b admin admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:47:56.104262 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6fd5c3-0706-4fad-bdb3-fab23c26212b admin admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:47:56.109071 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09be9b20-e40d-40a5-97cf-ad4189b7e58c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:47:56.109780 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09be9b20-e40d-40a5-97cf-ad4189b7e58c admin admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:47:56.110066 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09be9b20-e40d-40a5-97cf-ad4189b7e58c admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:47:56.110347 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09be9b20-e40d-40a5-97cf-ad4189b7e58c admin admin] PATH_INFO: `/v3/roles` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:47:56.111124 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09be9b20-e40d-40a5-97cf-ad4189b7e58c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:47:56.112744 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09be9b20-e40d-40a5-97cf-ad4189b7e58c admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:47:56.124742 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1270/2553] 10.222.0.67 () {58 vars in 1121 bytes} [Wed May 25 14:47:56 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:47:56.129174 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de6e4e1-ded1-4e9b-bb06-fc30b0e2020a admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:47:56.140209 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de6e4e1-ded1-4e9b-bb06-fc30b0e2020a admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:47:56.144759 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8e5dd8-41ab-445b-89e4-98246d84c689 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:47:56.145643 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8e5dd8-41ab-445b-89e4-98246d84c689 admin admin] REQUEST_METHOD: `PUT` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:47:56.145954 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8e5dd8-41ab-445b-89e4-98246d84c689 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:47:56.146245 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8e5dd8-41ab-445b-89e4-98246d84c689 admin admin] PATH_INFO: `/v3/projects/66265805c83f4f54b940b60579edd6f7/users/03362512547841f09a62fa7555e420e9/roles/399893e19eac4ab5a8e596f7c07be13c` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:47:56.164084 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8e5dd8-41ab-445b-89e4-98246d84c689 admin admin] RBAC: Authorizing `identity:create_grant(project_id=66265805c83f4f54b940b60579edd6f7, user_id=03362512547841f09a62fa7555e420e9, role_id=399893e19eac4ab5a8e596f7c07be13c)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:47:56.166811 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8e5dd8-41ab-445b-89e4-98246d84c689 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:47:56.180879 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1284/2554] 10.222.0.67 () {60 vars in 1482 bytes} [Wed May 25 14:47:56 2022] PUT /identity/v3/projects/66265805c83f4f54b940b60579edd6f7/users/03362512547841f09a62fa7555e420e9/roles/399893e19eac4ab5a8e596f7c07be13c => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:47:56.185334 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09be9b20-e40d-40a5-97cf-ad4189b7e58c admin admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:47:56.196203 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09be9b20-e40d-40a5-97cf-ad4189b7e58c admin admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:47:56.267494 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a711f1c-4bae-4337-99f8-4135a6be59b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:47:56.268180 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a711f1c-4bae-4337-99f8-4135a6be59b4 admin admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:47:56.268471 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a711f1c-4bae-4337-99f8-4135a6be59b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:47:56.268756 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a711f1c-4bae-4337-99f8-4135a6be59b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:47:56.269518 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a711f1c-4bae-4337-99f8-4135a6be59b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:47:56.271171 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a711f1c-4bae-4337-99f8-4135a6be59b4 admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:47:56.282736 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1271/2555] 10.222.0.67 () {58 vars in 1121 bytes} [Wed May 25 14:47:56 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:47:56.286847 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8e5dd8-41ab-445b-89e4-98246d84c689 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:47:56.299484 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8e5dd8-41ab-445b-89e4-98246d84c689 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:47:56.304434 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5ce54e-c750-416b-a5c3-cc3336ed235d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:47:56.305325 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5ce54e-c750-416b-a5c3-cc3336ed235d admin admin] REQUEST_METHOD: `PUT` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:47:56.305610 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5ce54e-c750-416b-a5c3-cc3336ed235d admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:47:56.305887 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5ce54e-c750-416b-a5c3-cc3336ed235d admin admin] PATH_INFO: `/v3/projects/66265805c83f4f54b940b60579edd6f7/users/03362512547841f09a62fa7555e420e9/roles/399893e19eac4ab5a8e596f7c07be13c` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:47:56.307908 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5ce54e-c750-416b-a5c3-cc3336ed235d admin admin] RBAC: Authorizing `identity:create_grant(project_id=66265805c83f4f54b940b60579edd6f7, user_id=03362512547841f09a62fa7555e420e9, role_id=399893e19eac4ab5a8e596f7c07be13c)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:47:56.310632 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5ce54e-c750-416b-a5c3-cc3336ed235d admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:47:56.321484 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1285/2556] 10.222.0.67 () {60 vars in 1482 bytes} [Wed May 25 14:47:56 2022] PUT /identity/v3/projects/66265805c83f4f54b940b60579edd6f7/users/03362512547841f09a62fa7555e420e9/roles/399893e19eac4ab5a8e596f7c07be13c => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:47:56.332753 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933c280e-e718-43b9-bb95-c234446c8cc4 None None] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:47:56.333166 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933c280e-e718-43b9-bb95-c234446c8cc4 None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:47:56.333446 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933c280e-e718-43b9-bb95-c234446c8cc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:47:56.364358 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.auth.core [None req-933c280e-e718-43b9-bb95-c234446c8cc4 None None] MFA Rules not processed for user `03362512547841f09a62fa7555e420e9`. Rule list: `[]` (Enabled: `True`). {{(pid=80474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:47:56.365521 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-933c280e-e718-43b9-bb95-c234446c8cc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:47:56.376290 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:47:56.450284 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1272/2557] 10.222.0.67 () {58 vars in 957 bytes} [Wed May 25 14:47:56 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 14:47:56.462171 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5ce54e-c750-416b-a5c3-cc3336ed235d admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:47:56.463969 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-ba5ce54e-c750-416b-a5c3-cc3336ed235d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:47:56.529189 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5ce54e-c750-416b-a5c3-cc3336ed235d admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:47:56.532901 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd338f49-5b1c-421c-967d-56adbe96e04d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e462acc9da84a61bb23998dd54e1858', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfe93ee8d32a441295efc0b885de4bd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:47:56.533557 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd338f49-5b1c-421c-967d-56adbe96e04d service cinder] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:47:56.533846 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd338f49-5b1c-421c-967d-56adbe96e04d service cinder] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:47:56.534128 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd338f49-5b1c-421c-967d-56adbe96e04d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:47:56.597960 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd338f49-5b1c-421c-967d-56adbe96e04d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:47:56.599669 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd338f49-5b1c-421c-967d-56adbe96e04d service cinder] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:47:56.616068 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1286/2558] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 14:47:56 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:47:58.250501 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933c280e-e718-43b9-bb95-c234446c8cc4 None None] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:47:58.260736 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933c280e-e718-43b9-bb95-c234446c8cc4 None None] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:47:58.265201 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885c1e7c-dcd7-4a0c-bb93-fb294710d258 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e462acc9da84a61bb23998dd54e1858', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfe93ee8d32a441295efc0b885de4bd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:47:58.265879 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885c1e7c-dcd7-4a0c-bb93-fb294710d258 service cinder] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:47:58.266163 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885c1e7c-dcd7-4a0c-bb93-fb294710d258 service cinder] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:47:58.266448 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885c1e7c-dcd7-4a0c-bb93-fb294710d258 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:47:58.337530 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885c1e7c-dcd7-4a0c-bb93-fb294710d258 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:47:58.339032 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885c1e7c-dcd7-4a0c-bb93-fb294710d258 service cinder] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:47:58.350859 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1273/2559] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 14:47:58 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:47:58.977974 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd338f49-5b1c-421c-967d-56adbe96e04d service cinder] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:47:58.988136 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd338f49-5b1c-421c-967d-56adbe96e04d service cinder] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:47:58.992641 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d06b98-e733-45dc-9720-474001013ccc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e462acc9da84a61bb23998dd54e1858', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfe93ee8d32a441295efc0b885de4bd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:47:58.993230 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d06b98-e733-45dc-9720-474001013ccc service cinder] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:47:58.993601 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d06b98-e733-45dc-9720-474001013ccc service cinder] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:47:58.994045 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d06b98-e733-45dc-9720-474001013ccc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:47:59.004813 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d06b98-e733-45dc-9720-474001013ccc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:47:59.006496 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d06b98-e733-45dc-9720-474001013ccc service cinder] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:47:59.019203 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1287/2560] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 14:47:58 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:47:59.829228 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1388e1-77bd-4b0e-8887-e7731522947c None None] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:47:59.829787 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1388e1-77bd-4b0e-8887-e7731522947c None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:47:59.829787 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1388e1-77bd-4b0e-8887-e7731522947c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:47:59.852262 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.auth.core [None req-1f1388e1-77bd-4b0e-8887-e7731522947c None None] MFA Rules not processed for user `e03f5bb82ffb41a1b1dde935d093e6f4`. Rule list: `[]` (Enabled: `True`). {{(pid=80474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:47:59.853497 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-1f1388e1-77bd-4b0e-8887-e7731522947c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:47:59.922685 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1274/2561] 10.222.0.67 () {58 vars in 1009 bytes} [Wed May 25 14:47:59 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:47:59.938279 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d06b98-e733-45dc-9720-474001013ccc service cinder] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:47:59.939753 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-89d06b98-e733-45dc-9720-474001013ccc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:47:59.961963 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:48:00.016220 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d06b98-e733-45dc-9720-474001013ccc service cinder] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:48:00.021488 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d36c5d-3639-4b57-942f-fb49e00e87c2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbe9e38881834198842a476889678096', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfe93ee8d32a441295efc0b885de4bd7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:48:00.022220 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d36c5d-3639-4b57-942f-fb49e00e87c2 service swift] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:48:00.022500 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d36c5d-3639-4b57-942f-fb49e00e87c2 service swift] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:48:00.022774 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d36c5d-3639-4b57-942f-fb49e00e87c2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:48:00.032905 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d36c5d-3639-4b57-942f-fb49e00e87c2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:48:00.034591 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d36c5d-3639-4b57-942f-fb49e00e87c2 service swift] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:48:00.043355 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1288/2562] 10.222.0.67 () {60 vars in 1384 bytes} [Wed May 25 14:47:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 25 14:48:03.158000 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1388e1-77bd-4b0e-8887-e7731522947c None None] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:48:03.236270 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=100 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:48:03.259219 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1388e1-77bd-4b0e-8887-e7731522947c None None] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:48:03.265934 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1486e5f3-44c4-41a8-b81f-47128704a530 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:48:03.266985 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1486e5f3-44c4-41a8-b81f-47128704a530 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:48:03.267383 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1486e5f3-44c4-41a8-b81f-47128704a530 admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:48:03.267729 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1486e5f3-44c4-41a8-b81f-47128704a530 admin admin] PATH_INFO: `/v3/users/f1af7553f7e24e59bb2cebe06da0c16d` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:48:03.269177 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1486e5f3-44c4-41a8-b81f-47128704a530 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f1af7553f7e24e59bb2cebe06da0c16d)` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:48:03.271268 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1486e5f3-44c4-41a8-b81f-47128704a530 admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:48:03.333518 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-1486e5f3-44c4-41a8-b81f-47128704a530 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f1af7553f7e24e59bb2cebe06da0c16d'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:48:03.334275 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-1486e5f3-44c4-41a8-b81f-47128704a530 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f1af7553f7e24e59bb2cebe06da0c16d'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:48:03.335015 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-1486e5f3-44c4-41a8-b81f-47128704a530 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f1af7553f7e24e59bb2cebe06da0c16d'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:48:03.349201 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-1486e5f3-44c4-41a8-b81f-47128704a530 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f1af7553f7e24e59bb2cebe06da0c16d'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:48:03.378906 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-1486e5f3-44c4-41a8-b81f-47128704a530 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f1af7553f7e24e59bb2cebe06da0c16d'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:48:03.403143 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1275/2563] 10.222.0.67 () {58 vars in 1223 bytes} [Wed May 25 14:48:03 2022] DELETE /identity/v3/users/f1af7553f7e24e59bb2cebe06da0c16d => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 14:48:03.404725 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5906677-afa0-49c2-8bb5-536fb515a0d4 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:48:03.405279 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5906677-afa0-49c2-8bb5-536fb515a0d4 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:48:03.405410 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5906677-afa0-49c2-8bb5-536fb515a0d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:48:03.425795 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-a5906677-afa0-49c2-8bb5-536fb515a0d4 None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:48:03.427259 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-a5906677-afa0-49c2-8bb5-536fb515a0d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:48:03.499737 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1289/2564] 10.222.0.67 () {58 vars in 957 bytes} [Wed May 25 14:48:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 14:48:03.507185 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1486e5f3-44c4-41a8-b81f-47128704a530 admin admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:48:03.508655 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-1486e5f3-44c4-41a8-b81f-47128704a530 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:48:03.588221 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1486e5f3-44c4-41a8-b81f-47128704a530 admin admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:48:03.594748 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f308affd-2059-4e62-8214-07260067e8fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b68eed985c7b49839bcdd173186ad4ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfe93ee8d32a441295efc0b885de4bd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:48:03.595545 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f308affd-2059-4e62-8214-07260067e8fd service neutron] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:48:03.595899 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f308affd-2059-4e62-8214-07260067e8fd service neutron] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:48:03.596248 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f308affd-2059-4e62-8214-07260067e8fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:48:03.607853 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f308affd-2059-4e62-8214-07260067e8fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:48:03.609319 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f308affd-2059-4e62-8214-07260067e8fd service neutron] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:48:03.620246 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1276/2565] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 14:48:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:48:04.076694 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5906677-afa0-49c2-8bb5-536fb515a0d4 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:48:04.078387 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-a5906677-afa0-49c2-8bb5-536fb515a0d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:48:04.106423 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5906677-afa0-49c2-8bb5-536fb515a0d4 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:48:04.114878 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc64837b-fd17-4fdd-b6c2-d12198b38009 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:48:04.115984 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc64837b-fd17-4fdd-b6c2-d12198b38009 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:48:04.116275 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc64837b-fd17-4fdd-b6c2-d12198b38009 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:48:04.116552 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc64837b-fd17-4fdd-b6c2-d12198b38009 admin admin] PATH_INFO: `/v3/projects/f54b8b95dc14432f829531b5113290b0` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:48:04.117836 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc64837b-fd17-4fdd-b6c2-d12198b38009 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f54b8b95dc14432f829531b5113290b0)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:48:04.120471 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc64837b-fd17-4fdd-b6c2-d12198b38009 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:48:04.190164 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-cc64837b-fd17-4fdd-b6c2-d12198b38009 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f54b8b95dc14432f829531b5113290b0', 'request_id': 'req-cc64837b-fd17-4fdd-b6c2-d12198b38009'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:48:04.199733 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-cc64837b-fd17-4fdd-b6c2-d12198b38009 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f54b8b95dc14432f829531b5113290b0', 'request_id': 'req-cc64837b-fd17-4fdd-b6c2-d12198b38009'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:48:04.211362 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-cc64837b-fd17-4fdd-b6c2-d12198b38009 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f54b8b95dc14432f829531b5113290b0', 'request_id': 'req-cc64837b-fd17-4fdd-b6c2-d12198b38009'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:48:04.225819 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-cc64837b-fd17-4fdd-b6c2-d12198b38009 admin admin] The token cache is being invalidate because project f54b8b95dc14432f829531b5113290b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80475) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 14:48:04.226426 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-cc64837b-fd17-4fdd-b6c2-d12198b38009 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:48:04.227177 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-cc64837b-fd17-4fdd-b6c2-d12198b38009 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:48:04.229029 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1290/2566] 10.222.0.67 () {58 vars in 1232 bytes} [Wed May 25 14:48:04 2022] DELETE /identity/v3/projects/f54b8b95dc14432f829531b5113290b0 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:48:04.233611 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f308affd-2059-4e62-8214-07260067e8fd service neutron] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:48:04.244112 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f308affd-2059-4e62-8214-07260067e8fd service neutron] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:48:04.319117 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb0bc37-9810-4e49-93ac-907fadcee058 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:48:04.320079 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb0bc37-9810-4e49-93ac-907fadcee058 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:48:04.320610 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb0bc37-9810-4e49-93ac-907fadcee058 admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:48:04.320905 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb0bc37-9810-4e49-93ac-907fadcee058 admin admin] PATH_INFO: `/v3/users/f8c50dbd4a3e41b9b541cd08a4de6da1` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:48:04.322158 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb0bc37-9810-4e49-93ac-907fadcee058 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f8c50dbd4a3e41b9b541cd08a4de6da1)` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:48:04.324923 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb0bc37-9810-4e49-93ac-907fadcee058 admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:48:04.341179 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:48:04.389893 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-6cb0bc37-9810-4e49-93ac-907fadcee058 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f8c50dbd4a3e41b9b541cd08a4de6da1'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:48:04.391008 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-6cb0bc37-9810-4e49-93ac-907fadcee058 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f8c50dbd4a3e41b9b541cd08a4de6da1'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:48:04.391909 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-6cb0bc37-9810-4e49-93ac-907fadcee058 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f8c50dbd4a3e41b9b541cd08a4de6da1'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:48:04.408832 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-6cb0bc37-9810-4e49-93ac-907fadcee058 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f8c50dbd4a3e41b9b541cd08a4de6da1'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:48:04.423405 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-6cb0bc37-9810-4e49-93ac-907fadcee058 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f8c50dbd4a3e41b9b541cd08a4de6da1'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:48:04.449994 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1277/2567] 10.222.0.67 () {58 vars in 1223 bytes} [Wed May 25 14:48:04 2022] DELETE /identity/v3/users/f8c50dbd4a3e41b9b541cd08a4de6da1 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:48:04.811693 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc64837b-fd17-4fdd-b6c2-d12198b38009 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:48:04.813535 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-cc64837b-fd17-4fdd-b6c2-d12198b38009 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:48:04.832584 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc64837b-fd17-4fdd-b6c2-d12198b38009 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:48:04.879893 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:48:04.931840 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d3940c-da6f-4f9f-aa83-ea39ccdd3cd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:48:04.932806 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d3940c-da6f-4f9f-aa83-ea39ccdd3cd3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:48:04.933771 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d3940c-da6f-4f9f-aa83-ea39ccdd3cd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:48:04.934316 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d3940c-da6f-4f9f-aa83-ea39ccdd3cd3 admin admin] PATH_INFO: `/v3/projects/5de9d389820a4c52ab9c8cb20b029f72` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:48:04.935888 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d3940c-da6f-4f9f-aa83-ea39ccdd3cd3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5de9d389820a4c52ab9c8cb20b029f72)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:48:04.938126 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d3940c-da6f-4f9f-aa83-ea39ccdd3cd3 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:48:05.031733 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-e1d3940c-da6f-4f9f-aa83-ea39ccdd3cd3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5de9d389820a4c52ab9c8cb20b029f72', 'request_id': 'req-e1d3940c-da6f-4f9f-aa83-ea39ccdd3cd3'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:48:05.038349 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-e1d3940c-da6f-4f9f-aa83-ea39ccdd3cd3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5de9d389820a4c52ab9c8cb20b029f72', 'request_id': 'req-e1d3940c-da6f-4f9f-aa83-ea39ccdd3cd3'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:48:05.046630 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-e1d3940c-da6f-4f9f-aa83-ea39ccdd3cd3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5de9d389820a4c52ab9c8cb20b029f72', 'request_id': 'req-e1d3940c-da6f-4f9f-aa83-ea39ccdd3cd3'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:48:05.065833 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-e1d3940c-da6f-4f9f-aa83-ea39ccdd3cd3 admin admin] The token cache is being invalidate because project 5de9d389820a4c52ab9c8cb20b029f72 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80475) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 14:48:05.068320 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-e1d3940c-da6f-4f9f-aa83-ea39ccdd3cd3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:48:05.068320 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-e1d3940c-da6f-4f9f-aa83-ea39ccdd3cd3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:48:05.068578 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1291/2568] 10.222.0.67 () {58 vars in 1232 bytes} [Wed May 25 14:48:04 2022] DELETE /identity/v3/projects/5de9d389820a4c52ab9c8cb20b029f72 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:48:05.072653 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb0bc37-9810-4e49-93ac-907fadcee058 admin admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:48:05.074721 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-6cb0bc37-9810-4e49-93ac-907fadcee058 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:48:05.092136 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb0bc37-9810-4e49-93ac-907fadcee058 admin admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:48:05.181151 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6c07ff-6ad1-4f2f-864b-53493190ee68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:48:05.182953 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6c07ff-6ad1-4f2f-864b-53493190ee68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:48:05.182953 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6c07ff-6ad1-4f2f-864b-53493190ee68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:48:05.182953 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6c07ff-6ad1-4f2f-864b-53493190ee68 admin admin] PATH_INFO: `/v3/users/03362512547841f09a62fa7555e420e9` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:48:05.184248 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6c07ff-6ad1-4f2f-864b-53493190ee68 admin admin] RBAC: Authorizing `identity:delete_user(user_id=03362512547841f09a62fa7555e420e9)` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:48:05.186961 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6c07ff-6ad1-4f2f-864b-53493190ee68 admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:48:05.270911 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-ec6c07ff-6ad1-4f2f-864b-53493190ee68 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '03362512547841f09a62fa7555e420e9'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:48:05.272131 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-ec6c07ff-6ad1-4f2f-864b-53493190ee68 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '03362512547841f09a62fa7555e420e9'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:48:05.272805 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-ec6c07ff-6ad1-4f2f-864b-53493190ee68 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '03362512547841f09a62fa7555e420e9'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:48:05.289809 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-ec6c07ff-6ad1-4f2f-864b-53493190ee68 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '03362512547841f09a62fa7555e420e9'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:48:05.305605 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-ec6c07ff-6ad1-4f2f-864b-53493190ee68 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '03362512547841f09a62fa7555e420e9'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:48:05.330339 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1278/2569] 10.222.0.67 () {58 vars in 1223 bytes} [Wed May 25 14:48:05 2022] DELETE /identity/v3/users/03362512547841f09a62fa7555e420e9 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:48:05.671954 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d3940c-da6f-4f9f-aa83-ea39ccdd3cd3 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:48:05.673410 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-e1d3940c-da6f-4f9f-aa83-ea39ccdd3cd3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:48:05.690346 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d3940c-da6f-4f9f-aa83-ea39ccdd3cd3 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:48:05.770892 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64256a8b-41e8-4a76-85b0-76afc61bad2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:48:05.772144 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64256a8b-41e8-4a76-85b0-76afc61bad2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:48:05.772526 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64256a8b-41e8-4a76-85b0-76afc61bad2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:48:05.772959 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64256a8b-41e8-4a76-85b0-76afc61bad2f admin admin] PATH_INFO: `/v3/projects/66265805c83f4f54b940b60579edd6f7` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:48:05.774437 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64256a8b-41e8-4a76-85b0-76afc61bad2f admin admin] RBAC: Authorizing `identity:delete_project(project_id=66265805c83f4f54b940b60579edd6f7)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:48:05.776582 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64256a8b-41e8-4a76-85b0-76afc61bad2f admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:48:05.840709 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-64256a8b-41e8-4a76-85b0-76afc61bad2f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '66265805c83f4f54b940b60579edd6f7', 'request_id': 'req-64256a8b-41e8-4a76-85b0-76afc61bad2f'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:48:05.846949 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-64256a8b-41e8-4a76-85b0-76afc61bad2f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '66265805c83f4f54b940b60579edd6f7', 'request_id': 'req-64256a8b-41e8-4a76-85b0-76afc61bad2f'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:48:05.853770 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-64256a8b-41e8-4a76-85b0-76afc61bad2f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '66265805c83f4f54b940b60579edd6f7', 'request_id': 'req-64256a8b-41e8-4a76-85b0-76afc61bad2f'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:48:05.855960 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:48:05.870305 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-64256a8b-41e8-4a76-85b0-76afc61bad2f admin admin] The token cache is being invalidate because project 66265805c83f4f54b940b60579edd6f7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80475) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 14:48:05.871661 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-64256a8b-41e8-4a76-85b0-76afc61bad2f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:48:05.872460 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-64256a8b-41e8-4a76-85b0-76afc61bad2f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:48:05.874173 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1292/2570] 10.222.0.67 () {58 vars in 1232 bytes} [Wed May 25 14:48:05 2022] DELETE /identity/v3/projects/66265805c83f4f54b940b60579edd6f7 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:48:05.879413 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6f0dc9-fabb-4bf7-96b9-08d8f8f1d22a None None] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:48:05.879715 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6f0dc9-fabb-4bf7-96b9-08d8f8f1d22a None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:48:05.880003 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6f0dc9-fabb-4bf7-96b9-08d8f8f1d22a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:48:05.905122 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.auth.core [None req-cc6f0dc9-fabb-4bf7-96b9-08d8f8f1d22a None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:48:05.906625 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-cc6f0dc9-fabb-4bf7-96b9-08d8f8f1d22a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:48:05.914674 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:48:06.010757 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1279/2571] 10.222.0.67 () {58 vars in 957 bytes} [Wed May 25 14:48:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:48:06.019833 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825c7d2c-0ab3-47e6-9cb6-0b43b77bd448 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:48:06.020128 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825c7d2c-0ab3-47e6-9cb6-0b43b77bd448 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:48:06.020419 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825c7d2c-0ab3-47e6-9cb6-0b43b77bd448 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:48:06.043388 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-825c7d2c-0ab3-47e6-9cb6-0b43b77bd448 None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:48:06.044732 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-825c7d2c-0ab3-47e6-9cb6-0b43b77bd448 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:48:06.062368 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1293/2572] 10.222.0.67 () {58 vars in 957 bytes} [Wed May 25 14:48:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:48:06.066709 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6f0dc9-fabb-4bf7-96b9-08d8f8f1d22a None None] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:48:06.080427 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6f0dc9-fabb-4bf7-96b9-08d8f8f1d22a None None] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:48:06.085215 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d2c543-8854-46e5-94e2-0e41cf90851a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:48:06.085894 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d2c543-8854-46e5-94e2-0e41cf90851a admin admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:48:06.086176 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d2c543-8854-46e5-94e2-0e41cf90851a admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:48:06.086459 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d2c543-8854-46e5-94e2-0e41cf90851a admin admin] PATH_INFO: `/v3/domains` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:48:06.087250 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d2c543-8854-46e5-94e2-0e41cf90851a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:48:06.087585 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d2c543-8854-46e5-94e2-0e41cf90851a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:48:06.089280 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d2c543-8854-46e5-94e2-0e41cf90851a admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:48:06.106893 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1280/2573] 10.222.0.67 () {58 vars in 1152 bytes} [Wed May 25 14:48:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:48:06.111342 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825c7d2c-0ab3-47e6-9cb6-0b43b77bd448 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:48:06.121650 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825c7d2c-0ab3-47e6-9cb6-0b43b77bd448 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:48:06.126894 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7920936-181b-45f7-905f-41a5a7dd8427 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:48:06.127607 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7920936-181b-45f7-905f-41a5a7dd8427 admin admin] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:48:06.127889 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7920936-181b-45f7-905f-41a5a7dd8427 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:48:06.128163 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7920936-181b-45f7-905f-41a5a7dd8427 admin admin] PATH_INFO: `/v3/projects` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:48:06.129117 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7920936-181b-45f7-905f-41a5a7dd8427 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:48:06.131426 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7920936-181b-45f7-905f-41a5a7dd8427 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:48:06.167379 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1294/2574] 10.222.0.67 () {60 vars in 1152 bytes} [Wed May 25 14:48:06 2022] POST /identity/v3/projects => generated 371 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:48:06.172407 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d2c543-8854-46e5-94e2-0e41cf90851a admin admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:48:06.184967 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d2c543-8854-46e5-94e2-0e41cf90851a admin admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:48:06.260997 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad70f237-5402-4a82-a8de-140264add318 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:48:06.262038 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad70f237-5402-4a82-a8de-140264add318 admin admin] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:48:06.262359 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad70f237-5402-4a82-a8de-140264add318 admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:48:06.262623 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad70f237-5402-4a82-a8de-140264add318 admin admin] PATH_INFO: `/v3/users` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:48:06.263385 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad70f237-5402-4a82-a8de-140264add318 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:48:06.265397 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad70f237-5402-4a82-a8de-140264add318 admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:48:06.295777 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7920936-181b-45f7-905f-41a5a7dd8427 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:48:06.296967 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1281/2575] 10.222.0.67 () {60 vars in 1143 bytes} [Wed May 25 14:48:06 2022] POST /identity/v3/users => generated 286 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:48:06.314022 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7920936-181b-45f7-905f-41a5a7dd8427 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:48:06.320481 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d466e9-8820-497d-a303-8e6b5454ff83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:48:06.321250 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d466e9-8820-497d-a303-8e6b5454ff83 admin admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:48:06.321606 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d466e9-8820-497d-a303-8e6b5454ff83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:48:06.321948 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d466e9-8820-497d-a303-8e6b5454ff83 admin admin] PATH_INFO: `/v3/roles` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:48:06.322749 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d466e9-8820-497d-a303-8e6b5454ff83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:48:06.324782 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d466e9-8820-497d-a303-8e6b5454ff83 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:48:06.336674 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1295/2576] 10.222.0.67 () {58 vars in 1121 bytes} [Wed May 25 14:48:06 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:48:06.341185 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad70f237-5402-4a82-a8de-140264add318 admin admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:48:06.353454 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad70f237-5402-4a82-a8de-140264add318 admin admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:48:06.361983 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485827e6-f6ea-4f7d-9abf-0172cd21f668 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:48:06.363110 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485827e6-f6ea-4f7d-9abf-0172cd21f668 admin admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:48:06.363601 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485827e6-f6ea-4f7d-9abf-0172cd21f668 admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:48:06.364082 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485827e6-f6ea-4f7d-9abf-0172cd21f668 admin admin] PATH_INFO: `/v3/roles` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:48:06.365419 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485827e6-f6ea-4f7d-9abf-0172cd21f668 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:48:06.368388 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485827e6-f6ea-4f7d-9abf-0172cd21f668 admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:48:06.394056 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1282/2577] 10.222.0.67 () {58 vars in 1121 bytes} [Wed May 25 14:48:06 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:48:06.395442 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d466e9-8820-497d-a303-8e6b5454ff83 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:48:06.412985 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d466e9-8820-497d-a303-8e6b5454ff83 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:48:06.420321 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c5123e-a9f7-46a6-8ee7-2daff0715dd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:48:06.421794 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c5123e-a9f7-46a6-8ee7-2daff0715dd9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:48:06.422312 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c5123e-a9f7-46a6-8ee7-2daff0715dd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:48:06.422845 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c5123e-a9f7-46a6-8ee7-2daff0715dd9 admin admin] PATH_INFO: `/v3/projects/1cc69483a02347c9badd81b559f05b77/users/aaf51a9c5e714953880193fe68663f30/roles/48808901834b4d5eab2c7e6b5b03791e` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:48:06.441047 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c5123e-a9f7-46a6-8ee7-2daff0715dd9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1cc69483a02347c9badd81b559f05b77, user_id=aaf51a9c5e714953880193fe68663f30, role_id=48808901834b4d5eab2c7e6b5b03791e)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:48:06.444371 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c5123e-a9f7-46a6-8ee7-2daff0715dd9 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:48:06.462212 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1296/2578] 10.222.0.67 () {60 vars in 1482 bytes} [Wed May 25 14:48:06 2022] PUT /identity/v3/projects/1cc69483a02347c9badd81b559f05b77/users/aaf51a9c5e714953880193fe68663f30/roles/48808901834b4d5eab2c7e6b5b03791e => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:48:06.470541 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a639cf-6d5d-4d2b-a35b-4f403bc2f5f1 None None] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:48:06.470541 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a639cf-6d5d-4d2b-a35b-4f403bc2f5f1 None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:48:06.470769 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a639cf-6d5d-4d2b-a35b-4f403bc2f5f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:48:06.491522 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.auth.core [None req-75a639cf-6d5d-4d2b-a35b-4f403bc2f5f1 None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:48:06.493524 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-75a639cf-6d5d-4d2b-a35b-4f403bc2f5f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:48:06.586604 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1283/2579] 10.222.0.67 () {58 vars in 957 bytes} [Wed May 25 14:48:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:48:06.655585 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c5123e-a9f7-46a6-8ee7-2daff0715dd9 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:48:06.657404 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-41c5123e-a9f7-46a6-8ee7-2daff0715dd9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:48:06.725942 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c5123e-a9f7-46a6-8ee7-2daff0715dd9 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:48:06.730327 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e147ae17-a98b-4a8c-b94a-1036b377b9eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b68eed985c7b49839bcdd173186ad4ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfe93ee8d32a441295efc0b885de4bd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:48:06.731249 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e147ae17-a98b-4a8c-b94a-1036b377b9eb service neutron] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:48:06.731615 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e147ae17-a98b-4a8c-b94a-1036b377b9eb service neutron] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:48:06.731970 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e147ae17-a98b-4a8c-b94a-1036b377b9eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:48:06.742345 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e147ae17-a98b-4a8c-b94a-1036b377b9eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:48:06.743995 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e147ae17-a98b-4a8c-b94a-1036b377b9eb service neutron] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:48:06.755795 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1297/2580] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 14:48:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:48:07.671934 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23a53f5-b37f-44c2-a7c8-4952565353b1 None None] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:48:07.672520 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23a53f5-b37f-44c2-a7c8-4952565353b1 None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:48:07.672861 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23a53f5-b37f-44c2-a7c8-4952565353b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:48:07.761865 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.auth.core [None req-c23a53f5-b37f-44c2-a7c8-4952565353b1 None None] MFA Rules not processed for user `aaf51a9c5e714953880193fe68663f30`. Rule list: `[]` (Enabled: `True`). {{(pid=80474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:48:07.764137 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-c23a53f5-b37f-44c2-a7c8-4952565353b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:48:07.776688 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:48:07.959646 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1284/2581] 10.222.0.67 () {58 vars in 957 bytes} [Wed May 25 14:48:07 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:48:07.974334 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e147ae17-a98b-4a8c-b94a-1036b377b9eb service neutron] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:48:07.975904 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-e147ae17-a98b-4a8c-b94a-1036b377b9eb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:48:08.094529 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e147ae17-a98b-4a8c-b94a-1036b377b9eb service neutron] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:48:08.107859 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2e3a5d-ce65-45c1-ac70-031fe793230a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e462acc9da84a61bb23998dd54e1858', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfe93ee8d32a441295efc0b885de4bd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:48:08.109081 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2e3a5d-ce65-45c1-ac70-031fe793230a service cinder] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:48:08.109661 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2e3a5d-ce65-45c1-ac70-031fe793230a service cinder] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:48:08.110211 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2e3a5d-ce65-45c1-ac70-031fe793230a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:48:08.122425 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2e3a5d-ce65-45c1-ac70-031fe793230a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:48:08.124257 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2e3a5d-ce65-45c1-ac70-031fe793230a service cinder] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:48:08.135974 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1298/2582] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 14:48:07 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:48:09.618943 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b441aa-0779-4a1e-a2fe-3e2c4f19cd1d None None] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:48:09.619561 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b441aa-0779-4a1e-a2fe-3e2c4f19cd1d None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:48:09.619561 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b441aa-0779-4a1e-a2fe-3e2c4f19cd1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:48:09.641271 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.auth.core [None req-17b441aa-0779-4a1e-a2fe-3e2c4f19cd1d None None] MFA Rules not processed for user `aaf51a9c5e714953880193fe68663f30`. Rule list: `[]` (Enabled: `True`). {{(pid=80474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:48:09.642507 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-17b441aa-0779-4a1e-a2fe-3e2c4f19cd1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:48:09.649493 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1285/2583] 10.222.0.67 () {58 vars in 957 bytes} [Wed May 25 14:48:09 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:48:09.882955 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2e3a5d-ce65-45c1-ac70-031fe793230a service cinder] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:48:09.892797 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2e3a5d-ce65-45c1-ac70-031fe793230a service cinder] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:48:09.896459 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9576b715-059c-4f9c-87c5-82842b26d4d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b68eed985c7b49839bcdd173186ad4ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfe93ee8d32a441295efc0b885de4bd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:48:09.897094 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9576b715-059c-4f9c-87c5-82842b26d4d9 service neutron] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:48:09.897382 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9576b715-059c-4f9c-87c5-82842b26d4d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:48:09.897664 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9576b715-059c-4f9c-87c5-82842b26d4d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:48:09.899507 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-9576b715-059c-4f9c-87c5-82842b26d4d9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:48:09.909326 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9576b715-059c-4f9c-87c5-82842b26d4d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:48:09.910759 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9576b715-059c-4f9c-87c5-82842b26d4d9 service neutron] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:48:09.919583 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1299/2584] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 14:48:09 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:48:14.458821 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebb0fdb-f0e0-43fd-bc86-d621dca992e3 None None] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:48:14.459382 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebb0fdb-f0e0-43fd-bc86-d621dca992e3 None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:48:14.459522 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebb0fdb-f0e0-43fd-bc86-d621dca992e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:48:14.478909 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.auth.core [None req-1ebb0fdb-f0e0-43fd-bc86-d621dca992e3 None None] MFA Rules not processed for user `e03f5bb82ffb41a1b1dde935d093e6f4`. Rule list: `[]` (Enabled: `True`). {{(pid=80474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:48:14.480182 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-1ebb0fdb-f0e0-43fd-bc86-d621dca992e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:48:14.555659 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1286/2585] 10.222.0.67 () {58 vars in 967 bytes} [Wed May 25 14:48:14 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:48:14.582811 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9576b715-059c-4f9c-87c5-82842b26d4d9 service neutron] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:48:14.584271 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-9576b715-059c-4f9c-87c5-82842b26d4d9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:48:14.608717 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:INSERT=3,keystone:DELETE=1,keystone:SELECT=96 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:48:14.669972 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9576b715-059c-4f9c-87c5-82842b26d4d9 service neutron] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:48:14.675437 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fd6f2d-d3c2-4262-b82b-0925c66c3b62 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbe9e38881834198842a476889678096', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfe93ee8d32a441295efc0b885de4bd7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:48:14.676116 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fd6f2d-d3c2-4262-b82b-0925c66c3b62 service swift] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:48:14.676515 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fd6f2d-d3c2-4262-b82b-0925c66c3b62 service swift] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:48:14.676683 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fd6f2d-d3c2-4262-b82b-0925c66c3b62 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:48:14.686189 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fd6f2d-d3c2-4262-b82b-0925c66c3b62 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:48:14.687840 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fd6f2d-d3c2-4262-b82b-0925c66c3b62 service swift] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:48:14.697638 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1300/2586] 10.222.0.67 () {60 vars in 1384 bytes} [Wed May 25 14:48:14 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 25 14:48:24.548427 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=53 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:48:24.693763 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=23 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:48:25.156274 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebb0fdb-f0e0-43fd-bc86-d621dca992e3 None None] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:48:25.157696 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-1ebb0fdb-f0e0-43fd-bc86-d621dca992e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:48:25.169755 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebb0fdb-f0e0-43fd-bc86-d621dca992e3 None None] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:48:25.173307 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59df9f45-6727-402a-99f5-8c923d5e0ee5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b68eed985c7b49839bcdd173186ad4ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfe93ee8d32a441295efc0b885de4bd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:48:25.173956 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59df9f45-6727-402a-99f5-8c923d5e0ee5 service neutron] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:48:25.174238 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59df9f45-6727-402a-99f5-8c923d5e0ee5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:48:25.174513 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59df9f45-6727-402a-99f5-8c923d5e0ee5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:48:25.176298 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-59df9f45-6727-402a-99f5-8c923d5e0ee5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:48:25.189047 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59df9f45-6727-402a-99f5-8c923d5e0ee5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:48:25.190486 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59df9f45-6727-402a-99f5-8c923d5e0ee5 service neutron] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:48:25.200488 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1287/2587] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 14:48:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:48:27.918058 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c52ac0b-5375-48b6-9946-b16f0b19f3ed None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:48:27.918058 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c52ac0b-5375-48b6-9946-b16f0b19f3ed None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:48:27.918882 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c52ac0b-5375-48b6-9946-b16f0b19f3ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:48:27.938039 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-1c52ac0b-5375-48b6-9946-b16f0b19f3ed None None] MFA Rules not processed for user `aaf51a9c5e714953880193fe68663f30`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:48:27.939297 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-1c52ac0b-5375-48b6-9946-b16f0b19f3ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:48:27.946365 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1301/2588] 10.222.0.67 () {58 vars in 957 bytes} [Wed May 25 14:48:27 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:48:29.226213 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59df9f45-6727-402a-99f5-8c923d5e0ee5 service neutron] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:48:29.228028 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-59df9f45-6727-402a-99f5-8c923d5e0ee5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:48:29.249250 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59df9f45-6727-402a-99f5-8c923d5e0ee5 service neutron] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:48:29.254853 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bcde2e-767d-49fa-a4f7-87e0c3fb9788 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:48:29.255853 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bcde2e-767d-49fa-a4f7-87e0c3fb9788 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:48:29.256176 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bcde2e-767d-49fa-a4f7-87e0c3fb9788 admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:48:29.256462 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bcde2e-767d-49fa-a4f7-87e0c3fb9788 admin admin] PATH_INFO: `/v3/users/ff5a1f15e8d54a68946c8ccfdd4a3587` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:48:29.257737 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bcde2e-767d-49fa-a4f7-87e0c3fb9788 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ff5a1f15e8d54a68946c8ccfdd4a3587)` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:48:29.259837 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bcde2e-767d-49fa-a4f7-87e0c3fb9788 admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:48:29.311142 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-e9bcde2e-767d-49fa-a4f7-87e0c3fb9788 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ff5a1f15e8d54a68946c8ccfdd4a3587'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:48:29.311813 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-e9bcde2e-767d-49fa-a4f7-87e0c3fb9788 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ff5a1f15e8d54a68946c8ccfdd4a3587'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:48:29.312446 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-e9bcde2e-767d-49fa-a4f7-87e0c3fb9788 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ff5a1f15e8d54a68946c8ccfdd4a3587'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:48:29.325578 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-e9bcde2e-767d-49fa-a4f7-87e0c3fb9788 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ff5a1f15e8d54a68946c8ccfdd4a3587'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:48:29.333470 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-e9bcde2e-767d-49fa-a4f7-87e0c3fb9788 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ff5a1f15e8d54a68946c8ccfdd4a3587'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:48:29.348362 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1288/2589] 10.222.0.67 () {58 vars in 1223 bytes} [Wed May 25 14:48:29 2022] DELETE /identity/v3/users/ff5a1f15e8d54a68946c8ccfdd4a3587 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:48:29.549191 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c52ac0b-5375-48b6-9946-b16f0b19f3ed None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:48:29.562711 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c52ac0b-5375-48b6-9946-b16f0b19f3ed None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:48:29.626393 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733c3cce-dc9c-4aaf-8eea-6c9af7c3ca27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:48:29.627332 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733c3cce-dc9c-4aaf-8eea-6c9af7c3ca27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:48:29.627617 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733c3cce-dc9c-4aaf-8eea-6c9af7c3ca27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:48:29.628057 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733c3cce-dc9c-4aaf-8eea-6c9af7c3ca27 admin admin] PATH_INFO: `/v3/projects/4e6496a9b4a44f1daf11c7ed0efdfef3` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:48:29.629243 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733c3cce-dc9c-4aaf-8eea-6c9af7c3ca27 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4e6496a9b4a44f1daf11c7ed0efdfef3)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:48:29.631219 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733c3cce-dc9c-4aaf-8eea-6c9af7c3ca27 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:48:29.685038 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-733c3cce-dc9c-4aaf-8eea-6c9af7c3ca27 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4e6496a9b4a44f1daf11c7ed0efdfef3', 'request_id': 'req-733c3cce-dc9c-4aaf-8eea-6c9af7c3ca27'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:48:29.691909 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-733c3cce-dc9c-4aaf-8eea-6c9af7c3ca27 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4e6496a9b4a44f1daf11c7ed0efdfef3', 'request_id': 'req-733c3cce-dc9c-4aaf-8eea-6c9af7c3ca27'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:48:29.702024 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-733c3cce-dc9c-4aaf-8eea-6c9af7c3ca27 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4e6496a9b4a44f1daf11c7ed0efdfef3', 'request_id': 'req-733c3cce-dc9c-4aaf-8eea-6c9af7c3ca27'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:48:29.718361 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-733c3cce-dc9c-4aaf-8eea-6c9af7c3ca27 admin admin] The token cache is being invalidate because project 4e6496a9b4a44f1daf11c7ed0efdfef3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80475) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 14:48:29.718650 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-733c3cce-dc9c-4aaf-8eea-6c9af7c3ca27 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:48:29.719343 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-733c3cce-dc9c-4aaf-8eea-6c9af7c3ca27 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:48:29.721048 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1302/2590] 10.222.0.67 () {58 vars in 1232 bytes} [Wed May 25 14:48:29 2022] DELETE /identity/v3/projects/4e6496a9b4a44f1daf11c7ed0efdfef3 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:48:29.726015 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c552cecd-cb18-49b8-b6dd-76e2bdd3d861 None None] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:48:29.726315 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c552cecd-cb18-49b8-b6dd-76e2bdd3d861 None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:48:29.726601 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c552cecd-cb18-49b8-b6dd-76e2bdd3d861 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:48:29.747038 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.auth.core [None req-c552cecd-cb18-49b8-b6dd-76e2bdd3d861 None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:48:29.748609 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-c552cecd-cb18-49b8-b6dd-76e2bdd3d861 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:48:29.832071 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1289/2591] 10.222.0.67 () {58 vars in 957 bytes} [Wed May 25 14:48:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 14:48:29.840835 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8babeb83-e805-45ee-83a3-80f097897969 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:48:29.841229 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8babeb83-e805-45ee-83a3-80f097897969 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:48:29.841471 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8babeb83-e805-45ee-83a3-80f097897969 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:48:29.862907 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-8babeb83-e805-45ee-83a3-80f097897969 None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:48:29.864607 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-8babeb83-e805-45ee-83a3-80f097897969 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:48:29.874229 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1303/2592] 10.222.0.67 () {58 vars in 957 bytes} [Wed May 25 14:48:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:48:29.878923 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c552cecd-cb18-49b8-b6dd-76e2bdd3d861 None None] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:48:29.891178 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c552cecd-cb18-49b8-b6dd-76e2bdd3d861 None None] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:48:29.897024 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9ca085-e781-4eb7-b01e-0aab4f9683ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:48:29.897722 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9ca085-e781-4eb7-b01e-0aab4f9683ea admin admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:48:29.898034 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9ca085-e781-4eb7-b01e-0aab4f9683ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:48:29.898293 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9ca085-e781-4eb7-b01e-0aab4f9683ea admin admin] PATH_INFO: `/v3/domains` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:48:29.899140 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9ca085-e781-4eb7-b01e-0aab4f9683ea admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:48:29.899572 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9ca085-e781-4eb7-b01e-0aab4f9683ea admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:48:29.906680 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9ca085-e781-4eb7-b01e-0aab4f9683ea admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:48:29.916031 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1290/2593] 10.222.0.67 () {58 vars in 1152 bytes} [Wed May 25 14:48:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:48:29.921523 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8babeb83-e805-45ee-83a3-80f097897969 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:48:29.931172 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8babeb83-e805-45ee-83a3-80f097897969 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:48:29.936589 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e57098-29b1-40fc-b95e-a5c8276e95ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:48:29.937263 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e57098-29b1-40fc-b95e-a5c8276e95ef admin admin] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:48:29.937550 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e57098-29b1-40fc-b95e-a5c8276e95ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:48:29.937826 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e57098-29b1-40fc-b95e-a5c8276e95ef admin admin] PATH_INFO: `/v3/projects` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:48:29.938524 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e57098-29b1-40fc-b95e-a5c8276e95ef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:48:29.940504 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e57098-29b1-40fc-b95e-a5c8276e95ef admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:48:29.977263 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1304/2594] 10.222.0.67 () {60 vars in 1152 bytes} [Wed May 25 14:48:29 2022] POST /identity/v3/projects => generated 383 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:48:29.978219 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9ca085-e781-4eb7-b01e-0aab4f9683ea admin admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:48:29.989009 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9ca085-e781-4eb7-b01e-0aab4f9683ea admin admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:48:30.051063 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:48:30.069418 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c221dd99-ac4e-4584-8115-6741d88c96cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:48:30.070104 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c221dd99-ac4e-4584-8115-6741d88c96cd admin admin] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:48:30.070387 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c221dd99-ac4e-4584-8115-6741d88c96cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:48:30.070690 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c221dd99-ac4e-4584-8115-6741d88c96cd admin admin] PATH_INFO: `/v3/users` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:48:30.071418 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c221dd99-ac4e-4584-8115-6741d88c96cd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:48:30.073952 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c221dd99-ac4e-4584-8115-6741d88c96cd admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:48:30.095477 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1291/2595] 10.222.0.67 () {60 vars in 1143 bytes} [Wed May 25 14:48:29 2022] POST /identity/v3/users => generated 292 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:48:30.100063 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e57098-29b1-40fc-b95e-a5c8276e95ef admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:48:30.111318 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e57098-29b1-40fc-b95e-a5c8276e95ef admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:48:30.116476 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d9d0ac-30f5-4303-b3fe-5deb1e3cd192 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:48:30.117196 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d9d0ac-30f5-4303-b3fe-5deb1e3cd192 admin admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:48:30.117484 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d9d0ac-30f5-4303-b3fe-5deb1e3cd192 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:48:30.117764 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d9d0ac-30f5-4303-b3fe-5deb1e3cd192 admin admin] PATH_INFO: `/v3/roles` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:48:30.118517 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d9d0ac-30f5-4303-b3fe-5deb1e3cd192 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:48:30.120218 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d9d0ac-30f5-4303-b3fe-5deb1e3cd192 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:48:30.131684 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1305/2596] 10.222.0.67 () {58 vars in 1121 bytes} [Wed May 25 14:48:30 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:48:30.137277 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c221dd99-ac4e-4584-8115-6741d88c96cd admin admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:48:30.156307 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c221dd99-ac4e-4584-8115-6741d88c96cd admin admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:48:30.164879 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1088bb1d-5c44-4009-a7b0-5ff8b05747e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:48:30.166434 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1088bb1d-5c44-4009-a7b0-5ff8b05747e3 admin admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:48:30.166584 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1088bb1d-5c44-4009-a7b0-5ff8b05747e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:48:30.167040 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1088bb1d-5c44-4009-a7b0-5ff8b05747e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:48:30.168446 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1088bb1d-5c44-4009-a7b0-5ff8b05747e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:48:30.171781 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1088bb1d-5c44-4009-a7b0-5ff8b05747e3 admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:48:30.188387 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1292/2597] 10.222.0.67 () {58 vars in 1121 bytes} [Wed May 25 14:48:30 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:48:30.191771 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d9d0ac-30f5-4303-b3fe-5deb1e3cd192 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:48:30.202781 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d9d0ac-30f5-4303-b3fe-5deb1e3cd192 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:48:30.207479 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67da55cc-30b8-4d6c-9b3f-34c5d1bbf8bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:48:30.208507 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67da55cc-30b8-4d6c-9b3f-34c5d1bbf8bc admin admin] REQUEST_METHOD: `PUT` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:48:30.208925 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67da55cc-30b8-4d6c-9b3f-34c5d1bbf8bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:48:30.209205 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67da55cc-30b8-4d6c-9b3f-34c5d1bbf8bc admin admin] PATH_INFO: `/v3/projects/a3b546c5706c4012a3ff2e144a23694a/users/fb8bbe1f1ef1493eb150877078acd476/roles/48808901834b4d5eab2c7e6b5b03791e` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:48:30.225082 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67da55cc-30b8-4d6c-9b3f-34c5d1bbf8bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=a3b546c5706c4012a3ff2e144a23694a, user_id=fb8bbe1f1ef1493eb150877078acd476, role_id=48808901834b4d5eab2c7e6b5b03791e)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:48:30.227816 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67da55cc-30b8-4d6c-9b3f-34c5d1bbf8bc admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:48:30.244623 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1306/2598] 10.222.0.67 () {60 vars in 1482 bytes} [Wed May 25 14:48:30 2022] PUT /identity/v3/projects/a3b546c5706c4012a3ff2e144a23694a/users/fb8bbe1f1ef1493eb150877078acd476/roles/48808901834b4d5eab2c7e6b5b03791e => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:48:30.250447 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be636911-34a4-413a-92ca-816fa1e9b571 None None] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:48:30.250964 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be636911-34a4-413a-92ca-816fa1e9b571 None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:48:30.251117 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be636911-34a4-413a-92ca-816fa1e9b571 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:48:30.270682 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.auth.core [None req-be636911-34a4-413a-92ca-816fa1e9b571 None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:48:30.272065 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-be636911-34a4-413a-92ca-816fa1e9b571 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:48:30.350549 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1293/2599] 10.222.0.67 () {58 vars in 957 bytes} [Wed May 25 14:48:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:48:30.360673 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67da55cc-30b8-4d6c-9b3f-34c5d1bbf8bc admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:48:30.362571 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-67da55cc-30b8-4d6c-9b3f-34c5d1bbf8bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:48:30.387953 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:48:30.434325 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67da55cc-30b8-4d6c-9b3f-34c5d1bbf8bc admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:48:30.437987 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2a12e8-cf48-4eb2-bf8d-6accb7252063 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b68eed985c7b49839bcdd173186ad4ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfe93ee8d32a441295efc0b885de4bd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:48:30.438653 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2a12e8-cf48-4eb2-bf8d-6accb7252063 service neutron] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:48:30.438940 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2a12e8-cf48-4eb2-bf8d-6accb7252063 service neutron] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:48:30.439256 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2a12e8-cf48-4eb2-bf8d-6accb7252063 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:48:30.450236 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2a12e8-cf48-4eb2-bf8d-6accb7252063 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:48:30.451805 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2a12e8-cf48-4eb2-bf8d-6accb7252063 service neutron] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:48:30.462326 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1307/2600] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 14:48:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:48:35.069229 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d4f931-d102-4687-afae-fe47034c3df8 None None] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:48:35.069766 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d4f931-d102-4687-afae-fe47034c3df8 None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:48:35.069766 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d4f931-d102-4687-afae-fe47034c3df8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:48:35.099195 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.auth.core [None req-02d4f931-d102-4687-afae-fe47034c3df8 None None] MFA Rules not processed for user `fb8bbe1f1ef1493eb150877078acd476`. Rule list: `[]` (Enabled: `True`). {{(pid=80474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:48:35.101258 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-02d4f931-d102-4687-afae-fe47034c3df8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:48:35.176864 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1294/2601] 10.222.0.67 () {58 vars in 957 bytes} [Wed May 25 14:48:35 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:48:35.193745 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2a12e8-cf48-4eb2-bf8d-6accb7252063 service neutron] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:48:35.195263 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-4a2a12e8-cf48-4eb2-bf8d-6accb7252063 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:48:35.284886 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2a12e8-cf48-4eb2-bf8d-6accb7252063 service neutron] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:48:35.291302 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354b44f9-70e3-47dd-8758-a675d92300c8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '428ec99478284743943ed41e9d24a603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfe93ee8d32a441295efc0b885de4bd7', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:48:35.292585 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354b44f9-70e3-47dd-8758-a675d92300c8 service nova] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:48:35.293535 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354b44f9-70e3-47dd-8758-a675d92300c8 service nova] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:48:35.293827 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354b44f9-70e3-47dd-8758-a675d92300c8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:48:35.302675 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354b44f9-70e3-47dd-8758-a675d92300c8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:48:35.304333 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354b44f9-70e3-47dd-8758-a675d92300c8 service nova] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:48:35.315555 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1308/2602] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 14:48:35 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:48:37.003959 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3a0c57-cd15-48c3-9a61-1e1eb5272007 None None] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:48:37.004407 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3a0c57-cd15-48c3-9a61-1e1eb5272007 None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:48:37.004506 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3a0c57-cd15-48c3-9a61-1e1eb5272007 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:48:37.023168 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.auth.core [None req-ab3a0c57-cd15-48c3-9a61-1e1eb5272007 None None] MFA Rules not processed for user `fb8bbe1f1ef1493eb150877078acd476`. Rule list: `[]` (Enabled: `True`). {{(pid=80474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:48:37.024397 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-ab3a0c57-cd15-48c3-9a61-1e1eb5272007 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:48:37.032255 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1295/2603] 10.222.0.67 () {58 vars in 957 bytes} [Wed May 25 14:48:37 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:48:45.311019 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=51 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:48:46.966853 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7850f1-a328-4d8e-b5c7-95b1045ff366 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:48:46.967540 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7850f1-a328-4d8e-b5c7-95b1045ff366 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:48:46.967540 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7850f1-a328-4d8e-b5c7-95b1045ff366 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:48:46.986063 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-9b7850f1-a328-4d8e-b5c7-95b1045ff366 None None] MFA Rules not processed for user `e03f5bb82ffb41a1b1dde935d093e6f4`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:48:46.987417 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-9b7850f1-a328-4d8e-b5c7-95b1045ff366 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:48:47.017627 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=75,keystone:INSERT=3 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:48:47.050102 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1309/2604] 10.222.0.67 () {58 vars in 1009 bytes} [Wed May 25 14:48:46 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:48:47.062136 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3a0c57-cd15-48c3-9a61-1e1eb5272007 None None] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:48:47.063659 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-ab3a0c57-cd15-48c3-9a61-1e1eb5272007 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:48:47.143652 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3a0c57-cd15-48c3-9a61-1e1eb5272007 None None] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:48:47.152657 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16ef24e-2f39-4493-96ec-4e8447b428f9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbe9e38881834198842a476889678096', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfe93ee8d32a441295efc0b885de4bd7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:48:47.153334 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16ef24e-2f39-4493-96ec-4e8447b428f9 service swift] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:48:47.153623 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16ef24e-2f39-4493-96ec-4e8447b428f9 service swift] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:48:47.153906 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16ef24e-2f39-4493-96ec-4e8447b428f9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:48:47.166511 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16ef24e-2f39-4493-96ec-4e8447b428f9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:48:47.168804 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16ef24e-2f39-4493-96ec-4e8447b428f9 service swift] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:48:47.178181 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1296/2605] 10.222.0.67 () {60 vars in 1384 bytes} [Wed May 25 14:48:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 25 14:48:57.044477 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=25 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:48:57.174537 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=32 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:49:03.368126 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7850f1-a328-4d8e-b5c7-95b1045ff366 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:49:03.378474 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7850f1-a328-4d8e-b5c7-95b1045ff366 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:49:03.382032 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df4505f-5d84-4f53-99d3-753ae92c79d1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b68eed985c7b49839bcdd173186ad4ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfe93ee8d32a441295efc0b885de4bd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:49:03.382688 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df4505f-5d84-4f53-99d3-753ae92c79d1 service neutron] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:03.382976 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df4505f-5d84-4f53-99d3-753ae92c79d1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:03.383286 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df4505f-5d84-4f53-99d3-753ae92c79d1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:03.385081 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-3df4505f-5d84-4f53-99d3-753ae92c79d1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:49:03.397707 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df4505f-5d84-4f53-99d3-753ae92c79d1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:49:03.399176 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df4505f-5d84-4f53-99d3-753ae92c79d1 service neutron] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:49:03.409242 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1310/2606] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 14:49:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:49:03.783033 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504846fd-9208-444c-a8bf-b794b1ffefbd None None] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:03.783762 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504846fd-9208-444c-a8bf-b794b1ffefbd None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:03.783762 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504846fd-9208-444c-a8bf-b794b1ffefbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:03.803455 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.auth.core [None req-504846fd-9208-444c-a8bf-b794b1ffefbd None None] MFA Rules not processed for user `e03f5bb82ffb41a1b1dde935d093e6f4`. Rule list: `[]` (Enabled: `True`). {{(pid=80474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:49:03.804675 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-504846fd-9208-444c-a8bf-b794b1ffefbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:49:03.812557 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1297/2607] 10.222.0.67 () {58 vars in 967 bytes} [Wed May 25 14:49:03 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:49:03.825704 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df4505f-5d84-4f53-99d3-753ae92c79d1 service neutron] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:49:03.837918 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df4505f-5d84-4f53-99d3-753ae92c79d1 service neutron] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:49:03.843468 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cca5679-46f3-4726-96a9-dc6d18fe13fe service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbe9e38881834198842a476889678096', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfe93ee8d32a441295efc0b885de4bd7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:49:03.843971 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cca5679-46f3-4726-96a9-dc6d18fe13fe service swift] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:03.844259 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cca5679-46f3-4726-96a9-dc6d18fe13fe service swift] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:03.844539 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cca5679-46f3-4726-96a9-dc6d18fe13fe service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:03.857937 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cca5679-46f3-4726-96a9-dc6d18fe13fe service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:49:03.859637 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cca5679-46f3-4726-96a9-dc6d18fe13fe service swift] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:49:03.869170 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1311/2608] 10.222.0.67 () {60 vars in 1384 bytes} [Wed May 25 14:49:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 25 14:49:05.912526 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504846fd-9208-444c-a8bf-b794b1ffefbd None None] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:49:05.914089 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-504846fd-9208-444c-a8bf-b794b1ffefbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:49:05.932537 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504846fd-9208-444c-a8bf-b794b1ffefbd None None] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:49:05.937381 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c8db3a-cfd5-42b1-b5fd-fc5cd31bf9f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:49:05.938374 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c8db3a-cfd5-42b1-b5fd-fc5cd31bf9f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:05.938732 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c8db3a-cfd5-42b1-b5fd-fc5cd31bf9f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:05.939151 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c8db3a-cfd5-42b1-b5fd-fc5cd31bf9f4 admin admin] PATH_INFO: `/v3/users/aaf51a9c5e714953880193fe68663f30` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:05.940507 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c8db3a-cfd5-42b1-b5fd-fc5cd31bf9f4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aaf51a9c5e714953880193fe68663f30)` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:49:05.942796 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c8db3a-cfd5-42b1-b5fd-fc5cd31bf9f4 admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:49:05.992511 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-d6c8db3a-cfd5-42b1-b5fd-fc5cd31bf9f4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aaf51a9c5e714953880193fe68663f30'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:49:05.993493 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-d6c8db3a-cfd5-42b1-b5fd-fc5cd31bf9f4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aaf51a9c5e714953880193fe68663f30'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:49:05.994189 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-d6c8db3a-cfd5-42b1-b5fd-fc5cd31bf9f4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aaf51a9c5e714953880193fe68663f30'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:49:06.008059 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-d6c8db3a-cfd5-42b1-b5fd-fc5cd31bf9f4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aaf51a9c5e714953880193fe68663f30'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:49:06.016904 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-d6c8db3a-cfd5-42b1-b5fd-fc5cd31bf9f4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aaf51a9c5e714953880193fe68663f30'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:49:06.032792 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1298/2609] 10.222.0.67 () {58 vars in 1223 bytes} [Wed May 25 14:49:05 2022] DELETE /identity/v3/users/aaf51a9c5e714953880193fe68663f30 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:49:06.241230 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cca5679-46f3-4726-96a9-dc6d18fe13fe service swift] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:49:06.266497 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cca5679-46f3-4726-96a9-dc6d18fe13fe service swift] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:49:06.351783 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5cdda0-af6e-4ed2-94fc-a8265e4b73da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:49:06.354675 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5cdda0-af6e-4ed2-94fc-a8265e4b73da admin admin] REQUEST_METHOD: `DELETE` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:06.354834 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5cdda0-af6e-4ed2-94fc-a8265e4b73da admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:06.355141 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5cdda0-af6e-4ed2-94fc-a8265e4b73da admin admin] PATH_INFO: `/v3/projects/1cc69483a02347c9badd81b559f05b77` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:06.359969 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5cdda0-af6e-4ed2-94fc-a8265e4b73da admin admin] RBAC: Authorizing `identity:delete_project(project_id=1cc69483a02347c9badd81b559f05b77)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:49:06.365208 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5cdda0-af6e-4ed2-94fc-a8265e4b73da admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:49:06.429760 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-6d5cdda0-af6e-4ed2-94fc-a8265e4b73da admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1cc69483a02347c9badd81b559f05b77', 'request_id': 'req-6d5cdda0-af6e-4ed2-94fc-a8265e4b73da'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:49:06.436189 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-6d5cdda0-af6e-4ed2-94fc-a8265e4b73da admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1cc69483a02347c9badd81b559f05b77', 'request_id': 'req-6d5cdda0-af6e-4ed2-94fc-a8265e4b73da'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:49:06.442646 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-6d5cdda0-af6e-4ed2-94fc-a8265e4b73da admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1cc69483a02347c9badd81b559f05b77', 'request_id': 'req-6d5cdda0-af6e-4ed2-94fc-a8265e4b73da'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:49:06.455921 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-6d5cdda0-af6e-4ed2-94fc-a8265e4b73da admin admin] The token cache is being invalidate because project 1cc69483a02347c9badd81b559f05b77 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80475) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 14:49:06.456208 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-6d5cdda0-af6e-4ed2-94fc-a8265e4b73da admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:49:06.457040 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-6d5cdda0-af6e-4ed2-94fc-a8265e4b73da admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:49:06.458634 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1312/2610] 10.222.0.67 () {58 vars in 1232 bytes} [Wed May 25 14:49:06 2022] DELETE /identity/v3/projects/1cc69483a02347c9badd81b559f05b77 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:49:06.894187 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c8db3a-cfd5-42b1-b5fd-fc5cd31bf9f4 admin admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:49:06.895681 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-d6c8db3a-cfd5-42b1-b5fd-fc5cd31bf9f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:49:06.909942 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c8db3a-cfd5-42b1-b5fd-fc5cd31bf9f4 admin admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:49:06.973911 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23cee30-3f74-49b4-a248-96fa79fcb3bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:49:06.974807 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23cee30-3f74-49b4-a248-96fa79fcb3bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:06.975124 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23cee30-3f74-49b4-a248-96fa79fcb3bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:06.975403 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23cee30-3f74-49b4-a248-96fa79fcb3bf admin admin] PATH_INFO: `/v3/users/4db7e98c4244461daf725c699fb2b9a3` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:06.976672 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23cee30-3f74-49b4-a248-96fa79fcb3bf admin admin] RBAC: Authorizing `identity:delete_user(user_id=4db7e98c4244461daf725c699fb2b9a3)` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:49:06.978600 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23cee30-3f74-49b4-a248-96fa79fcb3bf admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:49:07.042627 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-f23cee30-3f74-49b4-a248-96fa79fcb3bf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4db7e98c4244461daf725c699fb2b9a3'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:49:07.043320 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-f23cee30-3f74-49b4-a248-96fa79fcb3bf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4db7e98c4244461daf725c699fb2b9a3'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:49:07.043992 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-f23cee30-3f74-49b4-a248-96fa79fcb3bf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4db7e98c4244461daf725c699fb2b9a3'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:49:07.056245 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-f23cee30-3f74-49b4-a248-96fa79fcb3bf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4db7e98c4244461daf725c699fb2b9a3'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:49:07.058844 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=80,keystone:DELETE=19,keystone:INSERT=1 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:49:07.064874 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-f23cee30-3f74-49b4-a248-96fa79fcb3bf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4db7e98c4244461daf725c699fb2b9a3'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:49:07.079355 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1299/2611] 10.222.0.67 () {58 vars in 1223 bytes} [Wed May 25 14:49:06 2022] DELETE /identity/v3/users/4db7e98c4244461daf725c699fb2b9a3 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:49:07.548201 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5cdda0-af6e-4ed2-94fc-a8265e4b73da admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:49:07.549768 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-6d5cdda0-af6e-4ed2-94fc-a8265e4b73da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:49:07.568864 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5cdda0-af6e-4ed2-94fc-a8265e4b73da admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:49:07.636170 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e56bcd-863b-4f4e-8f94-83fc4af6b859 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:49:07.637435 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e56bcd-863b-4f4e-8f94-83fc4af6b859 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:07.637722 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e56bcd-863b-4f4e-8f94-83fc4af6b859 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:07.638003 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e56bcd-863b-4f4e-8f94-83fc4af6b859 admin admin] PATH_INFO: `/v3/projects/103825b93ee544b9ab0401daaf6fc77a` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:07.639249 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e56bcd-863b-4f4e-8f94-83fc4af6b859 admin admin] RBAC: Authorizing `identity:delete_project(project_id=103825b93ee544b9ab0401daaf6fc77a)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:49:07.641158 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e56bcd-863b-4f4e-8f94-83fc4af6b859 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:49:07.647961 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:49:07.692881 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-66e56bcd-863b-4f4e-8f94-83fc4af6b859 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '103825b93ee544b9ab0401daaf6fc77a', 'request_id': 'req-66e56bcd-863b-4f4e-8f94-83fc4af6b859'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:49:07.700867 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-66e56bcd-863b-4f4e-8f94-83fc4af6b859 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '103825b93ee544b9ab0401daaf6fc77a', 'request_id': 'req-66e56bcd-863b-4f4e-8f94-83fc4af6b859'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:49:07.707344 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-66e56bcd-863b-4f4e-8f94-83fc4af6b859 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '103825b93ee544b9ab0401daaf6fc77a', 'request_id': 'req-66e56bcd-863b-4f4e-8f94-83fc4af6b859'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:49:07.720503 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-66e56bcd-863b-4f4e-8f94-83fc4af6b859 admin admin] The token cache is being invalidate because project 103825b93ee544b9ab0401daaf6fc77a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80475) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 14:49:07.720794 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-66e56bcd-863b-4f4e-8f94-83fc4af6b859 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:49:07.721452 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-66e56bcd-863b-4f4e-8f94-83fc4af6b859 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:49:07.723070 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1313/2612] 10.222.0.67 () {58 vars in 1232 bytes} [Wed May 25 14:49:07 2022] DELETE /identity/v3/projects/103825b93ee544b9ab0401daaf6fc77a => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:49:07.728212 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe357da-1589-4415-bbbc-ffa7ff73cc8c None None] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:07.728504 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe357da-1589-4415-bbbc-ffa7ff73cc8c None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:07.728811 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe357da-1589-4415-bbbc-ffa7ff73cc8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:07.748755 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.auth.core [None req-2fe357da-1589-4415-bbbc-ffa7ff73cc8c None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:49:07.750004 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-2fe357da-1589-4415-bbbc-ffa7ff73cc8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:49:07.812407 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1300/2613] 10.222.0.67 () {58 vars in 957 bytes} [Wed May 25 14:49:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:49:07.820089 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b824be97-a552-4604-bb9d-af5f949db060 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:07.820380 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b824be97-a552-4604-bb9d-af5f949db060 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:07.820659 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b824be97-a552-4604-bb9d-af5f949db060 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:07.841717 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-b824be97-a552-4604-bb9d-af5f949db060 None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:49:07.842925 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-b824be97-a552-4604-bb9d-af5f949db060 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:49:07.850825 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1314/2614] 10.222.0.67 () {58 vars in 957 bytes} [Wed May 25 14:49:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:49:07.855093 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe357da-1589-4415-bbbc-ffa7ff73cc8c None None] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:49:07.864902 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe357da-1589-4415-bbbc-ffa7ff73cc8c None None] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:49:07.869699 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db06678f-bbb1-4b46-9100-d32aed4e329f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:49:07.870614 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db06678f-bbb1-4b46-9100-d32aed4e329f admin admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:07.870907 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db06678f-bbb1-4b46-9100-d32aed4e329f admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:07.871221 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db06678f-bbb1-4b46-9100-d32aed4e329f admin admin] PATH_INFO: `/v3/domains` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:07.871968 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db06678f-bbb1-4b46-9100-d32aed4e329f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:49:07.872279 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db06678f-bbb1-4b46-9100-d32aed4e329f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:49:07.873915 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db06678f-bbb1-4b46-9100-d32aed4e329f admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:49:07.887169 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1301/2615] 10.222.0.67 () {58 vars in 1152 bytes} [Wed May 25 14:49:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:49:07.891504 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b824be97-a552-4604-bb9d-af5f949db060 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:49:07.901880 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b824be97-a552-4604-bb9d-af5f949db060 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:49:07.906538 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc77b4a-90bd-49c8-b90b-bac8452871ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:49:07.907227 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc77b4a-90bd-49c8-b90b-bac8452871ec admin admin] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:07.907538 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc77b4a-90bd-49c8-b90b-bac8452871ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:07.907816 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc77b4a-90bd-49c8-b90b-bac8452871ec admin admin] PATH_INFO: `/v3/projects` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:07.908516 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc77b4a-90bd-49c8-b90b-bac8452871ec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:49:07.910411 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc77b4a-90bd-49c8-b90b-bac8452871ec admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:49:07.937496 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1315/2616] 10.222.0.67 () {60 vars in 1152 bytes} [Wed May 25 14:49:07 2022] POST /identity/v3/projects => generated 365 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:49:07.941728 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db06678f-bbb1-4b46-9100-d32aed4e329f admin admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:49:07.952884 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db06678f-bbb1-4b46-9100-d32aed4e329f admin admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:49:08.009830 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b571761-07c5-414f-a66d-72edc404bf68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:49:08.011248 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b571761-07c5-414f-a66d-72edc404bf68 admin admin] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:08.011248 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b571761-07c5-414f-a66d-72edc404bf68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:08.011742 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b571761-07c5-414f-a66d-72edc404bf68 admin admin] PATH_INFO: `/v3/users` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:08.012439 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b571761-07c5-414f-a66d-72edc404bf68 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:49:08.014366 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b571761-07c5-414f-a66d-72edc404bf68 admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:49:08.035768 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1302/2617] 10.222.0.67 () {60 vars in 1143 bytes} [Wed May 25 14:49:07 2022] POST /identity/v3/users => generated 283 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:49:08.039941 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc77b4a-90bd-49c8-b90b-bac8452871ec admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:49:08.051280 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc77b4a-90bd-49c8-b90b-bac8452871ec admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:49:08.056114 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e768a6ca-29df-4d93-b634-84239164f59a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:49:08.056756 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e768a6ca-29df-4d93-b634-84239164f59a admin admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:08.057899 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e768a6ca-29df-4d93-b634-84239164f59a admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:08.058198 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e768a6ca-29df-4d93-b634-84239164f59a admin admin] PATH_INFO: `/v3/roles` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:08.058924 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e768a6ca-29df-4d93-b634-84239164f59a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:49:08.060563 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e768a6ca-29df-4d93-b634-84239164f59a admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:49:08.071910 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1316/2618] 10.222.0.67 () {58 vars in 1121 bytes} [Wed May 25 14:49:08 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:49:08.076701 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b571761-07c5-414f-a66d-72edc404bf68 admin admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:49:08.087628 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b571761-07c5-414f-a66d-72edc404bf68 admin admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:49:08.093490 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f8576a-16b6-45cf-957e-109ff2ed08d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:49:08.094321 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f8576a-16b6-45cf-957e-109ff2ed08d7 admin admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:08.094615 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f8576a-16b6-45cf-957e-109ff2ed08d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:08.094904 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f8576a-16b6-45cf-957e-109ff2ed08d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:08.095684 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f8576a-16b6-45cf-957e-109ff2ed08d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:49:08.097326 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f8576a-16b6-45cf-957e-109ff2ed08d7 admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:49:08.109358 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1303/2619] 10.222.0.67 () {58 vars in 1121 bytes} [Wed May 25 14:49:08 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:49:08.113568 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e768a6ca-29df-4d93-b634-84239164f59a admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:49:08.124422 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e768a6ca-29df-4d93-b634-84239164f59a admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:49:08.129099 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27460066-fb8c-4343-a48d-9b26876fe32c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:49:08.129986 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27460066-fb8c-4343-a48d-9b26876fe32c admin admin] REQUEST_METHOD: `PUT` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:08.130272 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27460066-fb8c-4343-a48d-9b26876fe32c admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:08.130558 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27460066-fb8c-4343-a48d-9b26876fe32c admin admin] PATH_INFO: `/v3/projects/086925aab57c4fe4a3467ed18a946737/users/c5176f2df3c64688af627f1c2e0f935c/roles/48808901834b4d5eab2c7e6b5b03791e` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:08.147254 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27460066-fb8c-4343-a48d-9b26876fe32c admin admin] RBAC: Authorizing `identity:create_grant(project_id=086925aab57c4fe4a3467ed18a946737, user_id=c5176f2df3c64688af627f1c2e0f935c, role_id=48808901834b4d5eab2c7e6b5b03791e)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:49:08.149926 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27460066-fb8c-4343-a48d-9b26876fe32c admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:49:08.163623 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1317/2620] 10.222.0.67 () {60 vars in 1482 bytes} [Wed May 25 14:49:08 2022] PUT /identity/v3/projects/086925aab57c4fe4a3467ed18a946737/users/c5176f2df3c64688af627f1c2e0f935c/roles/48808901834b4d5eab2c7e6b5b03791e => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 14:49:08.175155 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b288d521-d5bc-4f19-8f82-7aaa486ffa9d None None] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:08.175451 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b288d521-d5bc-4f19-8f82-7aaa486ffa9d None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:08.175736 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b288d521-d5bc-4f19-8f82-7aaa486ffa9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:08.206026 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.auth.core [None req-b288d521-d5bc-4f19-8f82-7aaa486ffa9d None None] MFA Rules not processed for user `c5176f2df3c64688af627f1c2e0f935c`. Rule list: `[]` (Enabled: `True`). {{(pid=80474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:49:08.207276 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-b288d521-d5bc-4f19-8f82-7aaa486ffa9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:49:08.250381 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:49:08.278640 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1304/2621] 10.222.0.67 () {58 vars in 957 bytes} [Wed May 25 14:49:08 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:49:08.289410 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27460066-fb8c-4343-a48d-9b26876fe32c admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:49:08.291213 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-27460066-fb8c-4343-a48d-9b26876fe32c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:49:08.348502 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27460066-fb8c-4343-a48d-9b26876fe32c admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:49:08.352099 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97308661-d858-43d5-a8cb-34b6924238dc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e462acc9da84a61bb23998dd54e1858', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfe93ee8d32a441295efc0b885de4bd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:49:08.352737 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97308661-d858-43d5-a8cb-34b6924238dc service cinder] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:08.353021 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97308661-d858-43d5-a8cb-34b6924238dc service cinder] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:08.353293 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97308661-d858-43d5-a8cb-34b6924238dc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:08.362409 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97308661-d858-43d5-a8cb-34b6924238dc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:49:08.363875 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97308661-d858-43d5-a8cb-34b6924238dc service cinder] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:49:08.372961 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1318/2622] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 14:49:08 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:49:16.794611 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b288d521-d5bc-4f19-8f82-7aaa486ffa9d None None] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:49:16.885303 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b288d521-d5bc-4f19-8f82-7aaa486ffa9d None None] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:49:16.890068 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cf69fd-bcc5-4005-851f-cdf313c4dd16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:49:16.890958 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cf69fd-bcc5-4005-851f-cdf313c4dd16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:16.891276 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cf69fd-bcc5-4005-851f-cdf313c4dd16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:16.891553 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cf69fd-bcc5-4005-851f-cdf313c4dd16 admin admin] PATH_INFO: `/v3/users/c5176f2df3c64688af627f1c2e0f935c` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:16.892767 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0cf69fd-bcc5-4005-851f-cdf313c4dd16 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c5176f2df3c64688af627f1c2e0f935c)` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:49:16.895151 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0cf69fd-bcc5-4005-851f-cdf313c4dd16 admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:49:16.948498 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-a0cf69fd-bcc5-4005-851f-cdf313c4dd16 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c5176f2df3c64688af627f1c2e0f935c'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:49:16.949187 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-a0cf69fd-bcc5-4005-851f-cdf313c4dd16 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c5176f2df3c64688af627f1c2e0f935c'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:49:16.949784 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-a0cf69fd-bcc5-4005-851f-cdf313c4dd16 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c5176f2df3c64688af627f1c2e0f935c'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:49:16.964904 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-a0cf69fd-bcc5-4005-851f-cdf313c4dd16 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c5176f2df3c64688af627f1c2e0f935c'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:49:16.973463 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-a0cf69fd-bcc5-4005-851f-cdf313c4dd16 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c5176f2df3c64688af627f1c2e0f935c'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:49:16.987691 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1305/2623] 10.222.0.67 () {58 vars in 1223 bytes} [Wed May 25 14:49:16 2022] DELETE /identity/v3/users/c5176f2df3c64688af627f1c2e0f935c => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:49:16.993002 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa0578d-16ba-4cc1-99d8-01c9a024502c None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:16.993515 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa0578d-16ba-4cc1-99d8-01c9a024502c None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:16.993613 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa0578d-16ba-4cc1-99d8-01c9a024502c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:17.012790 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-eaa0578d-16ba-4cc1-99d8-01c9a024502c None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:49:17.014012 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-eaa0578d-16ba-4cc1-99d8-01c9a024502c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:49:17.049759 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:49:17.084470 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1319/2624] 10.222.0.67 () {58 vars in 957 bytes} [Wed May 25 14:49:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:49:17.095935 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cf69fd-bcc5-4005-851f-cdf313c4dd16 admin admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:49:17.097429 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-a0cf69fd-bcc5-4005-851f-cdf313c4dd16 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:49:17.166902 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cf69fd-bcc5-4005-851f-cdf313c4dd16 admin admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:49:17.170864 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedb26c8-3028-4529-b848-1c95a3ddcc36 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b68eed985c7b49839bcdd173186ad4ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfe93ee8d32a441295efc0b885de4bd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:49:17.171569 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedb26c8-3028-4529-b848-1c95a3ddcc36 service neutron] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:17.171874 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedb26c8-3028-4529-b848-1c95a3ddcc36 service neutron] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:17.172124 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedb26c8-3028-4529-b848-1c95a3ddcc36 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:17.182423 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedb26c8-3028-4529-b848-1c95a3ddcc36 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:49:17.184076 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedb26c8-3028-4529-b848-1c95a3ddcc36 service neutron] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:49:17.194215 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1306/2625] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 14:49:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:49:17.480802 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa0578d-16ba-4cc1-99d8-01c9a024502c None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:49:17.482403 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-eaa0578d-16ba-4cc1-99d8-01c9a024502c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:49:17.495333 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa0578d-16ba-4cc1-99d8-01c9a024502c None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:49:17.500467 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd1cc3e-360a-4d72-859d-55f32ce937c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:49:17.501331 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd1cc3e-360a-4d72-859d-55f32ce937c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:17.501615 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd1cc3e-360a-4d72-859d-55f32ce937c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:17.501893 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd1cc3e-360a-4d72-859d-55f32ce937c6 admin admin] PATH_INFO: `/v3/projects/086925aab57c4fe4a3467ed18a946737` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:17.503145 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd1cc3e-360a-4d72-859d-55f32ce937c6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=086925aab57c4fe4a3467ed18a946737)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:49:17.505087 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd1cc3e-360a-4d72-859d-55f32ce937c6 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:49:17.562762 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-ffd1cc3e-360a-4d72-859d-55f32ce937c6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '086925aab57c4fe4a3467ed18a946737', 'request_id': 'req-ffd1cc3e-360a-4d72-859d-55f32ce937c6'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:49:17.569125 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-ffd1cc3e-360a-4d72-859d-55f32ce937c6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '086925aab57c4fe4a3467ed18a946737', 'request_id': 'req-ffd1cc3e-360a-4d72-859d-55f32ce937c6'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:49:17.576630 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-ffd1cc3e-360a-4d72-859d-55f32ce937c6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '086925aab57c4fe4a3467ed18a946737', 'request_id': 'req-ffd1cc3e-360a-4d72-859d-55f32ce937c6'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:49:17.591230 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-ffd1cc3e-360a-4d72-859d-55f32ce937c6 admin admin] The token cache is being invalidate because project 086925aab57c4fe4a3467ed18a946737 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80475) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 14:49:17.591456 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-ffd1cc3e-360a-4d72-859d-55f32ce937c6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:49:17.592064 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-ffd1cc3e-360a-4d72-859d-55f32ce937c6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:49:17.593617 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1320/2626] 10.222.0.67 () {58 vars in 1232 bytes} [Wed May 25 14:49:17 2022] DELETE /identity/v3/projects/086925aab57c4fe4a3467ed18a946737 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:49:17.599557 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc21ffe-8eaa-4b92-a0af-0bb3ddff4fdc None None] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:17.599856 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc21ffe-8eaa-4b92-a0af-0bb3ddff4fdc None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:17.600142 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc21ffe-8eaa-4b92-a0af-0bb3ddff4fdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:17.607034 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:49:17.623719 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.auth.core [None req-fbc21ffe-8eaa-4b92-a0af-0bb3ddff4fdc None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:49:17.624920 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-fbc21ffe-8eaa-4b92-a0af-0bb3ddff4fdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:49:17.688859 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1307/2627] 10.222.0.67 () {58 vars in 957 bytes} [Wed May 25 14:49:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 14:49:17.696759 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35a2c9b-322d-4671-97d9-ec46cff5986a None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:17.697062 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35a2c9b-322d-4671-97d9-ec46cff5986a None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:17.697320 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35a2c9b-322d-4671-97d9-ec46cff5986a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:17.718153 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-f35a2c9b-322d-4671-97d9-ec46cff5986a None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:49:17.719427 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-f35a2c9b-322d-4671-97d9-ec46cff5986a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:49:17.727644 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1321/2628] 10.222.0.67 () {58 vars in 957 bytes} [Wed May 25 14:49:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:49:17.732514 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc21ffe-8eaa-4b92-a0af-0bb3ddff4fdc None None] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:49:17.742269 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc21ffe-8eaa-4b92-a0af-0bb3ddff4fdc None None] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:49:17.747788 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ea35a1-ab3e-46ae-9617-4105e0507031 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:49:17.748461 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ea35a1-ab3e-46ae-9617-4105e0507031 admin admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:17.748740 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ea35a1-ab3e-46ae-9617-4105e0507031 admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:17.749148 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ea35a1-ab3e-46ae-9617-4105e0507031 admin admin] PATH_INFO: `/v3/domains` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:17.749901 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ea35a1-ab3e-46ae-9617-4105e0507031 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:49:17.750209 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ea35a1-ab3e-46ae-9617-4105e0507031 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:49:17.751848 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ea35a1-ab3e-46ae-9617-4105e0507031 admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:49:17.765005 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1308/2629] 10.222.0.67 () {58 vars in 1152 bytes} [Wed May 25 14:49:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:49:17.769405 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35a2c9b-322d-4671-97d9-ec46cff5986a None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:49:17.778886 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35a2c9b-322d-4671-97d9-ec46cff5986a None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:49:17.783571 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7243b132-8d55-4c34-8dc3-bd6c2221f155 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:49:17.784246 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7243b132-8d55-4c34-8dc3-bd6c2221f155 admin admin] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:17.784564 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7243b132-8d55-4c34-8dc3-bd6c2221f155 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:17.784843 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7243b132-8d55-4c34-8dc3-bd6c2221f155 admin admin] PATH_INFO: `/v3/projects` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:17.785543 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7243b132-8d55-4c34-8dc3-bd6c2221f155 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:49:17.787503 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7243b132-8d55-4c34-8dc3-bd6c2221f155 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:49:17.816380 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1322/2630] 10.222.0.67 () {60 vars in 1152 bytes} [Wed May 25 14:49:17 2022] POST /identity/v3/projects => generated 373 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:49:17.820477 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ea35a1-ab3e-46ae-9617-4105e0507031 admin admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:49:17.830839 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ea35a1-ab3e-46ae-9617-4105e0507031 admin admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:49:17.891014 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db075cc-cbde-4105-9ffd-92ee12e9df02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:49:17.891677 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db075cc-cbde-4105-9ffd-92ee12e9df02 admin admin] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:17.891964 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db075cc-cbde-4105-9ffd-92ee12e9df02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:17.892245 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db075cc-cbde-4105-9ffd-92ee12e9df02 admin admin] PATH_INFO: `/v3/users` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:17.892953 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db075cc-cbde-4105-9ffd-92ee12e9df02 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:49:17.894911 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db075cc-cbde-4105-9ffd-92ee12e9df02 admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:49:17.919105 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1309/2631] 10.222.0.67 () {60 vars in 1143 bytes} [Wed May 25 14:49:17 2022] POST /identity/v3/users => generated 287 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:49:17.923416 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7243b132-8d55-4c34-8dc3-bd6c2221f155 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:49:17.935964 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7243b132-8d55-4c34-8dc3-bd6c2221f155 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:49:17.943248 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cf9bb6-f2f8-4427-9c59-14263824e7bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:49:17.943963 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cf9bb6-f2f8-4427-9c59-14263824e7bb admin admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:17.944249 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cf9bb6-f2f8-4427-9c59-14263824e7bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:17.944632 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cf9bb6-f2f8-4427-9c59-14263824e7bb admin admin] PATH_INFO: `/v3/roles` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:17.945258 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2cf9bb6-f2f8-4427-9c59-14263824e7bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:49:17.946880 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2cf9bb6-f2f8-4427-9c59-14263824e7bb admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:49:17.959296 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1323/2632] 10.222.0.67 () {58 vars in 1121 bytes} [Wed May 25 14:49:17 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 25 14:49:17.964959 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db075cc-cbde-4105-9ffd-92ee12e9df02 admin admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:49:17.975192 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db075cc-cbde-4105-9ffd-92ee12e9df02 admin admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:49:17.980845 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ae7315-d87b-4d76-8238-701d8a18ccc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:49:17.981544 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ae7315-d87b-4d76-8238-701d8a18ccc4 admin admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:17.981859 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ae7315-d87b-4d76-8238-701d8a18ccc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:17.982138 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ae7315-d87b-4d76-8238-701d8a18ccc4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:17.982882 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ae7315-d87b-4d76-8238-701d8a18ccc4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:49:17.984554 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ae7315-d87b-4d76-8238-701d8a18ccc4 admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:49:17.996410 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1310/2633] 10.222.0.67 () {58 vars in 1121 bytes} [Wed May 25 14:49:17 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:49:18.000769 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cf9bb6-f2f8-4427-9c59-14263824e7bb admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:49:18.011799 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cf9bb6-f2f8-4427-9c59-14263824e7bb admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:49:18.016869 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b165ce95-1d2f-48db-b61b-16eb574a46d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:49:18.017758 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b165ce95-1d2f-48db-b61b-16eb574a46d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:18.018036 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b165ce95-1d2f-48db-b61b-16eb574a46d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:18.018310 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b165ce95-1d2f-48db-b61b-16eb574a46d7 admin admin] PATH_INFO: `/v3/projects/5bfffe9178224e61b210f1f4577cb8ab/users/e25d6702b72245b6b9112be67df70416/roles/48808901834b4d5eab2c7e6b5b03791e` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:18.033594 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b165ce95-1d2f-48db-b61b-16eb574a46d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5bfffe9178224e61b210f1f4577cb8ab, user_id=e25d6702b72245b6b9112be67df70416, role_id=48808901834b4d5eab2c7e6b5b03791e)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:49:18.036338 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b165ce95-1d2f-48db-b61b-16eb574a46d7 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:49:18.052537 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1324/2634] 10.222.0.67 () {60 vars in 1482 bytes} [Wed May 25 14:49:17 2022] PUT /identity/v3/projects/5bfffe9178224e61b210f1f4577cb8ab/users/e25d6702b72245b6b9112be67df70416/roles/48808901834b4d5eab2c7e6b5b03791e => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:49:18.063871 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ba9317-8c41-426d-a229-ad67e4441229 None None] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:18.064164 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ba9317-8c41-426d-a229-ad67e4441229 None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:18.064442 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ba9317-8c41-426d-a229-ad67e4441229 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:18.094324 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.auth.core [None req-10ba9317-8c41-426d-a229-ad67e4441229 None None] MFA Rules not processed for user `e25d6702b72245b6b9112be67df70416`. Rule list: `[]` (Enabled: `True`). {{(pid=80474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:49:18.095494 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-10ba9317-8c41-426d-a229-ad67e4441229 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:49:18.160275 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:49:18.168564 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1311/2635] 10.222.0.67 () {58 vars in 957 bytes} [Wed May 25 14:49:18 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:49:18.183350 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b165ce95-1d2f-48db-b61b-16eb574a46d7 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:49:18.185654 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-b165ce95-1d2f-48db-b61b-16eb574a46d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:49:18.241271 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:49:18.265673 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b165ce95-1d2f-48db-b61b-16eb574a46d7 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:49:18.271369 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822a576a-5dd1-4593-b9e9-02421d4cf96a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '428ec99478284743943ed41e9d24a603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfe93ee8d32a441295efc0b885de4bd7', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:49:18.272024 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822a576a-5dd1-4593-b9e9-02421d4cf96a service nova] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:18.272315 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822a576a-5dd1-4593-b9e9-02421d4cf96a service nova] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:18.272596 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822a576a-5dd1-4593-b9e9-02421d4cf96a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:18.281279 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822a576a-5dd1-4593-b9e9-02421d4cf96a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:49:18.282862 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822a576a-5dd1-4593-b9e9-02421d4cf96a service nova] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:49:18.292669 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1325/2636] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 14:49:18 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:49:18.508106 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ba9317-8c41-426d-a229-ad67e4441229 None None] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:49:18.574984 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ba9317-8c41-426d-a229-ad67e4441229 None None] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:49:18.579757 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171fee0f-9778-443f-b0ac-bf147ebd3ff3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:49:18.580639 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171fee0f-9778-443f-b0ac-bf147ebd3ff3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:18.580927 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171fee0f-9778-443f-b0ac-bf147ebd3ff3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:18.581208 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171fee0f-9778-443f-b0ac-bf147ebd3ff3 admin admin] PATH_INFO: `/v3/users/e25d6702b72245b6b9112be67df70416` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:18.582398 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171fee0f-9778-443f-b0ac-bf147ebd3ff3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e25d6702b72245b6b9112be67df70416)` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:49:18.584427 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171fee0f-9778-443f-b0ac-bf147ebd3ff3 admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:49:18.644263 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-171fee0f-9778-443f-b0ac-bf147ebd3ff3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e25d6702b72245b6b9112be67df70416'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:49:18.644839 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-171fee0f-9778-443f-b0ac-bf147ebd3ff3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e25d6702b72245b6b9112be67df70416'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:49:18.645445 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-171fee0f-9778-443f-b0ac-bf147ebd3ff3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e25d6702b72245b6b9112be67df70416'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:49:18.668820 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-171fee0f-9778-443f-b0ac-bf147ebd3ff3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e25d6702b72245b6b9112be67df70416'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:49:18.678832 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-171fee0f-9778-443f-b0ac-bf147ebd3ff3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e25d6702b72245b6b9112be67df70416'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:49:18.693001 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1312/2637] 10.222.0.67 () {58 vars in 1223 bytes} [Wed May 25 14:49:18 2022] DELETE /identity/v3/users/e25d6702b72245b6b9112be67df70416 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:49:18.697805 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7f0dae-af16-470f-8b53-def40d49fb01 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:18.698091 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7f0dae-af16-470f-8b53-def40d49fb01 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:18.698370 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7f0dae-af16-470f-8b53-def40d49fb01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:18.716806 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-0e7f0dae-af16-470f-8b53-def40d49fb01 None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:49:18.718014 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-0e7f0dae-af16-470f-8b53-def40d49fb01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:49:18.784936 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1326/2638] 10.222.0.67 () {58 vars in 957 bytes} [Wed May 25 14:49:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:49:18.798411 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171fee0f-9778-443f-b0ac-bf147ebd3ff3 admin admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:49:18.799933 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-171fee0f-9778-443f-b0ac-bf147ebd3ff3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:49:18.862361 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171fee0f-9778-443f-b0ac-bf147ebd3ff3 admin admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:49:18.866383 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2995e62c-c6b4-4240-97da-a6f8ac5adb43 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b68eed985c7b49839bcdd173186ad4ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfe93ee8d32a441295efc0b885de4bd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:49:18.867075 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2995e62c-c6b4-4240-97da-a6f8ac5adb43 service neutron] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:18.867362 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2995e62c-c6b4-4240-97da-a6f8ac5adb43 service neutron] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:18.867640 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2995e62c-c6b4-4240-97da-a6f8ac5adb43 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:18.879607 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2995e62c-c6b4-4240-97da-a6f8ac5adb43 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:49:18.881051 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2995e62c-c6b4-4240-97da-a6f8ac5adb43 service neutron] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:49:18.892132 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1313/2639] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 14:49:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:49:19.193078 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7f0dae-af16-470f-8b53-def40d49fb01 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:49:19.194628 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-0e7f0dae-af16-470f-8b53-def40d49fb01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:49:19.216346 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7f0dae-af16-470f-8b53-def40d49fb01 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:49:19.228356 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396a1605-6273-4bf0-ba2b-b3297b6a2dc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:49:19.229326 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396a1605-6273-4bf0-ba2b-b3297b6a2dc0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:19.229629 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396a1605-6273-4bf0-ba2b-b3297b6a2dc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:19.229878 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396a1605-6273-4bf0-ba2b-b3297b6a2dc0 admin admin] PATH_INFO: `/v3/projects/5bfffe9178224e61b210f1f4577cb8ab` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:19.231121 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396a1605-6273-4bf0-ba2b-b3297b6a2dc0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5bfffe9178224e61b210f1f4577cb8ab)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:49:19.233092 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396a1605-6273-4bf0-ba2b-b3297b6a2dc0 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:49:19.287652 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-396a1605-6273-4bf0-ba2b-b3297b6a2dc0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5bfffe9178224e61b210f1f4577cb8ab', 'request_id': 'req-396a1605-6273-4bf0-ba2b-b3297b6a2dc0'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:49:19.294674 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-396a1605-6273-4bf0-ba2b-b3297b6a2dc0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5bfffe9178224e61b210f1f4577cb8ab', 'request_id': 'req-396a1605-6273-4bf0-ba2b-b3297b6a2dc0'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:49:19.301425 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-396a1605-6273-4bf0-ba2b-b3297b6a2dc0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5bfffe9178224e61b210f1f4577cb8ab', 'request_id': 'req-396a1605-6273-4bf0-ba2b-b3297b6a2dc0'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:49:19.315475 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-396a1605-6273-4bf0-ba2b-b3297b6a2dc0 admin admin] The token cache is being invalidate because project 5bfffe9178224e61b210f1f4577cb8ab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80475) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 14:49:19.315771 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-396a1605-6273-4bf0-ba2b-b3297b6a2dc0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:49:19.316412 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-396a1605-6273-4bf0-ba2b-b3297b6a2dc0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:49:19.318062 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1327/2640] 10.222.0.67 () {58 vars in 1232 bytes} [Wed May 25 14:49:19 2022] DELETE /identity/v3/projects/5bfffe9178224e61b210f1f4577cb8ab => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:49:19.324632 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe9b458-0641-48c5-bfc7-8f38088cac81 None None] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:19.324921 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe9b458-0641-48c5-bfc7-8f38088cac81 None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:19.325199 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe9b458-0641-48c5-bfc7-8f38088cac81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:19.346100 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.auth.core [None req-1fe9b458-0641-48c5-bfc7-8f38088cac81 None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:49:19.347396 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-1fe9b458-0641-48c5-bfc7-8f38088cac81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:49:19.362212 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:49:19.416200 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1314/2641] 10.222.0.67 () {58 vars in 957 bytes} [Wed May 25 14:49:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:49:19.424605 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e1cf92-a3ba-44df-9fda-da81152ec623 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:19.424900 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e1cf92-a3ba-44df-9fda-da81152ec623 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:19.425188 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e1cf92-a3ba-44df-9fda-da81152ec623 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:19.445082 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-a8e1cf92-a3ba-44df-9fda-da81152ec623 None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:49:19.446202 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-a8e1cf92-a3ba-44df-9fda-da81152ec623 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:49:19.454812 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1328/2642] 10.222.0.67 () {58 vars in 957 bytes} [Wed May 25 14:49:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:49:19.459120 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe9b458-0641-48c5-bfc7-8f38088cac81 None None] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:49:19.469256 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe9b458-0641-48c5-bfc7-8f38088cac81 None None] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:49:19.473793 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038c8943-6a5e-4535-8f7d-c4e680b5d81d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:49:19.474444 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038c8943-6a5e-4535-8f7d-c4e680b5d81d admin admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:19.474724 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038c8943-6a5e-4535-8f7d-c4e680b5d81d admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:19.475014 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038c8943-6a5e-4535-8f7d-c4e680b5d81d admin admin] PATH_INFO: `/v3/domains` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:19.475761 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038c8943-6a5e-4535-8f7d-c4e680b5d81d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:49:19.476068 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038c8943-6a5e-4535-8f7d-c4e680b5d81d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:49:19.477674 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038c8943-6a5e-4535-8f7d-c4e680b5d81d admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:49:19.490021 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1315/2643] 10.222.0.67 () {58 vars in 1152 bytes} [Wed May 25 14:49:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:49:19.494900 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e1cf92-a3ba-44df-9fda-da81152ec623 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:49:19.504599 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e1cf92-a3ba-44df-9fda-da81152ec623 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:49:19.509451 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365f4a12-4ced-45a1-b990-d410024ad351 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:49:19.510735 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365f4a12-4ced-45a1-b990-d410024ad351 admin admin] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:19.511506 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365f4a12-4ced-45a1-b990-d410024ad351 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:19.511506 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365f4a12-4ced-45a1-b990-d410024ad351 admin admin] PATH_INFO: `/v3/projects` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:19.512302 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365f4a12-4ced-45a1-b990-d410024ad351 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:49:19.514242 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365f4a12-4ced-45a1-b990-d410024ad351 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:49:19.541892 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1329/2644] 10.222.0.67 () {60 vars in 1152 bytes} [Wed May 25 14:49:19 2022] POST /identity/v3/projects => generated 405 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:49:19.546476 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038c8943-6a5e-4535-8f7d-c4e680b5d81d admin admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:49:19.557248 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038c8943-6a5e-4535-8f7d-c4e680b5d81d admin admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:49:19.622472 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7076075e-6071-409b-929e-c27d71df7944 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:49:19.623308 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7076075e-6071-409b-929e-c27d71df7944 admin admin] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:19.623735 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7076075e-6071-409b-929e-c27d71df7944 admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:19.624085 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7076075e-6071-409b-929e-c27d71df7944 admin admin] PATH_INFO: `/v3/users` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:19.624965 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7076075e-6071-409b-929e-c27d71df7944 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:49:19.627255 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7076075e-6071-409b-929e-c27d71df7944 admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:49:19.650057 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1316/2645] 10.222.0.67 () {60 vars in 1143 bytes} [Wed May 25 14:49:19 2022] POST /identity/v3/users => generated 303 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 14:49:19.655303 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365f4a12-4ced-45a1-b990-d410024ad351 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:49:19.667977 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365f4a12-4ced-45a1-b990-d410024ad351 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:49:19.672671 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb12ac0-a6d9-4fe3-9c8b-3c0e55029686 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:49:19.673338 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb12ac0-a6d9-4fe3-9c8b-3c0e55029686 admin admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:19.673737 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb12ac0-a6d9-4fe3-9c8b-3c0e55029686 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:19.674025 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb12ac0-a6d9-4fe3-9c8b-3c0e55029686 admin admin] PATH_INFO: `/v3/roles` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:19.674758 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb12ac0-a6d9-4fe3-9c8b-3c0e55029686 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:49:19.676561 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb12ac0-a6d9-4fe3-9c8b-3c0e55029686 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:49:19.687591 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1330/2646] 10.222.0.67 () {58 vars in 1121 bytes} [Wed May 25 14:49:19 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:49:19.693995 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7076075e-6071-409b-929e-c27d71df7944 admin admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:49:19.706580 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7076075e-6071-409b-929e-c27d71df7944 admin admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:49:19.711268 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a319e1-4d7a-48a1-b68a-3a1a68c27a93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:49:19.711935 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a319e1-4d7a-48a1-b68a-3a1a68c27a93 admin admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:19.712227 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a319e1-4d7a-48a1-b68a-3a1a68c27a93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:19.712565 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a319e1-4d7a-48a1-b68a-3a1a68c27a93 admin admin] PATH_INFO: `/v3/roles` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:19.713888 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a319e1-4d7a-48a1-b68a-3a1a68c27a93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:49:19.715629 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a319e1-4d7a-48a1-b68a-3a1a68c27a93 admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:49:19.726111 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1317/2647] 10.222.0.67 () {58 vars in 1121 bytes} [Wed May 25 14:49:19 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:49:19.731643 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb12ac0-a6d9-4fe3-9c8b-3c0e55029686 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:49:19.743964 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb12ac0-a6d9-4fe3-9c8b-3c0e55029686 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:49:19.753367 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a830a7ad-4cf5-4c77-ba84-9d756af24bd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:49:19.754810 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a830a7ad-4cf5-4c77-ba84-9d756af24bd0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:19.755308 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a830a7ad-4cf5-4c77-ba84-9d756af24bd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:19.755753 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a830a7ad-4cf5-4c77-ba84-9d756af24bd0 admin admin] PATH_INFO: `/v3/projects/4069f1ea4e1f4307a0ada846b952db1d/users/05fdffd0254d41b4be6f170ef8407732/roles/48808901834b4d5eab2c7e6b5b03791e` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:19.778087 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a830a7ad-4cf5-4c77-ba84-9d756af24bd0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4069f1ea4e1f4307a0ada846b952db1d, user_id=05fdffd0254d41b4be6f170ef8407732, role_id=48808901834b4d5eab2c7e6b5b03791e)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:49:19.780819 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a830a7ad-4cf5-4c77-ba84-9d756af24bd0 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:49:19.789063 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:49:19.799485 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1331/2648] 10.222.0.67 () {60 vars in 1482 bytes} [Wed May 25 14:49:19 2022] PUT /identity/v3/projects/4069f1ea4e1f4307a0ada846b952db1d/users/05fdffd0254d41b4be6f170ef8407732/roles/48808901834b4d5eab2c7e6b5b03791e => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:49:19.810416 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de0eb42-c825-4649-b2bc-2b20a1f80b6d None None] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:19.810741 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de0eb42-c825-4649-b2bc-2b20a1f80b6d None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:19.811051 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de0eb42-c825-4649-b2bc-2b20a1f80b6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:19.845047 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.auth.core [None req-3de0eb42-c825-4649-b2bc-2b20a1f80b6d None None] MFA Rules not processed for user `05fdffd0254d41b4be6f170ef8407732`. Rule list: `[]` (Enabled: `True`). {{(pid=80474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:49:19.846265 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-3de0eb42-c825-4649-b2bc-2b20a1f80b6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:49:19.922186 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1318/2649] 10.222.0.67 () {58 vars in 957 bytes} [Wed May 25 14:49:19 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:49:19.927808 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a830a7ad-4cf5-4c77-ba84-9d756af24bd0 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:49:19.991961 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a830a7ad-4cf5-4c77-ba84-9d756af24bd0 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:49:19.997388 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bab0dd-c11d-4e67-9980-47c7f85f9c02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:49:19.998046 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bab0dd-c11d-4e67-9980-47c7f85f9c02 admin admin] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:19.998327 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bab0dd-c11d-4e67-9980-47c7f85f9c02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:19.998603 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bab0dd-c11d-4e67-9980-47c7f85f9c02 admin admin] PATH_INFO: `/v3/projects` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:19.999332 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bab0dd-c11d-4e67-9980-47c7f85f9c02 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:49:20.001259 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bab0dd-c11d-4e67-9980-47c7f85f9c02 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:49:20.027042 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1332/2650] 10.222.0.67 () {60 vars in 1152 bytes} [Wed May 25 14:49:19 2022] POST /identity/v3/projects => generated 405 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:49:20.031052 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de0eb42-c825-4649-b2bc-2b20a1f80b6d None None] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:49:20.042971 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de0eb42-c825-4649-b2bc-2b20a1f80b6d None None] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:49:20.055074 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:49:20.103748 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a151278-4f98-4806-b087-637fbabbd6dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:49:20.105154 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a151278-4f98-4806-b087-637fbabbd6dd admin admin] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:20.105463 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a151278-4f98-4806-b087-637fbabbd6dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:20.105729 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a151278-4f98-4806-b087-637fbabbd6dd admin admin] PATH_INFO: `/v3/users` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:20.106427 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a151278-4f98-4806-b087-637fbabbd6dd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:49:20.108371 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a151278-4f98-4806-b087-637fbabbd6dd admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:49:20.128588 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1319/2651] 10.222.0.67 () {60 vars in 1143 bytes} [Wed May 25 14:49:20 2022] POST /identity/v3/users => generated 309 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:49:20.132548 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bab0dd-c11d-4e67-9980-47c7f85f9c02 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:49:20.143269 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bab0dd-c11d-4e67-9980-47c7f85f9c02 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:49:20.147840 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985c91af-e845-48bc-a53f-76f56a93e144 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:49:20.148496 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985c91af-e845-48bc-a53f-76f56a93e144 admin admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:20.148778 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985c91af-e845-48bc-a53f-76f56a93e144 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:20.149059 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985c91af-e845-48bc-a53f-76f56a93e144 admin admin] PATH_INFO: `/v3/roles` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:20.149779 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985c91af-e845-48bc-a53f-76f56a93e144 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:49:20.151945 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985c91af-e845-48bc-a53f-76f56a93e144 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:49:20.162804 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1333/2652] 10.222.0.67 () {58 vars in 1121 bytes} [Wed May 25 14:49:20 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:49:20.168073 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a151278-4f98-4806-b087-637fbabbd6dd admin admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:49:20.178541 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a151278-4f98-4806-b087-637fbabbd6dd admin admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:49:20.184364 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0028ab9-60a4-4940-8cea-67c8e6f208be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:49:20.185281 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0028ab9-60a4-4940-8cea-67c8e6f208be admin admin] REQUEST_METHOD: `PUT` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:20.185568 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0028ab9-60a4-4940-8cea-67c8e6f208be admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:20.185856 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0028ab9-60a4-4940-8cea-67c8e6f208be admin admin] PATH_INFO: `/v3/projects/4c4af683d6ff48ddab8c2cfbefb8533c/users/3d9702b84fa0412b83ee70ba31a50995/roles/399893e19eac4ab5a8e596f7c07be13c` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:20.204296 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0028ab9-60a4-4940-8cea-67c8e6f208be admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c4af683d6ff48ddab8c2cfbefb8533c, user_id=3d9702b84fa0412b83ee70ba31a50995, role_id=399893e19eac4ab5a8e596f7c07be13c)` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:49:20.207051 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0028ab9-60a4-4940-8cea-67c8e6f208be admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:49:20.222083 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1320/2653] 10.222.0.67 () {60 vars in 1482 bytes} [Wed May 25 14:49:20 2022] PUT /identity/v3/projects/4c4af683d6ff48ddab8c2cfbefb8533c/users/3d9702b84fa0412b83ee70ba31a50995/roles/399893e19eac4ab5a8e596f7c07be13c => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 14:49:20.226309 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985c91af-e845-48bc-a53f-76f56a93e144 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:49:20.236763 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985c91af-e845-48bc-a53f-76f56a93e144 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:49:20.306336 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322e6425-6ab7-4282-899b-467ff80fac9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:49:20.307590 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322e6425-6ab7-4282-899b-467ff80fac9a admin admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:20.307885 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322e6425-6ab7-4282-899b-467ff80fac9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:20.308178 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322e6425-6ab7-4282-899b-467ff80fac9a admin admin] PATH_INFO: `/v3/roles` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:20.308909 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322e6425-6ab7-4282-899b-467ff80fac9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:49:20.310537 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322e6425-6ab7-4282-899b-467ff80fac9a admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:49:20.321259 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1334/2654] 10.222.0.67 () {58 vars in 1121 bytes} [Wed May 25 14:49:20 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:49:20.326698 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0028ab9-60a4-4940-8cea-67c8e6f208be admin admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:49:20.337339 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0028ab9-60a4-4940-8cea-67c8e6f208be admin admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:49:20.342601 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a22ef4-57d0-4523-b613-d909c3aab371 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:49:20.343544 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a22ef4-57d0-4523-b613-d909c3aab371 admin admin] REQUEST_METHOD: `PUT` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:20.343855 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a22ef4-57d0-4523-b613-d909c3aab371 admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:20.344138 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a22ef4-57d0-4523-b613-d909c3aab371 admin admin] PATH_INFO: `/v3/projects/4c4af683d6ff48ddab8c2cfbefb8533c/users/3d9702b84fa0412b83ee70ba31a50995/roles/399893e19eac4ab5a8e596f7c07be13c` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:20.346168 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a22ef4-57d0-4523-b613-d909c3aab371 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c4af683d6ff48ddab8c2cfbefb8533c, user_id=3d9702b84fa0412b83ee70ba31a50995, role_id=399893e19eac4ab5a8e596f7c07be13c)` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:49:20.348909 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a22ef4-57d0-4523-b613-d909c3aab371 admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:49:20.360607 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1321/2655] 10.222.0.67 () {60 vars in 1482 bytes} [Wed May 25 14:49:20 2022] PUT /identity/v3/projects/4c4af683d6ff48ddab8c2cfbefb8533c/users/3d9702b84fa0412b83ee70ba31a50995/roles/399893e19eac4ab5a8e596f7c07be13c => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:49:20.373188 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2984581-e298-48ce-a4a0-2f2101e31c27 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:20.373638 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2984581-e298-48ce-a4a0-2f2101e31c27 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:20.373912 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2984581-e298-48ce-a4a0-2f2101e31c27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:20.406251 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-f2984581-e298-48ce-a4a0-2f2101e31c27 None None] MFA Rules not processed for user `3d9702b84fa0412b83ee70ba31a50995`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:49:20.407516 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-f2984581-e298-48ce-a4a0-2f2101e31c27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:49:20.469211 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:49:20.481337 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1335/2656] 10.222.0.67 () {58 vars in 957 bytes} [Wed May 25 14:49:20 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:49:20.491771 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a22ef4-57d0-4523-b613-d909c3aab371 admin admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:49:20.493470 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-87a22ef4-57d0-4523-b613-d909c3aab371 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:49:20.556124 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a22ef4-57d0-4523-b613-d909c3aab371 admin admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:49:20.560442 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2d149b-ebb9-41e9-9cce-e14f37c8344c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e462acc9da84a61bb23998dd54e1858', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfe93ee8d32a441295efc0b885de4bd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:49:20.561030 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2d149b-ebb9-41e9-9cce-e14f37c8344c service cinder] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:20.561318 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2d149b-ebb9-41e9-9cce-e14f37c8344c service cinder] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:20.561596 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2d149b-ebb9-41e9-9cce-e14f37c8344c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:20.570566 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2d149b-ebb9-41e9-9cce-e14f37c8344c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:49:20.572036 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2d149b-ebb9-41e9-9cce-e14f37c8344c service cinder] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:49:20.582494 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1322/2657] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 14:49:20 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:49:20.745880 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2984581-e298-48ce-a4a0-2f2101e31c27 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:49:20.806354 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2984581-e298-48ce-a4a0-2f2101e31c27 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:49:20.811869 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a176dcb-4744-4870-8613-49b368eb968a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:49:20.812668 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a176dcb-4744-4870-8613-49b368eb968a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:20.812952 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a176dcb-4744-4870-8613-49b368eb968a admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:20.813291 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a176dcb-4744-4870-8613-49b368eb968a admin admin] PATH_INFO: `/v3/users/05fdffd0254d41b4be6f170ef8407732` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:20.814478 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a176dcb-4744-4870-8613-49b368eb968a admin admin] RBAC: Authorizing `identity:delete_user(user_id=05fdffd0254d41b4be6f170ef8407732)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:49:20.816430 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a176dcb-4744-4870-8613-49b368eb968a admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:49:20.863264 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-9a176dcb-4744-4870-8613-49b368eb968a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '05fdffd0254d41b4be6f170ef8407732'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:49:20.870810 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-9a176dcb-4744-4870-8613-49b368eb968a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '05fdffd0254d41b4be6f170ef8407732'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:49:20.871463 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-9a176dcb-4744-4870-8613-49b368eb968a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '05fdffd0254d41b4be6f170ef8407732'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:49:20.878223 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-9a176dcb-4744-4870-8613-49b368eb968a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '05fdffd0254d41b4be6f170ef8407732'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:49:20.890332 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-9a176dcb-4744-4870-8613-49b368eb968a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '05fdffd0254d41b4be6f170ef8407732'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:49:20.896284 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1336/2658] 10.222.0.67 () {58 vars in 1223 bytes} [Wed May 25 14:49:20 2022] DELETE /identity/v3/users/05fdffd0254d41b4be6f170ef8407732 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:49:20.901333 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73baff44-a940-4c57-a28a-a896aefa976c None None] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:20.901625 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73baff44-a940-4c57-a28a-a896aefa976c None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:20.901901 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73baff44-a940-4c57-a28a-a896aefa976c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:20.921498 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.auth.core [None req-73baff44-a940-4c57-a28a-a896aefa976c None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:49:20.922697 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-73baff44-a940-4c57-a28a-a896aefa976c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:49:20.983745 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1323/2659] 10.222.0.67 () {58 vars in 957 bytes} [Wed May 25 14:49:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:49:20.993413 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a176dcb-4744-4870-8613-49b368eb968a admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:49:20.994827 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-9a176dcb-4744-4870-8613-49b368eb968a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:49:21.053851 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a176dcb-4744-4870-8613-49b368eb968a admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:49:21.057677 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3a00f3-b15b-4c1a-869f-a0734593882e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b68eed985c7b49839bcdd173186ad4ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfe93ee8d32a441295efc0b885de4bd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:49:21.058326 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3a00f3-b15b-4c1a-869f-a0734593882e service neutron] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:21.058608 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3a00f3-b15b-4c1a-869f-a0734593882e service neutron] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:21.058881 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3a00f3-b15b-4c1a-869f-a0734593882e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:21.068703 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3a00f3-b15b-4c1a-869f-a0734593882e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:49:21.070066 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3a00f3-b15b-4c1a-869f-a0734593882e service neutron] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:49:21.080251 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1337/2660] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 14:49:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:49:21.370433 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73baff44-a940-4c57-a28a-a896aefa976c None None] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:49:21.372472 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-73baff44-a940-4c57-a28a-a896aefa976c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:49:21.392193 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73baff44-a940-4c57-a28a-a896aefa976c None None] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:49:21.401632 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0470c4c-4f8f-4eb3-95b7-4ee48fd163b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:49:21.403157 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0470c4c-4f8f-4eb3-95b7-4ee48fd163b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:21.403352 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0470c4c-4f8f-4eb3-95b7-4ee48fd163b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:21.403712 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0470c4c-4f8f-4eb3-95b7-4ee48fd163b7 admin admin] PATH_INFO: `/v3/projects/4069f1ea4e1f4307a0ada846b952db1d` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:21.405352 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0470c4c-4f8f-4eb3-95b7-4ee48fd163b7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4069f1ea4e1f4307a0ada846b952db1d)` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:49:21.407705 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0470c4c-4f8f-4eb3-95b7-4ee48fd163b7 admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:49:21.414686 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:49:21.458411 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-c0470c4c-4f8f-4eb3-95b7-4ee48fd163b7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4069f1ea4e1f4307a0ada846b952db1d', 'request_id': 'req-c0470c4c-4f8f-4eb3-95b7-4ee48fd163b7'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:49:21.466725 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-c0470c4c-4f8f-4eb3-95b7-4ee48fd163b7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4069f1ea4e1f4307a0ada846b952db1d', 'request_id': 'req-c0470c4c-4f8f-4eb3-95b7-4ee48fd163b7'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:49:21.473911 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-c0470c4c-4f8f-4eb3-95b7-4ee48fd163b7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4069f1ea4e1f4307a0ada846b952db1d', 'request_id': 'req-c0470c4c-4f8f-4eb3-95b7-4ee48fd163b7'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:49:21.485976 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-c0470c4c-4f8f-4eb3-95b7-4ee48fd163b7 admin admin] The token cache is being invalidate because project 4069f1ea4e1f4307a0ada846b952db1d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80474) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 14:49:21.486271 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-c0470c4c-4f8f-4eb3-95b7-4ee48fd163b7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:49:21.486961 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-c0470c4c-4f8f-4eb3-95b7-4ee48fd163b7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:49:21.488554 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1324/2661] 10.222.0.67 () {58 vars in 1232 bytes} [Wed May 25 14:49:21 2022] DELETE /identity/v3/projects/4069f1ea4e1f4307a0ada846b952db1d => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:49:21.492668 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3a00f3-b15b-4c1a-869f-a0734593882e service neutron] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:49:21.502535 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3a00f3-b15b-4c1a-869f-a0734593882e service neutron] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:49:21.515085 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:49:21.562112 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ded7aa8-3403-41bf-955e-925e07bbe069 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:49:21.562977 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ded7aa8-3403-41bf-955e-925e07bbe069 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:21.563286 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ded7aa8-3403-41bf-955e-925e07bbe069 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:21.563561 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ded7aa8-3403-41bf-955e-925e07bbe069 admin admin] PATH_INFO: `/v3/users/3d9702b84fa0412b83ee70ba31a50995` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:21.564737 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ded7aa8-3403-41bf-955e-925e07bbe069 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3d9702b84fa0412b83ee70ba31a50995)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:49:21.566642 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ded7aa8-3403-41bf-955e-925e07bbe069 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:49:21.614162 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-6ded7aa8-3403-41bf-955e-925e07bbe069 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3d9702b84fa0412b83ee70ba31a50995'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:49:21.622583 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-6ded7aa8-3403-41bf-955e-925e07bbe069 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3d9702b84fa0412b83ee70ba31a50995'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:49:21.623227 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-6ded7aa8-3403-41bf-955e-925e07bbe069 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3d9702b84fa0412b83ee70ba31a50995'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:49:21.630272 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-6ded7aa8-3403-41bf-955e-925e07bbe069 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3d9702b84fa0412b83ee70ba31a50995'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:49:21.642861 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-6ded7aa8-3403-41bf-955e-925e07bbe069 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3d9702b84fa0412b83ee70ba31a50995'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:49:21.648838 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1338/2662] 10.222.0.67 () {58 vars in 1223 bytes} [Wed May 25 14:49:21 2022] DELETE /identity/v3/users/3d9702b84fa0412b83ee70ba31a50995 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:49:21.929572 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0470c4c-4f8f-4eb3-95b7-4ee48fd163b7 admin admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:49:21.931175 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-c0470c4c-4f8f-4eb3-95b7-4ee48fd163b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:49:21.945169 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0470c4c-4f8f-4eb3-95b7-4ee48fd163b7 admin admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:49:22.009526 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50df029e-2b3a-4284-9ce0-d568efa1f67e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:49:22.011027 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50df029e-2b3a-4284-9ce0-d568efa1f67e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:22.011394 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50df029e-2b3a-4284-9ce0-d568efa1f67e admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:22.011977 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50df029e-2b3a-4284-9ce0-d568efa1f67e admin admin] PATH_INFO: `/v3/projects/4c4af683d6ff48ddab8c2cfbefb8533c` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:22.013216 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50df029e-2b3a-4284-9ce0-d568efa1f67e admin admin] RBAC: Authorizing `identity:delete_project(project_id=4c4af683d6ff48ddab8c2cfbefb8533c)` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:49:22.015215 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50df029e-2b3a-4284-9ce0-d568efa1f67e admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:49:22.067724 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-50df029e-2b3a-4284-9ce0-d568efa1f67e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4c4af683d6ff48ddab8c2cfbefb8533c', 'request_id': 'req-50df029e-2b3a-4284-9ce0-d568efa1f67e'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:49:22.076290 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-50df029e-2b3a-4284-9ce0-d568efa1f67e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4c4af683d6ff48ddab8c2cfbefb8533c', 'request_id': 'req-50df029e-2b3a-4284-9ce0-d568efa1f67e'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:49:22.083595 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-50df029e-2b3a-4284-9ce0-d568efa1f67e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4c4af683d6ff48ddab8c2cfbefb8533c', 'request_id': 'req-50df029e-2b3a-4284-9ce0-d568efa1f67e'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:49:22.094782 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-50df029e-2b3a-4284-9ce0-d568efa1f67e admin admin] The token cache is being invalidate because project 4c4af683d6ff48ddab8c2cfbefb8533c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80474) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 14:49:22.095095 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-50df029e-2b3a-4284-9ce0-d568efa1f67e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:49:22.095755 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-50df029e-2b3a-4284-9ce0-d568efa1f67e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:49:22.097267 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1325/2663] 10.222.0.67 () {58 vars in 1232 bytes} [Wed May 25 14:49:21 2022] DELETE /identity/v3/projects/4c4af683d6ff48ddab8c2cfbefb8533c => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:49:22.102252 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb897609-d05e-4954-be7b-f1fe4dfab2b5 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:22.102594 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb897609-d05e-4954-be7b-f1fe4dfab2b5 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:22.102881 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb897609-d05e-4954-be7b-f1fe4dfab2b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:22.122404 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-eb897609-d05e-4954-be7b-f1fe4dfab2b5 None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:49:22.123537 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-eb897609-d05e-4954-be7b-f1fe4dfab2b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:49:22.184234 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1339/2664] 10.222.0.67 () {58 vars in 957 bytes} [Wed May 25 14:49:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:49:22.191887 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf41ac8-c787-4ee5-8b8e-04786d672496 None None] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:22.192182 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf41ac8-c787-4ee5-8b8e-04786d672496 None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:22.192497 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf41ac8-c787-4ee5-8b8e-04786d672496 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:22.212224 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.auth.core [None req-ebf41ac8-c787-4ee5-8b8e-04786d672496 None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:49:22.213495 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-ebf41ac8-c787-4ee5-8b8e-04786d672496 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:49:22.223050 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1326/2665] 10.222.0.67 () {58 vars in 957 bytes} [Wed May 25 14:49:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:49:22.227141 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb897609-d05e-4954-be7b-f1fe4dfab2b5 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:49:22.236961 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb897609-d05e-4954-be7b-f1fe4dfab2b5 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:49:22.241719 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718d4000-c768-477d-bdfa-f4cc1eab9192 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:49:22.242377 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718d4000-c768-477d-bdfa-f4cc1eab9192 admin admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:22.242773 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718d4000-c768-477d-bdfa-f4cc1eab9192 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:22.243041 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718d4000-c768-477d-bdfa-f4cc1eab9192 admin admin] PATH_INFO: `/v3/domains` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:22.244011 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718d4000-c768-477d-bdfa-f4cc1eab9192 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:49:22.244132 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718d4000-c768-477d-bdfa-f4cc1eab9192 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:49:22.246483 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718d4000-c768-477d-bdfa-f4cc1eab9192 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:49:22.258533 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1340/2666] 10.222.0.67 () {58 vars in 1152 bytes} [Wed May 25 14:49:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:49:22.264153 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf41ac8-c787-4ee5-8b8e-04786d672496 None None] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:49:22.273839 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf41ac8-c787-4ee5-8b8e-04786d672496 None None] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:49:22.282206 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f9adba-c762-485f-8f33-5b34f1849147 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:49:22.282892 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f9adba-c762-485f-8f33-5b34f1849147 admin admin] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:22.283208 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f9adba-c762-485f-8f33-5b34f1849147 admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:22.283488 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f9adba-c762-485f-8f33-5b34f1849147 admin admin] PATH_INFO: `/v3/projects` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:22.284200 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f9adba-c762-485f-8f33-5b34f1849147 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:49:22.286135 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f9adba-c762-485f-8f33-5b34f1849147 admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:49:22.301516 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:49:22.315538 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1327/2667] 10.222.0.67 () {60 vars in 1152 bytes} [Wed May 25 14:49:22 2022] POST /identity/v3/projects => generated 371 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:49:22.319749 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718d4000-c768-477d-bdfa-f4cc1eab9192 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:49:22.330198 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718d4000-c768-477d-bdfa-f4cc1eab9192 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:49:22.350374 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:49:22.396093 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd6eb27-bd58-4fec-b543-aeda9b47214b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:49:22.396651 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd6eb27-bd58-4fec-b543-aeda9b47214b admin admin] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:22.396932 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd6eb27-bd58-4fec-b543-aeda9b47214b admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:22.397205 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd6eb27-bd58-4fec-b543-aeda9b47214b admin admin] PATH_INFO: `/v3/users` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:22.397897 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd6eb27-bd58-4fec-b543-aeda9b47214b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:49:22.399930 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd6eb27-bd58-4fec-b543-aeda9b47214b admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:49:22.427687 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1341/2668] 10.222.0.67 () {60 vars in 1143 bytes} [Wed May 25 14:49:22 2022] POST /identity/v3/users => generated 286 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 14:49:22.432977 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f9adba-c762-485f-8f33-5b34f1849147 admin admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:49:22.447267 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f9adba-c762-485f-8f33-5b34f1849147 admin admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:49:22.452541 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575d9750-3c32-424b-a4f7-7fa9d924209d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:49:22.453219 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575d9750-3c32-424b-a4f7-7fa9d924209d admin admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:22.453503 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575d9750-3c32-424b-a4f7-7fa9d924209d admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:22.453779 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575d9750-3c32-424b-a4f7-7fa9d924209d admin admin] PATH_INFO: `/v3/roles` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:22.454608 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575d9750-3c32-424b-a4f7-7fa9d924209d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:49:22.456420 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575d9750-3c32-424b-a4f7-7fa9d924209d admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:49:22.470410 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1328/2669] 10.222.0.67 () {58 vars in 1121 bytes} [Wed May 25 14:49:22 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 25 14:49:22.474448 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd6eb27-bd58-4fec-b543-aeda9b47214b admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:49:22.485403 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd6eb27-bd58-4fec-b543-aeda9b47214b admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:49:22.490078 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e651853-0eab-4c98-8fa0-4270ff822fef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:49:22.491316 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e651853-0eab-4c98-8fa0-4270ff822fef admin admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:22.491316 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e651853-0eab-4c98-8fa0-4270ff822fef admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:22.491564 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e651853-0eab-4c98-8fa0-4270ff822fef admin admin] PATH_INFO: `/v3/roles` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:22.492137 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e651853-0eab-4c98-8fa0-4270ff822fef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:49:22.493756 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e651853-0eab-4c98-8fa0-4270ff822fef admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:49:22.505291 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1342/2670] 10.222.0.67 () {58 vars in 1121 bytes} [Wed May 25 14:49:22 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:49:22.509642 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575d9750-3c32-424b-a4f7-7fa9d924209d admin admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:49:22.521696 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575d9750-3c32-424b-a4f7-7fa9d924209d admin admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:49:22.526793 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063444c1-253e-42ea-93ac-ca520adf0238 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:49:22.528288 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063444c1-253e-42ea-93ac-ca520adf0238 admin admin] REQUEST_METHOD: `PUT` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:22.528583 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063444c1-253e-42ea-93ac-ca520adf0238 admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:22.528866 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063444c1-253e-42ea-93ac-ca520adf0238 admin admin] PATH_INFO: `/v3/projects/8bcf1dfb2ddd4a47a9cecf2acd3757ae/users/9657fff65d034af1951e7fb42cc76921/roles/48808901834b4d5eab2c7e6b5b03791e` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:22.545651 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063444c1-253e-42ea-93ac-ca520adf0238 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8bcf1dfb2ddd4a47a9cecf2acd3757ae, user_id=9657fff65d034af1951e7fb42cc76921, role_id=48808901834b4d5eab2c7e6b5b03791e)` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:49:22.548354 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063444c1-253e-42ea-93ac-ca520adf0238 admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:49:22.563018 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1329/2671] 10.222.0.67 () {60 vars in 1482 bytes} [Wed May 25 14:49:22 2022] PUT /identity/v3/projects/8bcf1dfb2ddd4a47a9cecf2acd3757ae/users/9657fff65d034af1951e7fb42cc76921/roles/48808901834b4d5eab2c7e6b5b03791e => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:49:22.575819 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de886e4e-170f-49f4-b651-14d24cc1d1e8 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:22.576162 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de886e4e-170f-49f4-b651-14d24cc1d1e8 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:22.576503 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de886e4e-170f-49f4-b651-14d24cc1d1e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:22.605424 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-de886e4e-170f-49f4-b651-14d24cc1d1e8 None None] MFA Rules not processed for user `9657fff65d034af1951e7fb42cc76921`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:49:22.606644 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-de886e4e-170f-49f4-b651-14d24cc1d1e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:49:22.673821 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1343/2672] 10.222.0.67 () {58 vars in 957 bytes} [Wed May 25 14:49:22 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:49:22.680323 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063444c1-253e-42ea-93ac-ca520adf0238 admin admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:49:22.747371 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063444c1-253e-42ea-93ac-ca520adf0238 admin admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:49:22.752012 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a5e2b9-e326-4e9b-adc5-f81827f72baf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:49:22.752671 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a5e2b9-e326-4e9b-adc5-f81827f72baf admin admin] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:22.752959 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a5e2b9-e326-4e9b-adc5-f81827f72baf admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:22.753325 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a5e2b9-e326-4e9b-adc5-f81827f72baf admin admin] PATH_INFO: `/v3/projects` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:22.753926 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a5e2b9-e326-4e9b-adc5-f81827f72baf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:49:22.755857 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a5e2b9-e326-4e9b-adc5-f81827f72baf admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:49:22.784460 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1330/2673] 10.222.0.67 () {60 vars in 1152 bytes} [Wed May 25 14:49:22 2022] POST /identity/v3/projects => generated 373 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:49:22.788506 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de886e4e-170f-49f4-b651-14d24cc1d1e8 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:49:22.799541 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de886e4e-170f-49f4-b651-14d24cc1d1e8 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:49:22.863909 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53752b9-2c7a-44e9-98d9-0e531df6f94b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:49:22.864622 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53752b9-2c7a-44e9-98d9-0e531df6f94b admin admin] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:22.864915 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53752b9-2c7a-44e9-98d9-0e531df6f94b admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:22.865197 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53752b9-2c7a-44e9-98d9-0e531df6f94b admin admin] PATH_INFO: `/v3/users` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:22.865907 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53752b9-2c7a-44e9-98d9-0e531df6f94b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:49:22.867859 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53752b9-2c7a-44e9-98d9-0e531df6f94b admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:49:22.890118 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1344/2674] 10.222.0.67 () {60 vars in 1143 bytes} [Wed May 25 14:49:22 2022] POST /identity/v3/users => generated 293 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:49:22.893964 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a5e2b9-e326-4e9b-adc5-f81827f72baf admin admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:49:22.905857 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a5e2b9-e326-4e9b-adc5-f81827f72baf admin admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:49:22.910565 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e58576f-b817-4076-bbe1-7a065d21fa8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:49:22.911277 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e58576f-b817-4076-bbe1-7a065d21fa8a admin admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:22.911565 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e58576f-b817-4076-bbe1-7a065d21fa8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:22.911848 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e58576f-b817-4076-bbe1-7a065d21fa8a admin admin] PATH_INFO: `/v3/roles` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:22.912588 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e58576f-b817-4076-bbe1-7a065d21fa8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:49:22.914203 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e58576f-b817-4076-bbe1-7a065d21fa8a admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:49:22.928211 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1331/2675] 10.222.0.67 () {58 vars in 1121 bytes} [Wed May 25 14:49:22 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:49:22.933025 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53752b9-2c7a-44e9-98d9-0e531df6f94b admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:49:22.943502 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53752b9-2c7a-44e9-98d9-0e531df6f94b admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:49:22.948859 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212cd314-e81d-4197-aec8-091e3c705500 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:49:22.949756 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212cd314-e81d-4197-aec8-091e3c705500 admin admin] REQUEST_METHOD: `PUT` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:22.950041 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212cd314-e81d-4197-aec8-091e3c705500 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:22.950319 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212cd314-e81d-4197-aec8-091e3c705500 admin admin] PATH_INFO: `/v3/projects/249ce0a635fc40b281a6e594c4ea7539/users/b8be9ac348044226bb5576617901217f/roles/399893e19eac4ab5a8e596f7c07be13c` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:22.968556 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212cd314-e81d-4197-aec8-091e3c705500 admin admin] RBAC: Authorizing `identity:create_grant(project_id=249ce0a635fc40b281a6e594c4ea7539, user_id=b8be9ac348044226bb5576617901217f, role_id=399893e19eac4ab5a8e596f7c07be13c)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:49:22.971238 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212cd314-e81d-4197-aec8-091e3c705500 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:49:22.974407 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:49:22.990866 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1345/2676] 10.222.0.67 () {60 vars in 1482 bytes} [Wed May 25 14:49:22 2022] PUT /identity/v3/projects/249ce0a635fc40b281a6e594c4ea7539/users/b8be9ac348044226bb5576617901217f/roles/399893e19eac4ab5a8e596f7c07be13c => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:49:22.996566 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e58576f-b817-4076-bbe1-7a065d21fa8a admin admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:49:23.006888 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e58576f-b817-4076-bbe1-7a065d21fa8a admin admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:49:23.073483 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e496c8d-54be-4f24-96b6-eac989711959 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:49:23.074247 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e496c8d-54be-4f24-96b6-eac989711959 admin admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:23.074535 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e496c8d-54be-4f24-96b6-eac989711959 admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:23.074814 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e496c8d-54be-4f24-96b6-eac989711959 admin admin] PATH_INFO: `/v3/roles` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:23.075592 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e496c8d-54be-4f24-96b6-eac989711959 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:49:23.077204 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e496c8d-54be-4f24-96b6-eac989711959 admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:49:23.087440 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1332/2677] 10.222.0.67 () {58 vars in 1121 bytes} [Wed May 25 14:49:22 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 25 14:49:23.092201 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212cd314-e81d-4197-aec8-091e3c705500 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:49:23.102849 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212cd314-e81d-4197-aec8-091e3c705500 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:49:23.108463 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cf87ec-9008-4bc4-b34b-c266622d8069 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:49:23.109352 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cf87ec-9008-4bc4-b34b-c266622d8069 admin admin] REQUEST_METHOD: `PUT` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:23.109630 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cf87ec-9008-4bc4-b34b-c266622d8069 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:23.109903 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cf87ec-9008-4bc4-b34b-c266622d8069 admin admin] PATH_INFO: `/v3/projects/249ce0a635fc40b281a6e594c4ea7539/users/b8be9ac348044226bb5576617901217f/roles/399893e19eac4ab5a8e596f7c07be13c` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:23.111994 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60cf87ec-9008-4bc4-b34b-c266622d8069 admin admin] RBAC: Authorizing `identity:create_grant(project_id=249ce0a635fc40b281a6e594c4ea7539, user_id=b8be9ac348044226bb5576617901217f, role_id=399893e19eac4ab5a8e596f7c07be13c)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:49:23.116063 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60cf87ec-9008-4bc4-b34b-c266622d8069 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:49:23.129618 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1346/2678] 10.222.0.67 () {60 vars in 1482 bytes} [Wed May 25 14:49:23 2022] PUT /identity/v3/projects/249ce0a635fc40b281a6e594c4ea7539/users/b8be9ac348044226bb5576617901217f/roles/399893e19eac4ab5a8e596f7c07be13c => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:49:23.142280 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd5408a-d0ec-43ed-8aae-46666de818e4 None None] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:23.142568 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd5408a-d0ec-43ed-8aae-46666de818e4 None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:23.142876 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd5408a-d0ec-43ed-8aae-46666de818e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:23.172206 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.auth.core [None req-1dd5408a-d0ec-43ed-8aae-46666de818e4 None None] MFA Rules not processed for user `b8be9ac348044226bb5576617901217f`. Rule list: `[]` (Enabled: `True`). {{(pid=80474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:49:23.173414 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-1dd5408a-d0ec-43ed-8aae-46666de818e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:49:23.192251 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:49:23.249958 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1333/2679] 10.222.0.67 () {58 vars in 957 bytes} [Wed May 25 14:49:23 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 14:49:23.262980 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cf87ec-9008-4bc4-b34b-c266622d8069 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:49:23.264739 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-60cf87ec-9008-4bc4-b34b-c266622d8069 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:49:23.323229 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cf87ec-9008-4bc4-b34b-c266622d8069 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:49:23.327381 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe697670-ecfa-4d6e-ae0a-38f3dd7c42c5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e462acc9da84a61bb23998dd54e1858', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfe93ee8d32a441295efc0b885de4bd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:49:23.328047 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe697670-ecfa-4d6e-ae0a-38f3dd7c42c5 service cinder] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:23.328336 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe697670-ecfa-4d6e-ae0a-38f3dd7c42c5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:23.328617 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe697670-ecfa-4d6e-ae0a-38f3dd7c42c5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:23.339155 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe697670-ecfa-4d6e-ae0a-38f3dd7c42c5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:49:23.340621 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe697670-ecfa-4d6e-ae0a-38f3dd7c42c5 service cinder] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:49:23.350797 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1347/2680] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 14:49:23 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:49:23.771464 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd5408a-d0ec-43ed-8aae-46666de818e4 None None] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:49:23.848957 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd5408a-d0ec-43ed-8aae-46666de818e4 None None] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:49:23.854058 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14cb83e-6d04-4d8d-a361-90d8c307d71b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:49:23.855357 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14cb83e-6d04-4d8d-a361-90d8c307d71b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:23.855637 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14cb83e-6d04-4d8d-a361-90d8c307d71b admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:23.855909 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14cb83e-6d04-4d8d-a361-90d8c307d71b admin admin] PATH_INFO: `/v3/users/9657fff65d034af1951e7fb42cc76921` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:23.857151 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14cb83e-6d04-4d8d-a361-90d8c307d71b admin admin] RBAC: Authorizing `identity:delete_user(user_id=9657fff65d034af1951e7fb42cc76921)` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:49:23.859111 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14cb83e-6d04-4d8d-a361-90d8c307d71b admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:49:23.913108 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-e14cb83e-6d04-4d8d-a361-90d8c307d71b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9657fff65d034af1951e7fb42cc76921'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:49:23.913784 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-e14cb83e-6d04-4d8d-a361-90d8c307d71b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9657fff65d034af1951e7fb42cc76921'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:49:23.914396 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-e14cb83e-6d04-4d8d-a361-90d8c307d71b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9657fff65d034af1951e7fb42cc76921'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:49:23.928044 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-e14cb83e-6d04-4d8d-a361-90d8c307d71b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9657fff65d034af1951e7fb42cc76921'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:49:23.935749 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-e14cb83e-6d04-4d8d-a361-90d8c307d71b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9657fff65d034af1951e7fb42cc76921'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:49:23.949235 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1334/2681] 10.222.0.67 () {58 vars in 1223 bytes} [Wed May 25 14:49:23 2022] DELETE /identity/v3/users/9657fff65d034af1951e7fb42cc76921 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:49:23.953797 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930a4532-fd60-4984-8b73-a8ef63dda1ab None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:23.954337 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930a4532-fd60-4984-8b73-a8ef63dda1ab None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:23.954451 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930a4532-fd60-4984-8b73-a8ef63dda1ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:23.972963 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-930a4532-fd60-4984-8b73-a8ef63dda1ab None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:49:23.974171 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-930a4532-fd60-4984-8b73-a8ef63dda1ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:49:24.037052 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1348/2682] 10.222.0.67 () {58 vars in 957 bytes} [Wed May 25 14:49:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:49:24.047447 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14cb83e-6d04-4d8d-a361-90d8c307d71b admin admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:49:24.048917 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-e14cb83e-6d04-4d8d-a361-90d8c307d71b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:49:24.089317 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:49:24.108489 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14cb83e-6d04-4d8d-a361-90d8c307d71b admin admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:49:24.112128 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739558e1-de84-463d-9a03-b607e6e2752a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b68eed985c7b49839bcdd173186ad4ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfe93ee8d32a441295efc0b885de4bd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:49:24.112779 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739558e1-de84-463d-9a03-b607e6e2752a service neutron] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:24.113067 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739558e1-de84-463d-9a03-b607e6e2752a service neutron] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:24.113348 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739558e1-de84-463d-9a03-b607e6e2752a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:24.124106 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739558e1-de84-463d-9a03-b607e6e2752a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:49:24.125559 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739558e1-de84-463d-9a03-b607e6e2752a service neutron] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:49:24.135881 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1335/2683] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 14:49:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:49:24.635888 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930a4532-fd60-4984-8b73-a8ef63dda1ab None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:49:24.637676 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-930a4532-fd60-4984-8b73-a8ef63dda1ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:49:24.650068 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930a4532-fd60-4984-8b73-a8ef63dda1ab None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:49:24.655462 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe82aa4-2c64-44f7-99ce-6c5789f682ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:49:24.656404 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe82aa4-2c64-44f7-99ce-6c5789f682ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:24.656628 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe82aa4-2c64-44f7-99ce-6c5789f682ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:24.656903 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe82aa4-2c64-44f7-99ce-6c5789f682ff admin admin] PATH_INFO: `/v3/projects/8bcf1dfb2ddd4a47a9cecf2acd3757ae` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:24.658294 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe82aa4-2c64-44f7-99ce-6c5789f682ff admin admin] RBAC: Authorizing `identity:delete_project(project_id=8bcf1dfb2ddd4a47a9cecf2acd3757ae)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:49:24.660458 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe82aa4-2c64-44f7-99ce-6c5789f682ff admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:49:24.711550 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-cfe82aa4-2c64-44f7-99ce-6c5789f682ff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8bcf1dfb2ddd4a47a9cecf2acd3757ae', 'request_id': 'req-cfe82aa4-2c64-44f7-99ce-6c5789f682ff'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:49:24.718737 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-cfe82aa4-2c64-44f7-99ce-6c5789f682ff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8bcf1dfb2ddd4a47a9cecf2acd3757ae', 'request_id': 'req-cfe82aa4-2c64-44f7-99ce-6c5789f682ff'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:49:24.725418 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-cfe82aa4-2c64-44f7-99ce-6c5789f682ff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8bcf1dfb2ddd4a47a9cecf2acd3757ae', 'request_id': 'req-cfe82aa4-2c64-44f7-99ce-6c5789f682ff'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:49:24.739109 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-cfe82aa4-2c64-44f7-99ce-6c5789f682ff admin admin] The token cache is being invalidate because project 8bcf1dfb2ddd4a47a9cecf2acd3757ae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80475) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 14:49:24.739406 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-cfe82aa4-2c64-44f7-99ce-6c5789f682ff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:49:24.740043 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-cfe82aa4-2c64-44f7-99ce-6c5789f682ff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:49:24.741635 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1349/2684] 10.222.0.67 () {58 vars in 1232 bytes} [Wed May 25 14:49:24 2022] DELETE /identity/v3/projects/8bcf1dfb2ddd4a47a9cecf2acd3757ae => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:49:24.746335 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739558e1-de84-463d-9a03-b607e6e2752a service neutron] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:49:24.756215 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739558e1-de84-463d-9a03-b607e6e2752a service neutron] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:49:24.817929 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea073ca-7567-4944-97cd-f17e5fb6daa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:49:24.818724 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea073ca-7567-4944-97cd-f17e5fb6daa8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:24.819038 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea073ca-7567-4944-97cd-f17e5fb6daa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:24.819322 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea073ca-7567-4944-97cd-f17e5fb6daa8 admin admin] PATH_INFO: `/v3/users/b8be9ac348044226bb5576617901217f` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:24.820535 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea073ca-7567-4944-97cd-f17e5fb6daa8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b8be9ac348044226bb5576617901217f)` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:49:24.822494 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea073ca-7567-4944-97cd-f17e5fb6daa8 admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:49:24.876369 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-8ea073ca-7567-4944-97cd-f17e5fb6daa8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b8be9ac348044226bb5576617901217f'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:49:24.877373 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-8ea073ca-7567-4944-97cd-f17e5fb6daa8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b8be9ac348044226bb5576617901217f'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:49:24.878322 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-8ea073ca-7567-4944-97cd-f17e5fb6daa8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b8be9ac348044226bb5576617901217f'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:49:24.899588 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-8ea073ca-7567-4944-97cd-f17e5fb6daa8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b8be9ac348044226bb5576617901217f'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:49:24.912103 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-8ea073ca-7567-4944-97cd-f17e5fb6daa8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b8be9ac348044226bb5576617901217f'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:49:24.926247 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1336/2685] 10.222.0.67 () {58 vars in 1223 bytes} [Wed May 25 14:49:24 2022] DELETE /identity/v3/users/b8be9ac348044226bb5576617901217f => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:49:25.216625 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe82aa4-2c64-44f7-99ce-6c5789f682ff admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:49:25.218629 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-cfe82aa4-2c64-44f7-99ce-6c5789f682ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:49:25.238567 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe82aa4-2c64-44f7-99ce-6c5789f682ff admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:49:25.243717 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:49:25.302425 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e948d2c8-0337-4f74-929a-69e05541b9b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:49:25.303341 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e948d2c8-0337-4f74-929a-69e05541b9b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:25.303623 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e948d2c8-0337-4f74-929a-69e05541b9b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:25.303901 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e948d2c8-0337-4f74-929a-69e05541b9b4 admin admin] PATH_INFO: `/v3/projects/249ce0a635fc40b281a6e594c4ea7539` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:25.305128 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e948d2c8-0337-4f74-929a-69e05541b9b4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=249ce0a635fc40b281a6e594c4ea7539)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:49:25.307114 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e948d2c8-0337-4f74-929a-69e05541b9b4 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:49:25.357972 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-e948d2c8-0337-4f74-929a-69e05541b9b4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '249ce0a635fc40b281a6e594c4ea7539', 'request_id': 'req-e948d2c8-0337-4f74-929a-69e05541b9b4'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:49:25.363440 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-e948d2c8-0337-4f74-929a-69e05541b9b4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '249ce0a635fc40b281a6e594c4ea7539', 'request_id': 'req-e948d2c8-0337-4f74-929a-69e05541b9b4'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:49:25.370144 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-e948d2c8-0337-4f74-929a-69e05541b9b4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '249ce0a635fc40b281a6e594c4ea7539', 'request_id': 'req-e948d2c8-0337-4f74-929a-69e05541b9b4'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:49:25.384093 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-e948d2c8-0337-4f74-929a-69e05541b9b4 admin admin] The token cache is being invalidate because project 249ce0a635fc40b281a6e594c4ea7539 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80475) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 14:49:25.384441 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-e948d2c8-0337-4f74-929a-69e05541b9b4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:49:25.385934 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-e948d2c8-0337-4f74-929a-69e05541b9b4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:49:25.388066 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1350/2686] 10.222.0.67 () {58 vars in 1232 bytes} [Wed May 25 14:49:25 2022] DELETE /identity/v3/projects/249ce0a635fc40b281a6e594c4ea7539 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:49:25.393071 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06c5661-efa7-49cd-93b0-a80cbbbbef64 None None] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:25.393539 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06c5661-efa7-49cd-93b0-a80cbbbbef64 None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:25.393664 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06c5661-efa7-49cd-93b0-a80cbbbbef64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:25.414546 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.auth.core [None req-a06c5661-efa7-49cd-93b0-a80cbbbbef64 None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:49:25.415811 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-a06c5661-efa7-49cd-93b0-a80cbbbbef64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:49:25.466584 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:49:25.477771 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1337/2687] 10.222.0.67 () {58 vars in 957 bytes} [Wed May 25 14:49:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:49:25.485858 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810ec97b-9d29-47d6-b078-729660206db8 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:25.486154 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810ec97b-9d29-47d6-b078-729660206db8 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:25.486442 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810ec97b-9d29-47d6-b078-729660206db8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:25.504919 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-810ec97b-9d29-47d6-b078-729660206db8 None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:49:25.506203 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-810ec97b-9d29-47d6-b078-729660206db8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:49:25.515009 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1351/2688] 10.222.0.67 () {58 vars in 957 bytes} [Wed May 25 14:49:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:49:25.519164 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06c5661-efa7-49cd-93b0-a80cbbbbef64 None None] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:49:25.529395 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06c5661-efa7-49cd-93b0-a80cbbbbef64 None None] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:49:25.533844 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ec28c0-1b4e-46ce-9fcc-4f2206ecefac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:49:25.534493 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ec28c0-1b4e-46ce-9fcc-4f2206ecefac admin admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:25.534776 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ec28c0-1b4e-46ce-9fcc-4f2206ecefac admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:25.535077 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ec28c0-1b4e-46ce-9fcc-4f2206ecefac admin admin] PATH_INFO: `/v3/domains` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:25.535801 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ec28c0-1b4e-46ce-9fcc-4f2206ecefac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:49:25.536111 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ec28c0-1b4e-46ce-9fcc-4f2206ecefac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:49:25.537694 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ec28c0-1b4e-46ce-9fcc-4f2206ecefac admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:49:25.549941 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1338/2689] 10.222.0.67 () {58 vars in 1152 bytes} [Wed May 25 14:49:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:49:25.554088 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810ec97b-9d29-47d6-b078-729660206db8 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:49:25.564101 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810ec97b-9d29-47d6-b078-729660206db8 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:49:25.568707 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddce24a-f5ef-4819-bc57-bb2ff4a2fb2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:49:25.569355 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddce24a-f5ef-4819-bc57-bb2ff4a2fb2b admin admin] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:25.569642 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddce24a-f5ef-4819-bc57-bb2ff4a2fb2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:25.569922 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddce24a-f5ef-4819-bc57-bb2ff4a2fb2b admin admin] PATH_INFO: `/v3/projects` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:25.570612 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ddce24a-f5ef-4819-bc57-bb2ff4a2fb2b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:49:25.572610 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ddce24a-f5ef-4819-bc57-bb2ff4a2fb2b admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:49:25.601352 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1352/2690] 10.222.0.67 () {60 vars in 1152 bytes} [Wed May 25 14:49:25 2022] POST /identity/v3/projects => generated 385 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:49:25.602500 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ec28c0-1b4e-46ce-9fcc-4f2206ecefac admin admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:49:25.613096 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ec28c0-1b4e-46ce-9fcc-4f2206ecefac admin admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:49:25.668613 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6ab81b-61ec-4e0c-aaa9-1c472fa525de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:49:25.669298 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6ab81b-61ec-4e0c-aaa9-1c472fa525de admin admin] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:25.669586 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6ab81b-61ec-4e0c-aaa9-1c472fa525de admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:25.669965 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6ab81b-61ec-4e0c-aaa9-1c472fa525de admin admin] PATH_INFO: `/v3/users` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:25.670933 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6ab81b-61ec-4e0c-aaa9-1c472fa525de admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:49:25.672896 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6ab81b-61ec-4e0c-aaa9-1c472fa525de admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:49:25.696911 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1339/2691] 10.222.0.67 () {60 vars in 1143 bytes} [Wed May 25 14:49:25 2022] POST /identity/v3/users => generated 293 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 14:49:25.699136 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddce24a-f5ef-4819-bc57-bb2ff4a2fb2b admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:49:25.709622 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddce24a-f5ef-4819-bc57-bb2ff4a2fb2b admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:49:25.715092 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730cfbc8-6886-4184-b0f4-fad15741e440 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:49:25.715759 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730cfbc8-6886-4184-b0f4-fad15741e440 admin admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:25.716043 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730cfbc8-6886-4184-b0f4-fad15741e440 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:25.716320 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730cfbc8-6886-4184-b0f4-fad15741e440 admin admin] PATH_INFO: `/v3/roles` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:25.717079 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730cfbc8-6886-4184-b0f4-fad15741e440 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:49:25.718686 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730cfbc8-6886-4184-b0f4-fad15741e440 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:49:25.730313 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1353/2692] 10.222.0.67 () {58 vars in 1121 bytes} [Wed May 25 14:49:25 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:49:25.734551 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6ab81b-61ec-4e0c-aaa9-1c472fa525de admin admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:49:25.745975 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6ab81b-61ec-4e0c-aaa9-1c472fa525de admin admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:49:25.753078 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc89844-9068-4242-a851-6e0055c65813 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:49:25.754426 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc89844-9068-4242-a851-6e0055c65813 admin admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:25.754723 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc89844-9068-4242-a851-6e0055c65813 admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:25.755031 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc89844-9068-4242-a851-6e0055c65813 admin admin] PATH_INFO: `/v3/roles` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:25.755803 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc89844-9068-4242-a851-6e0055c65813 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:49:25.757409 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc89844-9068-4242-a851-6e0055c65813 admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:49:25.769049 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1340/2693] 10.222.0.67 () {58 vars in 1121 bytes} [Wed May 25 14:49:25 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:49:25.773129 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730cfbc8-6886-4184-b0f4-fad15741e440 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:49:25.784060 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730cfbc8-6886-4184-b0f4-fad15741e440 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:49:25.788624 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea7312a-646e-4d5d-ae0b-fe35371ef13b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:49:25.789496 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea7312a-646e-4d5d-ae0b-fe35371ef13b admin admin] REQUEST_METHOD: `PUT` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:25.789778 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea7312a-646e-4d5d-ae0b-fe35371ef13b admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:25.790048 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea7312a-646e-4d5d-ae0b-fe35371ef13b admin admin] PATH_INFO: `/v3/projects/808b4161218c479a87e945fe9ebddcee/users/654d5079c0214a90ab724c8a66218e5d/roles/48808901834b4d5eab2c7e6b5b03791e` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:25.805589 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea7312a-646e-4d5d-ae0b-fe35371ef13b admin admin] RBAC: Authorizing `identity:create_grant(project_id=808b4161218c479a87e945fe9ebddcee, user_id=654d5079c0214a90ab724c8a66218e5d, role_id=48808901834b4d5eab2c7e6b5b03791e)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:49:25.808355 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea7312a-646e-4d5d-ae0b-fe35371ef13b admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:49:25.821265 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1354/2694] 10.222.0.67 () {60 vars in 1482 bytes} [Wed May 25 14:49:25 2022] PUT /identity/v3/projects/808b4161218c479a87e945fe9ebddcee/users/654d5079c0214a90ab724c8a66218e5d/roles/48808901834b4d5eab2c7e6b5b03791e => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:49:25.831742 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352e6b71-106f-4d09-834a-4be9feb22d81 None None] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:25.832037 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352e6b71-106f-4d09-834a-4be9feb22d81 None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:25.832324 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352e6b71-106f-4d09-834a-4be9feb22d81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:25.860933 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.auth.core [None req-352e6b71-106f-4d09-834a-4be9feb22d81 None None] MFA Rules not processed for user `654d5079c0214a90ab724c8a66218e5d`. Rule list: `[]` (Enabled: `True`). {{(pid=80474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:49:25.862132 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-352e6b71-106f-4d09-834a-4be9feb22d81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:49:25.932405 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1341/2695] 10.222.0.67 () {58 vars in 957 bytes} [Wed May 25 14:49:25 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:49:25.936828 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea7312a-646e-4d5d-ae0b-fe35371ef13b admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:49:25.986874 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:49:26.014890 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea7312a-646e-4d5d-ae0b-fe35371ef13b admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:49:26.019618 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75785fdb-409d-4ca7-a5d2-bc6bf97c9ad1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:49:26.020280 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75785fdb-409d-4ca7-a5d2-bc6bf97c9ad1 admin admin] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:26.020567 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75785fdb-409d-4ca7-a5d2-bc6bf97c9ad1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:26.020842 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75785fdb-409d-4ca7-a5d2-bc6bf97c9ad1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:26.021532 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75785fdb-409d-4ca7-a5d2-bc6bf97c9ad1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:49:26.023494 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75785fdb-409d-4ca7-a5d2-bc6bf97c9ad1 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:49:26.053794 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1355/2696] 10.222.0.67 () {60 vars in 1152 bytes} [Wed May 25 14:49:25 2022] POST /identity/v3/projects => generated 387 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:49:26.060997 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352e6b71-106f-4d09-834a-4be9feb22d81 None None] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:49:26.073145 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352e6b71-106f-4d09-834a-4be9feb22d81 None None] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:49:26.125830 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:49:26.135746 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e761b27c-612d-4fd5-a899-4d1274c03eaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:49:26.136555 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e761b27c-612d-4fd5-a899-4d1274c03eaf admin admin] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:26.136970 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e761b27c-612d-4fd5-a899-4d1274c03eaf admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:26.137254 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e761b27c-612d-4fd5-a899-4d1274c03eaf admin admin] PATH_INFO: `/v3/users` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:26.137947 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e761b27c-612d-4fd5-a899-4d1274c03eaf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:49:26.139893 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e761b27c-612d-4fd5-a899-4d1274c03eaf admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:49:26.160034 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1342/2697] 10.222.0.67 () {60 vars in 1143 bytes} [Wed May 25 14:49:26 2022] POST /identity/v3/users => generated 300 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:49:26.167009 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75785fdb-409d-4ca7-a5d2-bc6bf97c9ad1 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:49:26.178211 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75785fdb-409d-4ca7-a5d2-bc6bf97c9ad1 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:49:26.183609 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16014085-c341-47e7-b4dd-615467065447 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:49:26.184204 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16014085-c341-47e7-b4dd-615467065447 admin admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:26.184488 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16014085-c341-47e7-b4dd-615467065447 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:26.184764 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16014085-c341-47e7-b4dd-615467065447 admin admin] PATH_INFO: `/v3/roles` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:26.185485 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16014085-c341-47e7-b4dd-615467065447 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:49:26.187118 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16014085-c341-47e7-b4dd-615467065447 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:49:26.204105 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1356/2698] 10.222.0.67 () {58 vars in 1121 bytes} [Wed May 25 14:49:26 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:49:26.208616 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e761b27c-612d-4fd5-a899-4d1274c03eaf admin admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:49:26.219956 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e761b27c-612d-4fd5-a899-4d1274c03eaf admin admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:49:26.224638 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb3faa2-58bc-4b0c-b85d-9ad8ba42e6ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:49:26.225531 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb3faa2-58bc-4b0c-b85d-9ad8ba42e6ad admin admin] REQUEST_METHOD: `PUT` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:26.225821 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb3faa2-58bc-4b0c-b85d-9ad8ba42e6ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:26.226106 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb3faa2-58bc-4b0c-b85d-9ad8ba42e6ad admin admin] PATH_INFO: `/v3/projects/f1d690bfaefc4d0cb89d4e7432d04d46/users/80a9b12551884553ae806dc7b1fd073c/roles/399893e19eac4ab5a8e596f7c07be13c` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:26.241898 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb3faa2-58bc-4b0c-b85d-9ad8ba42e6ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=f1d690bfaefc4d0cb89d4e7432d04d46, user_id=80a9b12551884553ae806dc7b1fd073c, role_id=399893e19eac4ab5a8e596f7c07be13c)` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:49:26.244620 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb3faa2-58bc-4b0c-b85d-9ad8ba42e6ad admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:49:26.258226 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1343/2699] 10.222.0.67 () {60 vars in 1482 bytes} [Wed May 25 14:49:26 2022] PUT /identity/v3/projects/f1d690bfaefc4d0cb89d4e7432d04d46/users/80a9b12551884553ae806dc7b1fd073c/roles/399893e19eac4ab5a8e596f7c07be13c => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:49:26.263729 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16014085-c341-47e7-b4dd-615467065447 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:49:26.274430 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16014085-c341-47e7-b4dd-615467065447 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:49:26.334753 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ace23d6-58d6-4441-9260-e1c45500595d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:49:26.335456 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ace23d6-58d6-4441-9260-e1c45500595d admin admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:26.335738 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ace23d6-58d6-4441-9260-e1c45500595d admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:26.336013 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ace23d6-58d6-4441-9260-e1c45500595d admin admin] PATH_INFO: `/v3/roles` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:26.336742 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ace23d6-58d6-4441-9260-e1c45500595d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:49:26.339066 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ace23d6-58d6-4441-9260-e1c45500595d admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:49:26.349403 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1357/2700] 10.222.0.67 () {58 vars in 1121 bytes} [Wed May 25 14:49:26 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:49:26.353846 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb3faa2-58bc-4b0c-b85d-9ad8ba42e6ad admin admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:49:26.364457 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb3faa2-58bc-4b0c-b85d-9ad8ba42e6ad admin admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:49:26.369416 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3268339f-1067-4477-8bc0-f82beff26aac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:49:26.370472 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3268339f-1067-4477-8bc0-f82beff26aac admin admin] REQUEST_METHOD: `PUT` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:26.370766 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3268339f-1067-4477-8bc0-f82beff26aac admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:26.371083 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3268339f-1067-4477-8bc0-f82beff26aac admin admin] PATH_INFO: `/v3/projects/f1d690bfaefc4d0cb89d4e7432d04d46/users/80a9b12551884553ae806dc7b1fd073c/roles/399893e19eac4ab5a8e596f7c07be13c` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:26.373100 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3268339f-1067-4477-8bc0-f82beff26aac admin admin] RBAC: Authorizing `identity:create_grant(project_id=f1d690bfaefc4d0cb89d4e7432d04d46, user_id=80a9b12551884553ae806dc7b1fd073c, role_id=399893e19eac4ab5a8e596f7c07be13c)` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:49:26.375928 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3268339f-1067-4477-8bc0-f82beff26aac admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:49:26.387814 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1344/2701] 10.222.0.67 () {60 vars in 1482 bytes} [Wed May 25 14:49:26 2022] PUT /identity/v3/projects/f1d690bfaefc4d0cb89d4e7432d04d46/users/80a9b12551884553ae806dc7b1fd073c/roles/399893e19eac4ab5a8e596f7c07be13c => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:49:26.399923 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e50a23-1aac-4446-a262-f94252832fb6 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:26.400213 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e50a23-1aac-4446-a262-f94252832fb6 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:26.401366 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e50a23-1aac-4446-a262-f94252832fb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:26.429107 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-d7e50a23-1aac-4446-a262-f94252832fb6 None None] MFA Rules not processed for user `80a9b12551884553ae806dc7b1fd073c`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:49:26.430329 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-d7e50a23-1aac-4446-a262-f94252832fb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:49:26.503615 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1358/2702] 10.222.0.67 () {58 vars in 957 bytes} [Wed May 25 14:49:26 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:49:26.516358 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3268339f-1067-4477-8bc0-f82beff26aac admin admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:49:26.518079 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-3268339f-1067-4477-8bc0-f82beff26aac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:49:26.576740 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3268339f-1067-4477-8bc0-f82beff26aac admin admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:49:26.580391 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df3d768-43f2-426f-855f-1e34e36200ac service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e462acc9da84a61bb23998dd54e1858', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfe93ee8d32a441295efc0b885de4bd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:49:26.581038 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df3d768-43f2-426f-855f-1e34e36200ac service cinder] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:26.581335 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df3d768-43f2-426f-855f-1e34e36200ac service cinder] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:26.581619 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df3d768-43f2-426f-855f-1e34e36200ac service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:26.591353 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df3d768-43f2-426f-855f-1e34e36200ac service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:49:26.592780 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df3d768-43f2-426f-855f-1e34e36200ac service cinder] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:49:26.602192 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1345/2703] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 14:49:26 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:49:26.668086 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e50a23-1aac-4446-a262-f94252832fb6 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:49:26.703371 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:49:26.735572 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e50a23-1aac-4446-a262-f94252832fb6 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:49:26.740222 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bccb56-28b8-46e1-b7ed-331ca4781876 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:49:26.741103 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bccb56-28b8-46e1-b7ed-331ca4781876 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:26.741387 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bccb56-28b8-46e1-b7ed-331ca4781876 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:26.741665 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bccb56-28b8-46e1-b7ed-331ca4781876 admin admin] PATH_INFO: `/v3/users/654d5079c0214a90ab724c8a66218e5d` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:26.742873 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bccb56-28b8-46e1-b7ed-331ca4781876 admin admin] RBAC: Authorizing `identity:delete_user(user_id=654d5079c0214a90ab724c8a66218e5d)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:49:26.745926 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bccb56-28b8-46e1-b7ed-331ca4781876 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:49:26.794355 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-e4bccb56-28b8-46e1-b7ed-331ca4781876 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '654d5079c0214a90ab724c8a66218e5d'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:49:26.801946 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-e4bccb56-28b8-46e1-b7ed-331ca4781876 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '654d5079c0214a90ab724c8a66218e5d'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:49:26.802585 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-e4bccb56-28b8-46e1-b7ed-331ca4781876 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '654d5079c0214a90ab724c8a66218e5d'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:49:26.810370 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-e4bccb56-28b8-46e1-b7ed-331ca4781876 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '654d5079c0214a90ab724c8a66218e5d'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:49:26.824242 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-e4bccb56-28b8-46e1-b7ed-331ca4781876 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '654d5079c0214a90ab724c8a66218e5d'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:49:26.830543 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1359/2704] 10.222.0.67 () {58 vars in 1223 bytes} [Wed May 25 14:49:26 2022] DELETE /identity/v3/users/654d5079c0214a90ab724c8a66218e5d => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:49:26.835019 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31920809-979f-40d1-b182-5bea47683580 None None] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:26.835308 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31920809-979f-40d1-b182-5bea47683580 None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:26.838879 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31920809-979f-40d1-b182-5bea47683580 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:26.854100 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.auth.core [None req-31920809-979f-40d1-b182-5bea47683580 None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:49:26.855401 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-31920809-979f-40d1-b182-5bea47683580 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:49:26.915313 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1346/2705] 10.222.0.67 () {58 vars in 957 bytes} [Wed May 25 14:49:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:49:26.926255 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bccb56-28b8-46e1-b7ed-331ca4781876 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:49:26.927801 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-e4bccb56-28b8-46e1-b7ed-331ca4781876 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:49:26.999402 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bccb56-28b8-46e1-b7ed-331ca4781876 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:49:27.003071 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42f91fd-867e-4137-83c0-ad11ab27e419 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b68eed985c7b49839bcdd173186ad4ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfe93ee8d32a441295efc0b885de4bd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:49:27.003722 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42f91fd-867e-4137-83c0-ad11ab27e419 service neutron] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:27.004010 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42f91fd-867e-4137-83c0-ad11ab27e419 service neutron] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:27.004291 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42f91fd-867e-4137-83c0-ad11ab27e419 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:27.013992 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42f91fd-867e-4137-83c0-ad11ab27e419 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:49:27.015484 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42f91fd-867e-4137-83c0-ad11ab27e419 service neutron] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:49:27.025017 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1360/2706] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 14:49:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:49:27.303965 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31920809-979f-40d1-b182-5bea47683580 None None] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:49:27.305376 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-31920809-979f-40d1-b182-5bea47683580 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:49:27.317801 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31920809-979f-40d1-b182-5bea47683580 None None] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:49:27.322437 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72efd77c-a606-4146-995b-7ed29c0ed270 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:49:27.324072 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72efd77c-a606-4146-995b-7ed29c0ed270 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:27.324356 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72efd77c-a606-4146-995b-7ed29c0ed270 admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:27.324632 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72efd77c-a606-4146-995b-7ed29c0ed270 admin admin] PATH_INFO: `/v3/projects/808b4161218c479a87e945fe9ebddcee` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:27.325820 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72efd77c-a606-4146-995b-7ed29c0ed270 admin admin] RBAC: Authorizing `identity:delete_project(project_id=808b4161218c479a87e945fe9ebddcee)` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:49:27.327765 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72efd77c-a606-4146-995b-7ed29c0ed270 admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:49:27.374255 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=92,keystone:INSERT=5,keystone:DELETE=3 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:49:27.378584 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-72efd77c-a606-4146-995b-7ed29c0ed270 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '808b4161218c479a87e945fe9ebddcee', 'request_id': 'req-72efd77c-a606-4146-995b-7ed29c0ed270'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:49:27.388221 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-72efd77c-a606-4146-995b-7ed29c0ed270 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '808b4161218c479a87e945fe9ebddcee', 'request_id': 'req-72efd77c-a606-4146-995b-7ed29c0ed270'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:49:27.394594 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-72efd77c-a606-4146-995b-7ed29c0ed270 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '808b4161218c479a87e945fe9ebddcee', 'request_id': 'req-72efd77c-a606-4146-995b-7ed29c0ed270'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:49:27.406479 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-72efd77c-a606-4146-995b-7ed29c0ed270 admin admin] The token cache is being invalidate because project 808b4161218c479a87e945fe9ebddcee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80474) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 14:49:27.407629 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-72efd77c-a606-4146-995b-7ed29c0ed270 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:49:27.408337 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-72efd77c-a606-4146-995b-7ed29c0ed270 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:49:27.410138 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1347/2707] 10.222.0.67 () {58 vars in 1232 bytes} [Wed May 25 14:49:27 2022] DELETE /identity/v3/projects/808b4161218c479a87e945fe9ebddcee => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:49:27.414118 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42f91fd-867e-4137-83c0-ad11ab27e419 service neutron] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:49:27.428888 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42f91fd-867e-4137-83c0-ad11ab27e419 service neutron] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:49:27.483359 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:49:27.493396 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f66a561-37d7-49db-8db2-a55d3f70fbca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:49:27.494732 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f66a561-37d7-49db-8db2-a55d3f70fbca admin admin] REQUEST_METHOD: `DELETE` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:27.495076 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f66a561-37d7-49db-8db2-a55d3f70fbca admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:27.495344 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f66a561-37d7-49db-8db2-a55d3f70fbca admin admin] PATH_INFO: `/v3/users/80a9b12551884553ae806dc7b1fd073c` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:27.496565 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f66a561-37d7-49db-8db2-a55d3f70fbca admin admin] RBAC: Authorizing `identity:delete_user(user_id=80a9b12551884553ae806dc7b1fd073c)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:49:27.498477 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f66a561-37d7-49db-8db2-a55d3f70fbca admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:49:27.554858 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-1f66a561-37d7-49db-8db2-a55d3f70fbca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '80a9b12551884553ae806dc7b1fd073c'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:49:27.563999 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-1f66a561-37d7-49db-8db2-a55d3f70fbca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '80a9b12551884553ae806dc7b1fd073c'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:49:27.564728 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-1f66a561-37d7-49db-8db2-a55d3f70fbca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '80a9b12551884553ae806dc7b1fd073c'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:49:27.572822 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-1f66a561-37d7-49db-8db2-a55d3f70fbca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '80a9b12551884553ae806dc7b1fd073c'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:49:27.585115 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-1f66a561-37d7-49db-8db2-a55d3f70fbca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '80a9b12551884553ae806dc7b1fd073c'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:49:27.592067 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1361/2708] 10.222.0.67 () {58 vars in 1223 bytes} [Wed May 25 14:49:27 2022] DELETE /identity/v3/users/80a9b12551884553ae806dc7b1fd073c => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 14:49:27.887795 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72efd77c-a606-4146-995b-7ed29c0ed270 admin admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:49:27.889300 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-72efd77c-a606-4146-995b-7ed29c0ed270 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:49:27.902408 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72efd77c-a606-4146-995b-7ed29c0ed270 admin admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:49:27.961409 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d24270e-3588-4643-98d2-5c58ec9662bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:49:27.962193 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d24270e-3588-4643-98d2-5c58ec9662bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:27.962478 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d24270e-3588-4643-98d2-5c58ec9662bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:27.962757 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d24270e-3588-4643-98d2-5c58ec9662bc admin admin] PATH_INFO: `/v3/projects/f1d690bfaefc4d0cb89d4e7432d04d46` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:27.964596 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d24270e-3588-4643-98d2-5c58ec9662bc admin admin] RBAC: Authorizing `identity:delete_project(project_id=f1d690bfaefc4d0cb89d4e7432d04d46)` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:49:27.966534 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d24270e-3588-4643-98d2-5c58ec9662bc admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:49:28.013889 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-2d24270e-3588-4643-98d2-5c58ec9662bc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f1d690bfaefc4d0cb89d4e7432d04d46', 'request_id': 'req-2d24270e-3588-4643-98d2-5c58ec9662bc'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:49:28.021303 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-2d24270e-3588-4643-98d2-5c58ec9662bc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f1d690bfaefc4d0cb89d4e7432d04d46', 'request_id': 'req-2d24270e-3588-4643-98d2-5c58ec9662bc'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:49:28.028101 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-2d24270e-3588-4643-98d2-5c58ec9662bc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f1d690bfaefc4d0cb89d4e7432d04d46', 'request_id': 'req-2d24270e-3588-4643-98d2-5c58ec9662bc'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:49:28.038453 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-2d24270e-3588-4643-98d2-5c58ec9662bc admin admin] The token cache is being invalidate because project f1d690bfaefc4d0cb89d4e7432d04d46 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80474) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 14:49:28.038739 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-2d24270e-3588-4643-98d2-5c58ec9662bc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:49:28.039417 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-2d24270e-3588-4643-98d2-5c58ec9662bc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:49:28.040959 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1348/2709] 10.222.0.67 () {58 vars in 1232 bytes} [Wed May 25 14:49:27 2022] DELETE /identity/v3/projects/f1d690bfaefc4d0cb89d4e7432d04d46 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:49:28.046079 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e29da9-d2f0-449f-bf8f-49400cd2788b None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:28.046367 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e29da9-d2f0-449f-bf8f-49400cd2788b None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:28.046638 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e29da9-d2f0-449f-bf8f-49400cd2788b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:28.066575 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-63e29da9-d2f0-449f-bf8f-49400cd2788b None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:49:28.067827 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-63e29da9-d2f0-449f-bf8f-49400cd2788b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:49:28.129800 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1362/2710] 10.222.0.67 () {58 vars in 957 bytes} [Wed May 25 14:49:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:49:28.138435 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d965e7-9bc6-444d-94a6-ff0a91ed3803 None None] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:28.138730 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d965e7-9bc6-444d-94a6-ff0a91ed3803 None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:28.139041 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d965e7-9bc6-444d-94a6-ff0a91ed3803 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:28.157382 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.auth.core [None req-b0d965e7-9bc6-444d-94a6-ff0a91ed3803 None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:49:28.158625 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-b0d965e7-9bc6-444d-94a6-ff0a91ed3803 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:49:28.166508 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1349/2711] 10.222.0.67 () {58 vars in 957 bytes} [Wed May 25 14:49:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:49:28.170778 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e29da9-d2f0-449f-bf8f-49400cd2788b None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:49:28.180438 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e29da9-d2f0-449f-bf8f-49400cd2788b None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:49:28.185723 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ac19a5-585a-4b6b-a32a-c90d2c6e74ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:49:28.186378 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ac19a5-585a-4b6b-a32a-c90d2c6e74ca admin admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:28.186658 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ac19a5-585a-4b6b-a32a-c90d2c6e74ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:28.186934 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ac19a5-585a-4b6b-a32a-c90d2c6e74ca admin admin] PATH_INFO: `/v3/domains` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:28.187694 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ac19a5-585a-4b6b-a32a-c90d2c6e74ca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:49:28.188002 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ac19a5-585a-4b6b-a32a-c90d2c6e74ca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:49:28.189602 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ac19a5-585a-4b6b-a32a-c90d2c6e74ca admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:49:28.201757 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1363/2712] 10.222.0.67 () {58 vars in 1152 bytes} [Wed May 25 14:49:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:49:28.206213 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d965e7-9bc6-444d-94a6-ff0a91ed3803 None None] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:49:28.216042 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d965e7-9bc6-444d-94a6-ff0a91ed3803 None None] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:49:28.220672 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb0ddfb-723b-4c3d-92e6-5a3bc6ccb9dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:49:28.221333 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb0ddfb-723b-4c3d-92e6-5a3bc6ccb9dd admin admin] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:28.221621 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb0ddfb-723b-4c3d-92e6-5a3bc6ccb9dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:28.221903 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb0ddfb-723b-4c3d-92e6-5a3bc6ccb9dd admin admin] PATH_INFO: `/v3/projects` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:28.222606 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb0ddfb-723b-4c3d-92e6-5a3bc6ccb9dd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:49:28.224536 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb0ddfb-723b-4c3d-92e6-5a3bc6ccb9dd admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:49:28.251017 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1350/2713] 10.222.0.67 () {60 vars in 1152 bytes} [Wed May 25 14:49:28 2022] POST /identity/v3/projects => generated 385 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 14:49:28.255379 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ac19a5-585a-4b6b-a32a-c90d2c6e74ca admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:49:28.266319 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ac19a5-585a-4b6b-a32a-c90d2c6e74ca admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:49:28.322695 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6fbe2a-5ca6-44ce-90b0-9c4f80d09061 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:49:28.323383 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6fbe2a-5ca6-44ce-90b0-9c4f80d09061 admin admin] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:28.323667 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6fbe2a-5ca6-44ce-90b0-9c4f80d09061 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:28.323941 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6fbe2a-5ca6-44ce-90b0-9c4f80d09061 admin admin] PATH_INFO: `/v3/users` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:28.324640 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6fbe2a-5ca6-44ce-90b0-9c4f80d09061 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:49:28.326543 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6fbe2a-5ca6-44ce-90b0-9c4f80d09061 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:49:28.333250 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:49:28.349224 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1364/2714] 10.222.0.67 () {60 vars in 1143 bytes} [Wed May 25 14:49:28 2022] POST /identity/v3/users => generated 293 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:49:28.353762 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb0ddfb-723b-4c3d-92e6-5a3bc6ccb9dd admin admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:49:28.364473 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb0ddfb-723b-4c3d-92e6-5a3bc6ccb9dd admin admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:49:28.369027 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1033ea-56cf-45af-9435-e2009a7f6b43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:49:28.369744 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1033ea-56cf-45af-9435-e2009a7f6b43 admin admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:28.370173 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1033ea-56cf-45af-9435-e2009a7f6b43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:28.370459 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1033ea-56cf-45af-9435-e2009a7f6b43 admin admin] PATH_INFO: `/v3/roles` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:28.371219 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1033ea-56cf-45af-9435-e2009a7f6b43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:49:28.372819 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1033ea-56cf-45af-9435-e2009a7f6b43 admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:49:28.384001 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1351/2715] 10.222.0.67 () {58 vars in 1121 bytes} [Wed May 25 14:49:28 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:49:28.388802 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6fbe2a-5ca6-44ce-90b0-9c4f80d09061 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:49:28.406831 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6fbe2a-5ca6-44ce-90b0-9c4f80d09061 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:49:28.411552 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55e2c25-ef1a-4cf0-8601-cb9b7c92f543 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:49:28.412218 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55e2c25-ef1a-4cf0-8601-cb9b7c92f543 admin admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:28.412509 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55e2c25-ef1a-4cf0-8601-cb9b7c92f543 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:28.412791 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55e2c25-ef1a-4cf0-8601-cb9b7c92f543 admin admin] PATH_INFO: `/v3/roles` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:28.413548 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55e2c25-ef1a-4cf0-8601-cb9b7c92f543 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:49:28.415201 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55e2c25-ef1a-4cf0-8601-cb9b7c92f543 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:49:28.427526 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1365/2716] 10.222.0.67 () {58 vars in 1121 bytes} [Wed May 25 14:49:28 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:49:28.431896 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1033ea-56cf-45af-9435-e2009a7f6b43 admin admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:49:28.442674 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1033ea-56cf-45af-9435-e2009a7f6b43 admin admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:49:28.448146 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f1becd-ceee-4bc1-b798-f56dddc82976 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:49:28.449128 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f1becd-ceee-4bc1-b798-f56dddc82976 admin admin] REQUEST_METHOD: `PUT` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:28.449409 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f1becd-ceee-4bc1-b798-f56dddc82976 admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:28.449684 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f1becd-ceee-4bc1-b798-f56dddc82976 admin admin] PATH_INFO: `/v3/projects/a0188ecdd6324e1490e6c1750fb50b94/users/a02e9ebb4f3747ffa4a2517c9ffcaad1/roles/48808901834b4d5eab2c7e6b5b03791e` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:28.465572 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f1becd-ceee-4bc1-b798-f56dddc82976 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a0188ecdd6324e1490e6c1750fb50b94, user_id=a02e9ebb4f3747ffa4a2517c9ffcaad1, role_id=48808901834b4d5eab2c7e6b5b03791e)` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:49:28.468323 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f1becd-ceee-4bc1-b798-f56dddc82976 admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:49:28.477829 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=85,keystone:DELETE=11,keystone:INSERT=4 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:49:28.484547 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1352/2717] 10.222.0.67 () {60 vars in 1482 bytes} [Wed May 25 14:49:28 2022] PUT /identity/v3/projects/a0188ecdd6324e1490e6c1750fb50b94/users/a02e9ebb4f3747ffa4a2517c9ffcaad1/roles/48808901834b4d5eab2c7e6b5b03791e => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:49:28.496928 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d25657-7725-44fa-9f83-e6201f4a6775 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:28.497221 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d25657-7725-44fa-9f83-e6201f4a6775 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:28.497503 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d25657-7725-44fa-9f83-e6201f4a6775 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:28.525199 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-09d25657-7725-44fa-9f83-e6201f4a6775 None None] MFA Rules not processed for user `a02e9ebb4f3747ffa4a2517c9ffcaad1`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:49:28.527732 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-09d25657-7725-44fa-9f83-e6201f4a6775 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:49:28.596310 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1366/2718] 10.222.0.67 () {58 vars in 957 bytes} [Wed May 25 14:49:28 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:49:28.600851 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f1becd-ceee-4bc1-b798-f56dddc82976 admin admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:49:28.665947 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f1becd-ceee-4bc1-b798-f56dddc82976 admin admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:49:28.671747 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e272df1-32b2-4ba7-81f4-bf35c44f28d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:49:28.672440 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e272df1-32b2-4ba7-81f4-bf35c44f28d6 admin admin] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:28.672729 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e272df1-32b2-4ba7-81f4-bf35c44f28d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:28.673006 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e272df1-32b2-4ba7-81f4-bf35c44f28d6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:28.673706 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e272df1-32b2-4ba7-81f4-bf35c44f28d6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:49:28.675645 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e272df1-32b2-4ba7-81f4-bf35c44f28d6 admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:49:28.702916 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1353/2719] 10.222.0.67 () {60 vars in 1152 bytes} [Wed May 25 14:49:28 2022] POST /identity/v3/projects => generated 385 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:49:28.706928 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d25657-7725-44fa-9f83-e6201f4a6775 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:49:28.717783 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d25657-7725-44fa-9f83-e6201f4a6775 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:49:28.778297 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393a013b-71ce-4f40-a74a-10175eca45d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:49:28.778969 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393a013b-71ce-4f40-a74a-10175eca45d4 admin admin] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:28.779288 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393a013b-71ce-4f40-a74a-10175eca45d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:28.779566 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393a013b-71ce-4f40-a74a-10175eca45d4 admin admin] PATH_INFO: `/v3/users` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:28.780272 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393a013b-71ce-4f40-a74a-10175eca45d4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:49:28.782230 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393a013b-71ce-4f40-a74a-10175eca45d4 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:49:28.803041 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1367/2720] 10.222.0.67 () {60 vars in 1143 bytes} [Wed May 25 14:49:28 2022] POST /identity/v3/users => generated 299 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:49:28.806821 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e272df1-32b2-4ba7-81f4-bf35c44f28d6 admin admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:49:28.818056 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e272df1-32b2-4ba7-81f4-bf35c44f28d6 admin admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:49:28.823598 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2c08f2-48f7-41eb-adb5-329de100068a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:49:28.824317 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2c08f2-48f7-41eb-adb5-329de100068a admin admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:28.824603 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2c08f2-48f7-41eb-adb5-329de100068a admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:28.824877 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2c08f2-48f7-41eb-adb5-329de100068a admin admin] PATH_INFO: `/v3/roles` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:28.827988 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2c08f2-48f7-41eb-adb5-329de100068a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:49:28.829651 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2c08f2-48f7-41eb-adb5-329de100068a admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:49:28.841612 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1354/2721] 10.222.0.67 () {58 vars in 1121 bytes} [Wed May 25 14:49:28 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:49:28.845958 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393a013b-71ce-4f40-a74a-10175eca45d4 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:49:28.856586 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393a013b-71ce-4f40-a74a-10175eca45d4 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:49:28.861194 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdd3316-acc3-4c50-81ac-abbd3f89ba45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:49:28.862068 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdd3316-acc3-4c50-81ac-abbd3f89ba45 admin admin] REQUEST_METHOD: `PUT` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:28.862350 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdd3316-acc3-4c50-81ac-abbd3f89ba45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:28.862622 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdd3316-acc3-4c50-81ac-abbd3f89ba45 admin admin] PATH_INFO: `/v3/projects/c7782f2f72964eaf995b8d0a0f8f7ec9/users/035a02cbabbb419daac0430cf05efdf9/roles/399893e19eac4ab5a8e596f7c07be13c` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:28.878658 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cdd3316-acc3-4c50-81ac-abbd3f89ba45 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c7782f2f72964eaf995b8d0a0f8f7ec9, user_id=035a02cbabbb419daac0430cf05efdf9, role_id=399893e19eac4ab5a8e596f7c07be13c)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:49:28.881333 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cdd3316-acc3-4c50-81ac-abbd3f89ba45 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:49:28.895120 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1368/2722] 10.222.0.67 () {60 vars in 1482 bytes} [Wed May 25 14:49:28 2022] PUT /identity/v3/projects/c7782f2f72964eaf995b8d0a0f8f7ec9/users/035a02cbabbb419daac0430cf05efdf9/roles/399893e19eac4ab5a8e596f7c07be13c => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:49:28.899255 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2c08f2-48f7-41eb-adb5-329de100068a admin admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:49:28.910118 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2c08f2-48f7-41eb-adb5-329de100068a admin admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:49:28.977985 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27151362-c7c8-4d11-b32a-7b63a8e4a5bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:49:28.978675 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27151362-c7c8-4d11-b32a-7b63a8e4a5bc admin admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:28.978966 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27151362-c7c8-4d11-b32a-7b63a8e4a5bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:28.979277 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27151362-c7c8-4d11-b32a-7b63a8e4a5bc admin admin] PATH_INFO: `/v3/roles` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:28.980164 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27151362-c7c8-4d11-b32a-7b63a8e4a5bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:49:28.981779 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27151362-c7c8-4d11-b32a-7b63a8e4a5bc admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:49:28.993446 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1355/2723] 10.222.0.67 () {58 vars in 1121 bytes} [Wed May 25 14:49:28 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:49:28.998883 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdd3316-acc3-4c50-81ac-abbd3f89ba45 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:49:29.009084 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdd3316-acc3-4c50-81ac-abbd3f89ba45 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:49:29.015572 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b88f415-d23c-4eb3-9737-13fd8851b852 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:49:29.016574 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b88f415-d23c-4eb3-9737-13fd8851b852 admin admin] REQUEST_METHOD: `PUT` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:29.016928 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b88f415-d23c-4eb3-9737-13fd8851b852 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:29.017277 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b88f415-d23c-4eb3-9737-13fd8851b852 admin admin] PATH_INFO: `/v3/projects/c7782f2f72964eaf995b8d0a0f8f7ec9/users/035a02cbabbb419daac0430cf05efdf9/roles/399893e19eac4ab5a8e596f7c07be13c` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:29.019398 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b88f415-d23c-4eb3-9737-13fd8851b852 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c7782f2f72964eaf995b8d0a0f8f7ec9, user_id=035a02cbabbb419daac0430cf05efdf9, role_id=399893e19eac4ab5a8e596f7c07be13c)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:49:29.022104 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b88f415-d23c-4eb3-9737-13fd8851b852 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:49:29.034095 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1369/2724] 10.222.0.67 () {60 vars in 1482 bytes} [Wed May 25 14:49:28 2022] PUT /identity/v3/projects/c7782f2f72964eaf995b8d0a0f8f7ec9/users/035a02cbabbb419daac0430cf05efdf9/roles/399893e19eac4ab5a8e596f7c07be13c => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:49:29.044596 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e454c4cb-a162-499d-b7e0-126a231a56cc None None] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:29.044933 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e454c4cb-a162-499d-b7e0-126a231a56cc None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:29.045271 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e454c4cb-a162-499d-b7e0-126a231a56cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:29.079706 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.auth.core [None req-e454c4cb-a162-499d-b7e0-126a231a56cc None None] MFA Rules not processed for user `035a02cbabbb419daac0430cf05efdf9`. Rule list: `[]` (Enabled: `True`). {{(pid=80474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:49:29.082710 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-e454c4cb-a162-499d-b7e0-126a231a56cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:49:29.155078 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:49:29.175122 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1356/2725] 10.222.0.67 () {58 vars in 957 bytes} [Wed May 25 14:49:29 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:49:29.181546 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b88f415-d23c-4eb3-9737-13fd8851b852 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:49:29.184380 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-1b88f415-d23c-4eb3-9737-13fd8851b852 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:49:29.226506 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:INSERT=8,keystone:SELECT=92 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:49:29.281034 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b88f415-d23c-4eb3-9737-13fd8851b852 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:49:29.286631 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa0052e-9046-4d85-8a53-bb91c03a183f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e462acc9da84a61bb23998dd54e1858', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfe93ee8d32a441295efc0b885de4bd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:49:29.287341 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa0052e-9046-4d85-8a53-bb91c03a183f service cinder] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:29.287733 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa0052e-9046-4d85-8a53-bb91c03a183f service cinder] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:29.287911 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa0052e-9046-4d85-8a53-bb91c03a183f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:29.302903 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa0052e-9046-4d85-8a53-bb91c03a183f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:49:29.305706 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa0052e-9046-4d85-8a53-bb91c03a183f service cinder] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:49:29.324227 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1370/2726] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 14:49:29 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:49:29.945038 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e454c4cb-a162-499d-b7e0-126a231a56cc None None] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:49:30.008119 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e454c4cb-a162-499d-b7e0-126a231a56cc None None] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:49:30.013796 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ad19ff-915e-4aa7-8585-64b594bba9e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:49:30.014685 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ad19ff-915e-4aa7-8585-64b594bba9e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:30.014973 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ad19ff-915e-4aa7-8585-64b594bba9e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:30.015285 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ad19ff-915e-4aa7-8585-64b594bba9e2 admin admin] PATH_INFO: `/v3/users/a02e9ebb4f3747ffa4a2517c9ffcaad1` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:30.016503 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ad19ff-915e-4aa7-8585-64b594bba9e2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a02e9ebb4f3747ffa4a2517c9ffcaad1)` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:49:30.018439 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ad19ff-915e-4aa7-8585-64b594bba9e2 admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:49:30.067365 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-41ad19ff-915e-4aa7-8585-64b594bba9e2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a02e9ebb4f3747ffa4a2517c9ffcaad1'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:49:30.067934 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-41ad19ff-915e-4aa7-8585-64b594bba9e2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a02e9ebb4f3747ffa4a2517c9ffcaad1'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:49:30.068531 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-41ad19ff-915e-4aa7-8585-64b594bba9e2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a02e9ebb4f3747ffa4a2517c9ffcaad1'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:49:30.080508 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-41ad19ff-915e-4aa7-8585-64b594bba9e2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a02e9ebb4f3747ffa4a2517c9ffcaad1'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:49:30.087201 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-41ad19ff-915e-4aa7-8585-64b594bba9e2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a02e9ebb4f3747ffa4a2517c9ffcaad1'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:49:30.099491 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1357/2727] 10.222.0.67 () {58 vars in 1223 bytes} [Wed May 25 14:49:29 2022] DELETE /identity/v3/users/a02e9ebb4f3747ffa4a2517c9ffcaad1 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:49:30.105138 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e4370c-da0a-425c-bf96-42ff7a5ba61d None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:30.105706 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e4370c-da0a-425c-bf96-42ff7a5ba61d None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:30.105706 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e4370c-da0a-425c-bf96-42ff7a5ba61d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:30.124133 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-68e4370c-da0a-425c-bf96-42ff7a5ba61d None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:49:30.125336 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-68e4370c-da0a-425c-bf96-42ff7a5ba61d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:49:30.184819 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1371/2728] 10.222.0.67 () {58 vars in 957 bytes} [Wed May 25 14:49:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:49:30.196568 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ad19ff-915e-4aa7-8585-64b594bba9e2 admin admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:49:30.198526 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-41ad19ff-915e-4aa7-8585-64b594bba9e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:49:30.255171 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ad19ff-915e-4aa7-8585-64b594bba9e2 admin admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:49:30.258818 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa1dd4a-b01e-47ab-9f71-ae76e7f14c2b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b68eed985c7b49839bcdd173186ad4ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfe93ee8d32a441295efc0b885de4bd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:49:30.259508 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa1dd4a-b01e-47ab-9f71-ae76e7f14c2b service neutron] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:30.260360 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa1dd4a-b01e-47ab-9f71-ae76e7f14c2b service neutron] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:30.261138 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa1dd4a-b01e-47ab-9f71-ae76e7f14c2b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:30.270713 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa1dd4a-b01e-47ab-9f71-ae76e7f14c2b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:49:30.272171 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa1dd4a-b01e-47ab-9f71-ae76e7f14c2b service neutron] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:49:30.281669 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1358/2729] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 14:49:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:49:30.583439 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e4370c-da0a-425c-bf96-42ff7a5ba61d None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:49:30.585481 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-68e4370c-da0a-425c-bf96-42ff7a5ba61d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:49:30.619608 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e4370c-da0a-425c-bf96-42ff7a5ba61d None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:49:30.627658 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1dadfb3-783c-4146-8a75-f6ea37e45804 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:49:30.629329 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dadfb3-783c-4146-8a75-f6ea37e45804 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:30.629828 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dadfb3-783c-4146-8a75-f6ea37e45804 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:30.630372 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dadfb3-783c-4146-8a75-f6ea37e45804 admin admin] PATH_INFO: `/v3/projects/a0188ecdd6324e1490e6c1750fb50b94` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:30.632496 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1dadfb3-783c-4146-8a75-f6ea37e45804 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a0188ecdd6324e1490e6c1750fb50b94)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:49:30.636638 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1dadfb3-783c-4146-8a75-f6ea37e45804 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:49:30.705349 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-e1dadfb3-783c-4146-8a75-f6ea37e45804 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a0188ecdd6324e1490e6c1750fb50b94', 'request_id': 'req-e1dadfb3-783c-4146-8a75-f6ea37e45804'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:49:30.711681 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-e1dadfb3-783c-4146-8a75-f6ea37e45804 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a0188ecdd6324e1490e6c1750fb50b94', 'request_id': 'req-e1dadfb3-783c-4146-8a75-f6ea37e45804'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:49:30.720036 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-e1dadfb3-783c-4146-8a75-f6ea37e45804 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a0188ecdd6324e1490e6c1750fb50b94', 'request_id': 'req-e1dadfb3-783c-4146-8a75-f6ea37e45804'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:49:30.733112 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-e1dadfb3-783c-4146-8a75-f6ea37e45804 admin admin] The token cache is being invalidate because project a0188ecdd6324e1490e6c1750fb50b94 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80475) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 14:49:30.733407 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-e1dadfb3-783c-4146-8a75-f6ea37e45804 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:49:30.734135 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-e1dadfb3-783c-4146-8a75-f6ea37e45804 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:49:30.735740 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1372/2730] 10.222.0.67 () {58 vars in 1232 bytes} [Wed May 25 14:49:30 2022] DELETE /identity/v3/projects/a0188ecdd6324e1490e6c1750fb50b94 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:49:30.740541 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa1dd4a-b01e-47ab-9f71-ae76e7f14c2b service neutron] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:49:30.754971 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa1dd4a-b01e-47ab-9f71-ae76e7f14c2b service neutron] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:49:30.769407 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:49:30.846947 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f94863e-6dd2-4dc0-8d91-05be31cbf1fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:49:30.848334 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f94863e-6dd2-4dc0-8d91-05be31cbf1fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:30.848822 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f94863e-6dd2-4dc0-8d91-05be31cbf1fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:30.849107 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f94863e-6dd2-4dc0-8d91-05be31cbf1fb admin admin] PATH_INFO: `/v3/users/035a02cbabbb419daac0430cf05efdf9` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:30.850573 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f94863e-6dd2-4dc0-8d91-05be31cbf1fb admin admin] RBAC: Authorizing `identity:delete_user(user_id=035a02cbabbb419daac0430cf05efdf9)` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:49:30.852662 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f94863e-6dd2-4dc0-8d91-05be31cbf1fb admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:49:30.904476 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-2f94863e-6dd2-4dc0-8d91-05be31cbf1fb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '035a02cbabbb419daac0430cf05efdf9'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:49:30.905156 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-2f94863e-6dd2-4dc0-8d91-05be31cbf1fb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '035a02cbabbb419daac0430cf05efdf9'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:49:30.905795 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-2f94863e-6dd2-4dc0-8d91-05be31cbf1fb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '035a02cbabbb419daac0430cf05efdf9'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:49:30.918385 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-2f94863e-6dd2-4dc0-8d91-05be31cbf1fb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '035a02cbabbb419daac0430cf05efdf9'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:49:30.925208 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-2f94863e-6dd2-4dc0-8d91-05be31cbf1fb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '035a02cbabbb419daac0430cf05efdf9'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:49:30.939223 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1359/2731] 10.222.0.67 () {58 vars in 1223 bytes} [Wed May 25 14:49:30 2022] DELETE /identity/v3/users/035a02cbabbb419daac0430cf05efdf9 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:49:31.231799 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1dadfb3-783c-4146-8a75-f6ea37e45804 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:49:31.233288 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-e1dadfb3-783c-4146-8a75-f6ea37e45804 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:49:31.250480 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1dadfb3-783c-4146-8a75-f6ea37e45804 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:49:31.300425 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:49:31.314515 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4066906b-aa55-4ed3-8a22-b99805ba4784 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:49:31.315422 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4066906b-aa55-4ed3-8a22-b99805ba4784 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:31.315817 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4066906b-aa55-4ed3-8a22-b99805ba4784 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:31.316164 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4066906b-aa55-4ed3-8a22-b99805ba4784 admin admin] PATH_INFO: `/v3/projects/c7782f2f72964eaf995b8d0a0f8f7ec9` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:31.317382 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4066906b-aa55-4ed3-8a22-b99805ba4784 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c7782f2f72964eaf995b8d0a0f8f7ec9)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:49:31.319364 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4066906b-aa55-4ed3-8a22-b99805ba4784 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:49:31.367399 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-4066906b-aa55-4ed3-8a22-b99805ba4784 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c7782f2f72964eaf995b8d0a0f8f7ec9', 'request_id': 'req-4066906b-aa55-4ed3-8a22-b99805ba4784'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:49:31.373592 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-4066906b-aa55-4ed3-8a22-b99805ba4784 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c7782f2f72964eaf995b8d0a0f8f7ec9', 'request_id': 'req-4066906b-aa55-4ed3-8a22-b99805ba4784'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:49:31.380293 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-4066906b-aa55-4ed3-8a22-b99805ba4784 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c7782f2f72964eaf995b8d0a0f8f7ec9', 'request_id': 'req-4066906b-aa55-4ed3-8a22-b99805ba4784'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:49:31.394345 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-4066906b-aa55-4ed3-8a22-b99805ba4784 admin admin] The token cache is being invalidate because project c7782f2f72964eaf995b8d0a0f8f7ec9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80475) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 14:49:31.394730 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-4066906b-aa55-4ed3-8a22-b99805ba4784 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:49:31.395363 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-4066906b-aa55-4ed3-8a22-b99805ba4784 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:49:31.396912 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1373/2732] 10.222.0.67 () {58 vars in 1232 bytes} [Wed May 25 14:49:31 2022] DELETE /identity/v3/projects/c7782f2f72964eaf995b8d0a0f8f7ec9 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:49:31.403392 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04de91f4-6793-47a7-b254-0de97e4460bb None None] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:31.403864 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04de91f4-6793-47a7-b254-0de97e4460bb None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:31.403974 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04de91f4-6793-47a7-b254-0de97e4460bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:31.426728 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.auth.core [None req-04de91f4-6793-47a7-b254-0de97e4460bb None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:49:31.427992 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-04de91f4-6793-47a7-b254-0de97e4460bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:49:31.491647 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1360/2733] 10.222.0.67 () {58 vars in 957 bytes} [Wed May 25 14:49:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:49:31.500484 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f33d5d-287d-4bfc-bf95-90ac27fd85f5 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:31.500777 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f33d5d-287d-4bfc-bf95-90ac27fd85f5 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:31.501060 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f33d5d-287d-4bfc-bf95-90ac27fd85f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:31.519551 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-15f33d5d-287d-4bfc-bf95-90ac27fd85f5 None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:49:31.520745 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-15f33d5d-287d-4bfc-bf95-90ac27fd85f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:49:31.528799 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1374/2734] 10.222.0.67 () {58 vars in 957 bytes} [Wed May 25 14:49:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:49:31.533071 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04de91f4-6793-47a7-b254-0de97e4460bb None None] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:49:31.543701 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04de91f4-6793-47a7-b254-0de97e4460bb None None] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:49:31.548697 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a11be4-6581-4b14-8a28-e40b2beba022 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:49:31.549363 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a11be4-6581-4b14-8a28-e40b2beba022 admin admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:31.549646 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a11be4-6581-4b14-8a28-e40b2beba022 admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:31.549922 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a11be4-6581-4b14-8a28-e40b2beba022 admin admin] PATH_INFO: `/v3/domains` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:31.550690 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a11be4-6581-4b14-8a28-e40b2beba022 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:49:31.551029 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a11be4-6581-4b14-8a28-e40b2beba022 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:49:31.552633 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a11be4-6581-4b14-8a28-e40b2beba022 admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:49:31.568938 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1361/2735] 10.222.0.67 () {58 vars in 1152 bytes} [Wed May 25 14:49:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:49:31.570204 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f33d5d-287d-4bfc-bf95-90ac27fd85f5 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:49:31.582898 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f33d5d-287d-4bfc-bf95-90ac27fd85f5 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:49:31.587533 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fe966d-4065-43ca-9315-bc6af2a309c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:49:31.588845 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fe966d-4065-43ca-9315-bc6af2a309c3 admin admin] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:31.589127 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fe966d-4065-43ca-9315-bc6af2a309c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:31.589423 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fe966d-4065-43ca-9315-bc6af2a309c3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:31.590642 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fe966d-4065-43ca-9315-bc6af2a309c3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:49:31.592761 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fe966d-4065-43ca-9315-bc6af2a309c3 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:49:31.620251 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1375/2736] 10.222.0.67 () {60 vars in 1152 bytes} [Wed May 25 14:49:31 2022] POST /identity/v3/projects => generated 391 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 14:49:31.624619 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a11be4-6581-4b14-8a28-e40b2beba022 admin admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:49:31.635532 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a11be4-6581-4b14-8a28-e40b2beba022 admin admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:49:31.656048 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:49:31.698482 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc97e409-6e5e-4326-b62d-e37f04b0945c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:49:31.699135 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc97e409-6e5e-4326-b62d-e37f04b0945c admin admin] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:31.699425 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc97e409-6e5e-4326-b62d-e37f04b0945c admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:31.699700 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc97e409-6e5e-4326-b62d-e37f04b0945c admin admin] PATH_INFO: `/v3/users` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:31.700424 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc97e409-6e5e-4326-b62d-e37f04b0945c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:49:31.702357 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc97e409-6e5e-4326-b62d-e37f04b0945c admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:49:31.724583 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1362/2737] 10.222.0.67 () {60 vars in 1143 bytes} [Wed May 25 14:49:31 2022] POST /identity/v3/users => generated 296 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:49:31.728728 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fe966d-4065-43ca-9315-bc6af2a309c3 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:49:31.739510 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fe966d-4065-43ca-9315-bc6af2a309c3 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:49:31.744841 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c311f70d-c761-451b-82d2-7501992615d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:49:31.745775 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c311f70d-c761-451b-82d2-7501992615d3 admin admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:31.746065 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c311f70d-c761-451b-82d2-7501992615d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:31.746363 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c311f70d-c761-451b-82d2-7501992615d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:31.747124 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c311f70d-c761-451b-82d2-7501992615d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:49:31.748771 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c311f70d-c761-451b-82d2-7501992615d3 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:49:31.761579 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1376/2738] 10.222.0.67 () {58 vars in 1121 bytes} [Wed May 25 14:49:31 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:49:31.766138 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc97e409-6e5e-4326-b62d-e37f04b0945c admin admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:49:31.776718 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc97e409-6e5e-4326-b62d-e37f04b0945c admin admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:49:31.781811 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c108e748-ac3d-41b9-801e-690b55873c75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:49:31.782487 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c108e748-ac3d-41b9-801e-690b55873c75 admin admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:31.782775 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c108e748-ac3d-41b9-801e-690b55873c75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:31.783103 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c108e748-ac3d-41b9-801e-690b55873c75 admin admin] PATH_INFO: `/v3/roles` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:31.783847 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c108e748-ac3d-41b9-801e-690b55873c75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:49:31.785460 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c108e748-ac3d-41b9-801e-690b55873c75 admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:49:31.798326 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1363/2739] 10.222.0.67 () {58 vars in 1121 bytes} [Wed May 25 14:49:31 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:49:31.800296 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c311f70d-c761-451b-82d2-7501992615d3 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:49:31.811022 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c311f70d-c761-451b-82d2-7501992615d3 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:49:31.815690 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03d7007-9929-4889-853f-b8210404551e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:49:31.816654 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03d7007-9929-4889-853f-b8210404551e admin admin] REQUEST_METHOD: `PUT` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:31.817153 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03d7007-9929-4889-853f-b8210404551e admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:31.817434 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03d7007-9929-4889-853f-b8210404551e admin admin] PATH_INFO: `/v3/projects/16893babe2c549fb8127a1ed35f0c1d2/users/a8a1010dd04c4d0d8ddf6af9ef360218/roles/48808901834b4d5eab2c7e6b5b03791e` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:31.837922 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03d7007-9929-4889-853f-b8210404551e admin admin] RBAC: Authorizing `identity:create_grant(project_id=16893babe2c549fb8127a1ed35f0c1d2, user_id=a8a1010dd04c4d0d8ddf6af9ef360218, role_id=48808901834b4d5eab2c7e6b5b03791e)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:49:31.840971 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03d7007-9929-4889-853f-b8210404551e admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:49:31.855251 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1377/2740] 10.222.0.67 () {60 vars in 1482 bytes} [Wed May 25 14:49:31 2022] PUT /identity/v3/projects/16893babe2c549fb8127a1ed35f0c1d2/users/a8a1010dd04c4d0d8ddf6af9ef360218/roles/48808901834b4d5eab2c7e6b5b03791e => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:49:31.871506 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17641d5e-5f83-4dc4-b0dd-88285c2b4d62 None None] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:31.871800 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17641d5e-5f83-4dc4-b0dd-88285c2b4d62 None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:31.872091 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17641d5e-5f83-4dc4-b0dd-88285c2b4d62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:31.901169 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.auth.core [None req-17641d5e-5f83-4dc4-b0dd-88285c2b4d62 None None] MFA Rules not processed for user `a8a1010dd04c4d0d8ddf6af9ef360218`. Rule list: `[]` (Enabled: `True`). {{(pid=80474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:49:31.902368 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-17641d5e-5f83-4dc4-b0dd-88285c2b4d62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:49:31.973449 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1364/2741] 10.222.0.67 () {58 vars in 957 bytes} [Wed May 25 14:49:31 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:49:31.985590 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03d7007-9929-4889-853f-b8210404551e admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:49:31.987463 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-d03d7007-9929-4889-853f-b8210404551e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:49:32.047015 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03d7007-9929-4889-853f-b8210404551e admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:49:32.052829 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e20db6-502f-4076-aec3-8851ac3a64a2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e462acc9da84a61bb23998dd54e1858', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfe93ee8d32a441295efc0b885de4bd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:49:32.053525 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e20db6-502f-4076-aec3-8851ac3a64a2 service cinder] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:32.054425 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e20db6-502f-4076-aec3-8851ac3a64a2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:32.054425 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e20db6-502f-4076-aec3-8851ac3a64a2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:32.064887 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e20db6-502f-4076-aec3-8851ac3a64a2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:49:32.066349 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e20db6-502f-4076-aec3-8851ac3a64a2 service cinder] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:49:32.077273 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1378/2742] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 14:49:31 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:49:34.402820 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6083b089-0b59-4a0d-aa01-f080017c775c None None] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:34.403390 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6083b089-0b59-4a0d-aa01-f080017c775c None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:34.403528 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6083b089-0b59-4a0d-aa01-f080017c775c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:34.422003 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.auth.core [None req-6083b089-0b59-4a0d-aa01-f080017c775c None None] MFA Rules not processed for user `fb8bbe1f1ef1493eb150877078acd476`. Rule list: `[]` (Enabled: `True`). {{(pid=80474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:49:34.423233 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-6083b089-0b59-4a0d-aa01-f080017c775c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:49:34.480445 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1365/2743] 10.222.0.67 () {58 vars in 957 bytes} [Wed May 25 14:49:34 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:49:42.071959 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=83,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:49:42.313803 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e20db6-502f-4076-aec3-8851ac3a64a2 service cinder] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:49:42.387215 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e20db6-502f-4076-aec3-8851ac3a64a2 service cinder] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:49:42.391881 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703fc83b-ea41-4c50-9a12-fbad3932eebd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:49:42.392792 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703fc83b-ea41-4c50-9a12-fbad3932eebd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:42.393081 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703fc83b-ea41-4c50-9a12-fbad3932eebd admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:42.393367 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703fc83b-ea41-4c50-9a12-fbad3932eebd admin admin] PATH_INFO: `/v3/users/a8a1010dd04c4d0d8ddf6af9ef360218` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:42.394630 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703fc83b-ea41-4c50-9a12-fbad3932eebd admin admin] RBAC: Authorizing `identity:delete_user(user_id=a8a1010dd04c4d0d8ddf6af9ef360218)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:49:42.396838 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703fc83b-ea41-4c50-9a12-fbad3932eebd admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:49:42.463971 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-703fc83b-ea41-4c50-9a12-fbad3932eebd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a8a1010dd04c4d0d8ddf6af9ef360218'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:49:42.474575 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-703fc83b-ea41-4c50-9a12-fbad3932eebd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a8a1010dd04c4d0d8ddf6af9ef360218'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:49:42.475328 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-703fc83b-ea41-4c50-9a12-fbad3932eebd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a8a1010dd04c4d0d8ddf6af9ef360218'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:49:42.487298 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-703fc83b-ea41-4c50-9a12-fbad3932eebd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a8a1010dd04c4d0d8ddf6af9ef360218'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:49:42.504679 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-703fc83b-ea41-4c50-9a12-fbad3932eebd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a8a1010dd04c4d0d8ddf6af9ef360218'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:49:42.512940 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1379/2744] 10.222.0.67 () {58 vars in 1223 bytes} [Wed May 25 14:49:42 2022] DELETE /identity/v3/users/a8a1010dd04c4d0d8ddf6af9ef360218 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:49:42.517511 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba51a92a-9c1e-4cc4-831d-ca9b380206e8 None None] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:42.518024 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba51a92a-9c1e-4cc4-831d-ca9b380206e8 None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:42.518131 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba51a92a-9c1e-4cc4-831d-ca9b380206e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:42.539013 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.auth.core [None req-ba51a92a-9c1e-4cc4-831d-ca9b380206e8 None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:49:42.540240 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-ba51a92a-9c1e-4cc4-831d-ca9b380206e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:49:42.583608 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:49:42.626356 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1366/2745] 10.222.0.67 () {58 vars in 957 bytes} [Wed May 25 14:49:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:49:42.638296 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703fc83b-ea41-4c50-9a12-fbad3932eebd admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:49:42.639780 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-703fc83b-ea41-4c50-9a12-fbad3932eebd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:49:42.713529 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703fc83b-ea41-4c50-9a12-fbad3932eebd admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:49:42.722128 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2734e339-8c19-4e84-99dc-2d74b4bb32d6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b68eed985c7b49839bcdd173186ad4ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfe93ee8d32a441295efc0b885de4bd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:49:42.722800 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2734e339-8c19-4e84-99dc-2d74b4bb32d6 service neutron] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:42.723128 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2734e339-8c19-4e84-99dc-2d74b4bb32d6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:42.723404 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2734e339-8c19-4e84-99dc-2d74b4bb32d6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:42.736490 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2734e339-8c19-4e84-99dc-2d74b4bb32d6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:49:42.737957 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2734e339-8c19-4e84-99dc-2d74b4bb32d6 service neutron] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:49:42.749915 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1380/2746] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 14:49:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:49:43.145924 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba51a92a-9c1e-4cc4-831d-ca9b380206e8 None None] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:49:43.148163 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-ba51a92a-9c1e-4cc4-831d-ca9b380206e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:49:43.177926 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba51a92a-9c1e-4cc4-831d-ca9b380206e8 None None] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:49:43.186322 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d7380e-3465-4ed8-806a-8a4291ee5808 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:49:43.187686 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d7380e-3465-4ed8-806a-8a4291ee5808 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:43.188072 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d7380e-3465-4ed8-806a-8a4291ee5808 admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:43.188480 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d7380e-3465-4ed8-806a-8a4291ee5808 admin admin] PATH_INFO: `/v3/projects/16893babe2c549fb8127a1ed35f0c1d2` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:43.190285 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d7380e-3465-4ed8-806a-8a4291ee5808 admin admin] RBAC: Authorizing `identity:delete_project(project_id=16893babe2c549fb8127a1ed35f0c1d2)` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:49:43.193869 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d7380e-3465-4ed8-806a-8a4291ee5808 admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:49:43.251000 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-b6d7380e-3465-4ed8-806a-8a4291ee5808 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '16893babe2c549fb8127a1ed35f0c1d2', 'request_id': 'req-b6d7380e-3465-4ed8-806a-8a4291ee5808'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:49:43.258722 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-b6d7380e-3465-4ed8-806a-8a4291ee5808 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '16893babe2c549fb8127a1ed35f0c1d2', 'request_id': 'req-b6d7380e-3465-4ed8-806a-8a4291ee5808'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:49:43.265810 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-b6d7380e-3465-4ed8-806a-8a4291ee5808 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '16893babe2c549fb8127a1ed35f0c1d2', 'request_id': 'req-b6d7380e-3465-4ed8-806a-8a4291ee5808'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:49:43.281194 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-b6d7380e-3465-4ed8-806a-8a4291ee5808 admin admin] The token cache is being invalidate because project 16893babe2c549fb8127a1ed35f0c1d2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80474) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 14:49:43.281599 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-b6d7380e-3465-4ed8-806a-8a4291ee5808 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:49:43.282309 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-b6d7380e-3465-4ed8-806a-8a4291ee5808 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:49:43.283933 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1367/2747] 10.222.0.67 () {58 vars in 1232 bytes} [Wed May 25 14:49:43 2022] DELETE /identity/v3/projects/16893babe2c549fb8127a1ed35f0c1d2 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 14:49:52.745223 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=79,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:49:53.275604 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=38,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:50:10.491898 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2734e339-8c19-4e84-99dc-2d74b4bb32d6 service neutron] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:50:10.493577 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-2734e339-8c19-4e84-99dc-2d74b4bb32d6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:50:10.580929 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2734e339-8c19-4e84-99dc-2d74b4bb32d6 service neutron] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:50:10.653105 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c86fd7f-3ba4-4c5d-aa4a-0015dbbe27b4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad2b99c2122a4311996364e982e1c801', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfe93ee8d32a441295efc0b885de4bd7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:50:10.653903 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c86fd7f-3ba4-4c5d-aa4a-0015dbbe27b4 service placement] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:50:10.654197 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c86fd7f-3ba4-4c5d-aa4a-0015dbbe27b4 service placement] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:50:10.654485 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c86fd7f-3ba4-4c5d-aa4a-0015dbbe27b4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:50:10.656755 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-8c86fd7f-3ba4-4c5d-aa4a-0015dbbe27b4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:50:10.669397 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c86fd7f-3ba4-4c5d-aa4a-0015dbbe27b4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:50:10.671049 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c86fd7f-3ba4-4c5d-aa4a-0015dbbe27b4 service placement] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:50:10.682191 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1381/2748] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 14:50:10 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:50:12.006407 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef12329-bebf-4a12-8340-1eb4283b1bb7 None None] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:50:12.007084 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef12329-bebf-4a12-8340-1eb4283b1bb7 None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:50:12.007396 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef12329-bebf-4a12-8340-1eb4283b1bb7 None None] PATH_INFO: `/` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:50:12.009636 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1368/2749] 10.222.0.67 () {54 vars in 921 bytes} [Wed May 25 14:50:12 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:50:12.018649 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95825ff-0498-480e-8b45-f0ab315ee6f2 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:50:12.021473 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95825ff-0498-480e-8b45-f0ab315ee6f2 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:50:12.021473 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95825ff-0498-480e-8b45-f0ab315ee6f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:50:12.062567 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-a95825ff-0498-480e-8b45-f0ab315ee6f2 None None] MFA Rules not processed for user `b68eed985c7b49839bcdd173186ad4ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:50:12.063838 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-a95825ff-0498-480e-8b45-f0ab315ee6f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:50:12.124216 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1382/2750] 10.222.0.67 () {58 vars in 1018 bytes} [Wed May 25 14:50:12 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:50:12.136543 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef12329-bebf-4a12-8340-1eb4283b1bb7 None None] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:50:12.138604 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-1ef12329-bebf-4a12-8340-1eb4283b1bb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:50:12.157172 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef12329-bebf-4a12-8340-1eb4283b1bb7 None None] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:50:12.160940 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c45a2e-e239-47d5-b9f1-fe097c54b5ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b68eed985c7b49839bcdd173186ad4ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfe93ee8d32a441295efc0b885de4bd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:50:12.161594 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c45a2e-e239-47d5-b9f1-fe097c54b5ab service neutron] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:50:12.161883 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c45a2e-e239-47d5-b9f1-fe097c54b5ab service neutron] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:50:12.162163 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c45a2e-e239-47d5-b9f1-fe097c54b5ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:50:12.171001 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c45a2e-e239-47d5-b9f1-fe097c54b5ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:50:12.172493 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c45a2e-e239-47d5-b9f1-fe097c54b5ab service neutron] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:50:12.181437 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1369/2751] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 14:50:12 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:50:12.268603 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d94a77-711b-4879-a692-bde81dc25aa2 None None] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:50:12.268907 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d94a77-711b-4879-a692-bde81dc25aa2 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:50:12.269169 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d94a77-711b-4879-a692-bde81dc25aa2 None None] PATH_INFO: `/` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:50:12.270537 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1383/2752] 10.222.0.67 () {54 vars in 921 bytes} [Wed May 25 14:50:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:50:12.276549 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffd11bf-07d0-4a08-b897-b74884406051 None None] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:50:12.276860 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffd11bf-07d0-4a08-b897-b74884406051 None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:50:12.277289 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffd11bf-07d0-4a08-b897-b74884406051 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:50:12.297564 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.auth.core [None req-bffd11bf-07d0-4a08-b897-b74884406051 None None] MFA Rules not processed for user `428ec99478284743943ed41e9d24a603`. Rule list: `[]` (Enabled: `True`). {{(pid=80474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:50:12.298784 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-bffd11bf-07d0-4a08-b897-b74884406051 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:50:12.370674 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1370/2753] 10.222.0.67 () {58 vars in 1018 bytes} [Wed May 25 14:50:12 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 14:50:12.381502 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d94a77-711b-4879-a692-bde81dc25aa2 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:50:12.383390 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-58d94a77-711b-4879-a692-bde81dc25aa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:50:12.397537 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d94a77-711b-4879-a692-bde81dc25aa2 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:50:12.402106 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11606d03-3f5b-4b73-bdd0-620633c980a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b68eed985c7b49839bcdd173186ad4ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfe93ee8d32a441295efc0b885de4bd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:50:12.402743 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11606d03-3f5b-4b73-bdd0-620633c980a0 service neutron] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:50:12.403057 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11606d03-3f5b-4b73-bdd0-620633c980a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:50:12.403339 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11606d03-3f5b-4b73-bdd0-620633c980a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:50:12.413829 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11606d03-3f5b-4b73-bdd0-620633c980a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:50:12.416463 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11606d03-3f5b-4b73-bdd0-620633c980a0 service neutron] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:50:12.428176 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1384/2754] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 14:50:12 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:50:22.360360 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=37 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:50:22.422838 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=93 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:50:35.729423 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3d6dd6-e389-46f5-94b6-e74d191726f6 None None] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:50:35.729990 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3d6dd6-e389-46f5-94b6-e74d191726f6 None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:50:35.729990 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3d6dd6-e389-46f5-94b6-e74d191726f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:50:35.748481 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.auth.core [None req-eb3d6dd6-e389-46f5-94b6-e74d191726f6 None None] MFA Rules not processed for user `fb8bbe1f1ef1493eb150877078acd476`. Rule list: `[]` (Enabled: `True`). {{(pid=80474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:50:35.749703 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-eb3d6dd6-e389-46f5-94b6-e74d191726f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:50:35.817653 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1371/2755] 10.222.0.67 () {58 vars in 957 bytes} [Wed May 25 14:50:35 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:50:45.810811 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=25 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:51:35.733342 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210fb430-d73c-4ad0-b883-882b22b6d608 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:51:35.733939 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210fb430-d73c-4ad0-b883-882b22b6d608 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:51:35.733939 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210fb430-d73c-4ad0-b883-882b22b6d608 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:51:35.752626 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-210fb430-d73c-4ad0-b883-882b22b6d608 None None] MFA Rules not processed for user `fb8bbe1f1ef1493eb150877078acd476`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:51:35.753906 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-210fb430-d73c-4ad0-b883-882b22b6d608 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:51:35.761045 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1385/2756] 10.222.0.67 () {58 vars in 957 bytes} [Wed May 25 14:51:35 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:51:38.289276 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3d6dd6-e389-46f5-94b6-e74d191726f6 None None] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:51:38.299981 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3d6dd6-e389-46f5-94b6-e74d191726f6 None None] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:51:38.305040 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b3c636-4446-4600-a2c6-883ac9c96dad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b68eed985c7b49839bcdd173186ad4ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfe93ee8d32a441295efc0b885de4bd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:51:38.306096 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b3c636-4446-4600-a2c6-883ac9c96dad service neutron] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:51:38.306386 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b3c636-4446-4600-a2c6-883ac9c96dad service neutron] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:51:38.306665 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b3c636-4446-4600-a2c6-883ac9c96dad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:51:38.308565 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-08b3c636-4446-4600-a2c6-883ac9c96dad service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:51:38.325979 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b3c636-4446-4600-a2c6-883ac9c96dad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:51:38.327482 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b3c636-4446-4600-a2c6-883ac9c96dad service neutron] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:51:38.351442 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1372/2757] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 14:51:38 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:51:38.635915 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210fb430-d73c-4ad0-b883-882b22b6d608 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:51:38.649230 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210fb430-d73c-4ad0-b883-882b22b6d608 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:51:38.654284 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2666909-bb21-4125-96db-b85fc4f8adfe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b68eed985c7b49839bcdd173186ad4ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfe93ee8d32a441295efc0b885de4bd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:51:38.655415 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2666909-bb21-4125-96db-b85fc4f8adfe service neutron] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:51:38.655896 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2666909-bb21-4125-96db-b85fc4f8adfe service neutron] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:51:38.656181 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2666909-bb21-4125-96db-b85fc4f8adfe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:51:38.658389 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-e2666909-bb21-4125-96db-b85fc4f8adfe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:51:38.679100 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2666909-bb21-4125-96db-b85fc4f8adfe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:51:38.681092 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2666909-bb21-4125-96db-b85fc4f8adfe service neutron] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:51:38.702656 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1386/2758] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 14:51:38 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:51:40.572882 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b3c636-4446-4600-a2c6-883ac9c96dad service neutron] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:51:40.574558 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-08b3c636-4446-4600-a2c6-883ac9c96dad service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:51:40.591140 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b3c636-4446-4600-a2c6-883ac9c96dad service neutron] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:51:40.596867 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b839aac5-104c-4402-a63e-edb6eaef092f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '428ec99478284743943ed41e9d24a603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfe93ee8d32a441295efc0b885de4bd7', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:51:40.597800 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b839aac5-104c-4402-a63e-edb6eaef092f service nova] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:51:40.598252 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b839aac5-104c-4402-a63e-edb6eaef092f service nova] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:51:40.598530 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b839aac5-104c-4402-a63e-edb6eaef092f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:51:40.601160 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-b839aac5-104c-4402-a63e-edb6eaef092f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:51:40.618686 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b839aac5-104c-4402-a63e-edb6eaef092f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:51:40.620319 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b839aac5-104c-4402-a63e-edb6eaef092f service nova] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:51:40.632777 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1373/2759] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 14:51:40 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 14:51:48.695784 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=9 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:51:50.507426 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2666909-bb21-4125-96db-b85fc4f8adfe service neutron] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:51:50.509888 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-e2666909-bb21-4125-96db-b85fc4f8adfe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:51:50.607788 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2666909-bb21-4125-96db-b85fc4f8adfe service neutron] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:51:50.612332 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab62124f-9da6-43ed-9003-46cacc87222a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:51:50.613220 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab62124f-9da6-43ed-9003-46cacc87222a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:51:50.613688 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab62124f-9da6-43ed-9003-46cacc87222a admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:51:50.613956 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab62124f-9da6-43ed-9003-46cacc87222a admin admin] PATH_INFO: `/v3/users/8413124333524161a13a8a25ccc094b8` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:51:50.615236 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab62124f-9da6-43ed-9003-46cacc87222a admin admin] RBAC: Authorizing `identity:delete_user(user_id=8413124333524161a13a8a25ccc094b8)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:51:50.617827 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab62124f-9da6-43ed-9003-46cacc87222a admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:51:50.627337 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=12 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:51:50.679765 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-ab62124f-9da6-43ed-9003-46cacc87222a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8413124333524161a13a8a25ccc094b8'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:51:50.688193 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-ab62124f-9da6-43ed-9003-46cacc87222a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8413124333524161a13a8a25ccc094b8'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:51:50.690978 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-ab62124f-9da6-43ed-9003-46cacc87222a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8413124333524161a13a8a25ccc094b8'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:51:50.699573 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-ab62124f-9da6-43ed-9003-46cacc87222a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8413124333524161a13a8a25ccc094b8'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:51:50.722552 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-ab62124f-9da6-43ed-9003-46cacc87222a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8413124333524161a13a8a25ccc094b8'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:51:50.730355 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1387/2760] 10.222.0.67 () {58 vars in 1223 bytes} [Wed May 25 14:51:50 2022] DELETE /identity/v3/users/8413124333524161a13a8a25ccc094b8 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:51:50.925087 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b839aac5-104c-4402-a63e-edb6eaef092f service nova] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:51:50.941470 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b839aac5-104c-4402-a63e-edb6eaef092f service nova] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:51:51.007993 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c0df18-23b8-4115-a602-79950391d542 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:51:51.008851 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c0df18-23b8-4115-a602-79950391d542 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:51:51.009134 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c0df18-23b8-4115-a602-79950391d542 admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:51:51.009417 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c0df18-23b8-4115-a602-79950391d542 admin admin] PATH_INFO: `/v3/projects/539a6be5a2584df1ac3d9acb0cba4dba` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:51:51.010607 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c0df18-23b8-4115-a602-79950391d542 admin admin] RBAC: Authorizing `identity:delete_project(project_id=539a6be5a2584df1ac3d9acb0cba4dba)` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:51:51.012807 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c0df18-23b8-4115-a602-79950391d542 admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:51:51.060351 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-98c0df18-23b8-4115-a602-79950391d542 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '539a6be5a2584df1ac3d9acb0cba4dba', 'request_id': 'req-98c0df18-23b8-4115-a602-79950391d542'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:51:51.067559 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-98c0df18-23b8-4115-a602-79950391d542 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '539a6be5a2584df1ac3d9acb0cba4dba', 'request_id': 'req-98c0df18-23b8-4115-a602-79950391d542'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:51:51.078157 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-98c0df18-23b8-4115-a602-79950391d542 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '539a6be5a2584df1ac3d9acb0cba4dba', 'request_id': 'req-98c0df18-23b8-4115-a602-79950391d542'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:51:51.089638 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-98c0df18-23b8-4115-a602-79950391d542 admin admin] The token cache is being invalidate because project 539a6be5a2584df1ac3d9acb0cba4dba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80474) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 14:51:51.089922 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-98c0df18-23b8-4115-a602-79950391d542 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:51:51.090621 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-98c0df18-23b8-4115-a602-79950391d542 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:51:51.092341 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1374/2761] 10.222.0.67 () {58 vars in 1232 bytes} [Wed May 25 14:51:50 2022] DELETE /identity/v3/projects/539a6be5a2584df1ac3d9acb0cba4dba => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:51:51.098405 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab62124f-9da6-43ed-9003-46cacc87222a admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:51:51.101974 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-ab62124f-9da6-43ed-9003-46cacc87222a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:51:51.117927 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab62124f-9da6-43ed-9003-46cacc87222a admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:51:51.179120 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6276a118-d960-493f-a973-1be393ee017e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:51:51.180004 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6276a118-d960-493f-a973-1be393ee017e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:51:51.180292 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6276a118-d960-493f-a973-1be393ee017e admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:51:51.180570 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6276a118-d960-493f-a973-1be393ee017e admin admin] PATH_INFO: `/v3/users/26064829e934426ba891c7f517705d75` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:51:51.181788 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6276a118-d960-493f-a973-1be393ee017e admin admin] RBAC: Authorizing `identity:delete_user(user_id=26064829e934426ba891c7f517705d75)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:51:51.183753 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6276a118-d960-493f-a973-1be393ee017e admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:51:51.206378 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:51:51.238296 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-6276a118-d960-493f-a973-1be393ee017e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '26064829e934426ba891c7f517705d75'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:51:51.247117 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-6276a118-d960-493f-a973-1be393ee017e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '26064829e934426ba891c7f517705d75'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:51:51.247794 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-6276a118-d960-493f-a973-1be393ee017e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '26064829e934426ba891c7f517705d75'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:51:51.255127 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-6276a118-d960-493f-a973-1be393ee017e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '26064829e934426ba891c7f517705d75'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:51:51.268664 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-6276a118-d960-493f-a973-1be393ee017e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '26064829e934426ba891c7f517705d75'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:51:51.275458 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1388/2762] 10.222.0.67 () {58 vars in 1223 bytes} [Wed May 25 14:51:51 2022] DELETE /identity/v3/users/26064829e934426ba891c7f517705d75 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:51:51.452201 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c0df18-23b8-4115-a602-79950391d542 admin admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:51:51.454308 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-98c0df18-23b8-4115-a602-79950391d542 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:51:51.477305 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c0df18-23b8-4115-a602-79950391d542 admin admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:51:51.546862 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2da7ace-1ac6-4764-babc-48a2e9ceb082 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:51:51.547885 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2da7ace-1ac6-4764-babc-48a2e9ceb082 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:51:51.548163 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2da7ace-1ac6-4764-babc-48a2e9ceb082 admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:51:51.548477 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2da7ace-1ac6-4764-babc-48a2e9ceb082 admin admin] PATH_INFO: `/v3/projects/f90292b386044d93be967371ce5b51c6` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:51:51.549755 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2da7ace-1ac6-4764-babc-48a2e9ceb082 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f90292b386044d93be967371ce5b51c6)` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:51:51.551724 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2da7ace-1ac6-4764-babc-48a2e9ceb082 admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:51:51.594534 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:51:51.611697 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-c2da7ace-1ac6-4764-babc-48a2e9ceb082 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f90292b386044d93be967371ce5b51c6', 'request_id': 'req-c2da7ace-1ac6-4764-babc-48a2e9ceb082'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:51:51.621665 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-c2da7ace-1ac6-4764-babc-48a2e9ceb082 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f90292b386044d93be967371ce5b51c6', 'request_id': 'req-c2da7ace-1ac6-4764-babc-48a2e9ceb082'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:51:51.629065 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-c2da7ace-1ac6-4764-babc-48a2e9ceb082 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f90292b386044d93be967371ce5b51c6', 'request_id': 'req-c2da7ace-1ac6-4764-babc-48a2e9ceb082'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:51:51.645054 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-c2da7ace-1ac6-4764-babc-48a2e9ceb082 admin admin] The token cache is being invalidate because project f90292b386044d93be967371ce5b51c6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80474) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 14:51:51.645440 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-c2da7ace-1ac6-4764-babc-48a2e9ceb082 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:51:51.646181 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-c2da7ace-1ac6-4764-babc-48a2e9ceb082 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:51:51.648199 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1375/2763] 10.222.0.67 () {58 vars in 1232 bytes} [Wed May 25 14:51:51 2022] DELETE /identity/v3/projects/f90292b386044d93be967371ce5b51c6 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:52:01.271182 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:DELETE=7,keystone:SELECT=20,keystone:INSERT=1 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:52:01.641631 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=12,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:52:34.353788 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6276a118-d960-493f-a973-1be393ee017e admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:52:34.356136 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-6276a118-d960-493f-a973-1be393ee017e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:52:34.458619 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6276a118-d960-493f-a973-1be393ee017e admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:52:34.566957 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94bb129-ad9e-4e21-8cbd-35ed3988023a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '428ec99478284743943ed41e9d24a603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfe93ee8d32a441295efc0b885de4bd7', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:52:34.567684 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94bb129-ad9e-4e21-8cbd-35ed3988023a service nova] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:52:34.567968 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94bb129-ad9e-4e21-8cbd-35ed3988023a service nova] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:52:34.568402 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94bb129-ad9e-4e21-8cbd-35ed3988023a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:52:34.570708 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-b94bb129-ad9e-4e21-8cbd-35ed3988023a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:52:34.590313 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94bb129-ad9e-4e21-8cbd-35ed3988023a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:52:34.592105 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94bb129-ad9e-4e21-8cbd-35ed3988023a service nova] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:52:34.605231 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1389/2764] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 14:52:34 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:52:43.669019 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2da7ace-1ac6-4764-babc-48a2e9ceb082 admin admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:52:43.670560 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-c2da7ace-1ac6-4764-babc-48a2e9ceb082 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:52:43.748664 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94bb129-ad9e-4e21-8cbd-35ed3988023a service nova] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:52:43.750249 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-b94bb129-ad9e-4e21-8cbd-35ed3988023a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:52:43.773890 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2da7ace-1ac6-4764-babc-48a2e9ceb082 admin admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:52:43.779099 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2703cd-e06e-4246-9318-a0067a9998a2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad2b99c2122a4311996364e982e1c801', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfe93ee8d32a441295efc0b885de4bd7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:52:43.779867 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2703cd-e06e-4246-9318-a0067a9998a2 service placement] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:52:43.780219 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2703cd-e06e-4246-9318-a0067a9998a2 service placement] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:52:43.780562 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2703cd-e06e-4246-9318-a0067a9998a2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:52:43.782489 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-9c2703cd-e06e-4246-9318-a0067a9998a2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:52:43.796380 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2703cd-e06e-4246-9318-a0067a9998a2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:52:43.799075 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2703cd-e06e-4246-9318-a0067a9998a2 service placement] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:52:43.811814 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1376/2765] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 14:52:43 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:52:43.851156 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94bb129-ad9e-4e21-8cbd-35ed3988023a service nova] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:52:43.855752 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8ada45-7eee-40d3-a129-43abe97e7a5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:52:43.856625 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8ada45-7eee-40d3-a129-43abe97e7a5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:52:43.856905 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8ada45-7eee-40d3-a129-43abe97e7a5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:52:43.857174 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8ada45-7eee-40d3-a129-43abe97e7a5a admin admin] PATH_INFO: `/v3/users/fb8bbe1f1ef1493eb150877078acd476` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:52:43.859644 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8ada45-7eee-40d3-a129-43abe97e7a5a admin admin] RBAC: Authorizing `identity:delete_user(user_id=fb8bbe1f1ef1493eb150877078acd476)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:52:43.861572 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8ada45-7eee-40d3-a129-43abe97e7a5a admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:52:43.899353 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:52:43.920700 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-ee8ada45-7eee-40d3-a129-43abe97e7a5a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fb8bbe1f1ef1493eb150877078acd476'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:52:43.928140 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-ee8ada45-7eee-40d3-a129-43abe97e7a5a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fb8bbe1f1ef1493eb150877078acd476'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:52:43.928867 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-ee8ada45-7eee-40d3-a129-43abe97e7a5a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fb8bbe1f1ef1493eb150877078acd476'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:52:43.936633 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-ee8ada45-7eee-40d3-a129-43abe97e7a5a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fb8bbe1f1ef1493eb150877078acd476'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:52:43.949008 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-ee8ada45-7eee-40d3-a129-43abe97e7a5a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fb8bbe1f1ef1493eb150877078acd476'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:52:43.956489 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1390/2766] 10.222.0.67 () {58 vars in 1223 bytes} [Wed May 25 14:52:43 2022] DELETE /identity/v3/users/fb8bbe1f1ef1493eb150877078acd476 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:52:44.144963 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2703cd-e06e-4246-9318-a0067a9998a2 service placement] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:52:44.156959 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2703cd-e06e-4246-9318-a0067a9998a2 service placement] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:52:44.222553 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cba214b-aafd-43e4-b46b-75d4a78d6f47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:52:44.223456 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cba214b-aafd-43e4-b46b-75d4a78d6f47 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:52:44.223745 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cba214b-aafd-43e4-b46b-75d4a78d6f47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:52:44.224027 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cba214b-aafd-43e4-b46b-75d4a78d6f47 admin admin] PATH_INFO: `/v3/projects/a3b546c5706c4012a3ff2e144a23694a` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:52:44.225853 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cba214b-aafd-43e4-b46b-75d4a78d6f47 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a3b546c5706c4012a3ff2e144a23694a)` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:52:44.227810 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cba214b-aafd-43e4-b46b-75d4a78d6f47 admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:52:44.280525 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-7cba214b-aafd-43e4-b46b-75d4a78d6f47 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a3b546c5706c4012a3ff2e144a23694a', 'request_id': 'req-7cba214b-aafd-43e4-b46b-75d4a78d6f47'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:52:44.288695 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-7cba214b-aafd-43e4-b46b-75d4a78d6f47 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a3b546c5706c4012a3ff2e144a23694a', 'request_id': 'req-7cba214b-aafd-43e4-b46b-75d4a78d6f47'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:52:44.295239 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-7cba214b-aafd-43e4-b46b-75d4a78d6f47 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a3b546c5706c4012a3ff2e144a23694a', 'request_id': 'req-7cba214b-aafd-43e4-b46b-75d4a78d6f47'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:52:44.306511 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-7cba214b-aafd-43e4-b46b-75d4a78d6f47 admin admin] The token cache is being invalidate because project a3b546c5706c4012a3ff2e144a23694a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80474) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 14:52:44.306793 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-7cba214b-aafd-43e4-b46b-75d4a78d6f47 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:52:44.307491 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-7cba214b-aafd-43e4-b46b-75d4a78d6f47 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:52:44.309027 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1377/2767] 10.222.0.67 () {58 vars in 1232 bytes} [Wed May 25 14:52:44 2022] DELETE /identity/v3/projects/a3b546c5706c4012a3ff2e144a23694a => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:52:44.314129 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdca4aec-17bf-4a65-906f-44a2d786f430 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:52:44.314332 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdca4aec-17bf-4a65-906f-44a2d786f430 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:52:44.314530 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdca4aec-17bf-4a65-906f-44a2d786f430 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:52:44.333144 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-bdca4aec-17bf-4a65-906f-44a2d786f430 None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:52:44.335035 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-bdca4aec-17bf-4a65-906f-44a2d786f430 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:52:44.402050 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1391/2768] 10.222.0.67 () {58 vars in 957 bytes} [Wed May 25 14:52:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:52:44.409953 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317d6a4e-270d-4e44-8ce5-c2950ebd5728 None None] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:52:44.410246 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317d6a4e-270d-4e44-8ce5-c2950ebd5728 None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:52:44.410528 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317d6a4e-270d-4e44-8ce5-c2950ebd5728 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:52:44.429653 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.auth.core [None req-317d6a4e-270d-4e44-8ce5-c2950ebd5728 None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:52:44.430900 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-317d6a4e-270d-4e44-8ce5-c2950ebd5728 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:52:44.439673 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1378/2769] 10.222.0.67 () {58 vars in 957 bytes} [Wed May 25 14:52:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:52:44.444066 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdca4aec-17bf-4a65-906f-44a2d786f430 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:52:44.454166 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdca4aec-17bf-4a65-906f-44a2d786f430 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:52:44.459826 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48710c8d-fdf2-4eda-bba0-5d1f96211c65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:52:44.460191 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48710c8d-fdf2-4eda-bba0-5d1f96211c65 admin admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:52:44.460499 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48710c8d-fdf2-4eda-bba0-5d1f96211c65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:52:44.460758 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48710c8d-fdf2-4eda-bba0-5d1f96211c65 admin admin] PATH_INFO: `/v3/domains` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:52:44.461498 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48710c8d-fdf2-4eda-bba0-5d1f96211c65 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:52:44.461808 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48710c8d-fdf2-4eda-bba0-5d1f96211c65 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:52:44.463461 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48710c8d-fdf2-4eda-bba0-5d1f96211c65 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:52:44.476767 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1392/2770] 10.222.0.67 () {58 vars in 1152 bytes} [Wed May 25 14:52:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:52:44.481243 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317d6a4e-270d-4e44-8ce5-c2950ebd5728 None None] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:52:44.490760 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317d6a4e-270d-4e44-8ce5-c2950ebd5728 None None] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:52:44.495553 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d38e14-0d7d-4d13-8121-fd7526b080a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:52:44.496214 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d38e14-0d7d-4d13-8121-fd7526b080a3 admin admin] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:52:44.496495 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d38e14-0d7d-4d13-8121-fd7526b080a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:52:44.496787 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d38e14-0d7d-4d13-8121-fd7526b080a3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:52:44.497479 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d38e14-0d7d-4d13-8121-fd7526b080a3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:52:44.499413 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d38e14-0d7d-4d13-8121-fd7526b080a3 admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:52:44.509983 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:52:44.531106 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1379/2771] 10.222.0.67 () {60 vars in 1152 bytes} [Wed May 25 14:52:44 2022] POST /identity/v3/projects => generated 387 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:52:44.533958 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48710c8d-fdf2-4eda-bba0-5d1f96211c65 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:52:44.545140 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48710c8d-fdf2-4eda-bba0-5d1f96211c65 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:52:44.605280 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff36f0ca-0265-438d-a070-74611c897af1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:52:44.605952 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff36f0ca-0265-438d-a070-74611c897af1 admin admin] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:52:44.606237 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff36f0ca-0265-438d-a070-74611c897af1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:52:44.606516 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff36f0ca-0265-438d-a070-74611c897af1 admin admin] PATH_INFO: `/v3/users` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:52:44.607282 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff36f0ca-0265-438d-a070-74611c897af1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:52:44.609241 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff36f0ca-0265-438d-a070-74611c897af1 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:52:44.633522 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1393/2772] 10.222.0.67 () {60 vars in 1143 bytes} [Wed May 25 14:52:44 2022] POST /identity/v3/users => generated 294 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:52:44.637221 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d38e14-0d7d-4d13-8121-fd7526b080a3 admin admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:52:44.648188 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d38e14-0d7d-4d13-8121-fd7526b080a3 admin admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:52:44.652831 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1b11a7-6552-4f0c-b8b8-9907ec8e39f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:52:44.653498 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1b11a7-6552-4f0c-b8b8-9907ec8e39f4 admin admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:52:44.653783 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1b11a7-6552-4f0c-b8b8-9907ec8e39f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:52:44.654059 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1b11a7-6552-4f0c-b8b8-9907ec8e39f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:52:44.654799 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1b11a7-6552-4f0c-b8b8-9907ec8e39f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:52:44.656447 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1b11a7-6552-4f0c-b8b8-9907ec8e39f4 admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:52:44.669622 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1380/2773] 10.222.0.67 () {58 vars in 1121 bytes} [Wed May 25 14:52:44 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:52:44.673580 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff36f0ca-0265-438d-a070-74611c897af1 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:52:44.685002 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff36f0ca-0265-438d-a070-74611c897af1 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:52:44.689910 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03affd42-2a35-4eb9-b4fd-43f1b635eed1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:52:44.690591 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03affd42-2a35-4eb9-b4fd-43f1b635eed1 admin admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:52:44.690882 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03affd42-2a35-4eb9-b4fd-43f1b635eed1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:52:44.691194 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03affd42-2a35-4eb9-b4fd-43f1b635eed1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:52:44.691943 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03affd42-2a35-4eb9-b4fd-43f1b635eed1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:52:44.694299 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03affd42-2a35-4eb9-b4fd-43f1b635eed1 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:52:44.706411 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1394/2774] 10.222.0.67 () {58 vars in 1121 bytes} [Wed May 25 14:52:44 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:52:44.710776 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1b11a7-6552-4f0c-b8b8-9907ec8e39f4 admin admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:52:44.722698 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1b11a7-6552-4f0c-b8b8-9907ec8e39f4 admin admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:52:44.728220 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2560da58-a950-41cf-80d8-a3f4fae85ae7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:52:44.729119 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2560da58-a950-41cf-80d8-a3f4fae85ae7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:52:44.729407 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2560da58-a950-41cf-80d8-a3f4fae85ae7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:52:44.729688 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2560da58-a950-41cf-80d8-a3f4fae85ae7 admin admin] PATH_INFO: `/v3/projects/c5bebea1f919491fad0711a951ad315f/users/40dd5ef154544a66a43f313383e28e77/roles/48808901834b4d5eab2c7e6b5b03791e` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:52:44.745726 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2560da58-a950-41cf-80d8-a3f4fae85ae7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c5bebea1f919491fad0711a951ad315f, user_id=40dd5ef154544a66a43f313383e28e77, role_id=48808901834b4d5eab2c7e6b5b03791e)` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:52:44.748559 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2560da58-a950-41cf-80d8-a3f4fae85ae7 admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:52:44.765380 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1381/2775] 10.222.0.67 () {60 vars in 1482 bytes} [Wed May 25 14:52:44 2022] PUT /identity/v3/projects/c5bebea1f919491fad0711a951ad315f/users/40dd5ef154544a66a43f313383e28e77/roles/48808901834b4d5eab2c7e6b5b03791e => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:52:44.775822 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbfac1e-1557-4a28-96a1-34ea724c0efc None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:52:44.776412 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbfac1e-1557-4a28-96a1-34ea724c0efc None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:52:44.776412 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbfac1e-1557-4a28-96a1-34ea724c0efc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:52:44.796365 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:52:44.809290 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-9cbfac1e-1557-4a28-96a1-34ea724c0efc None None] MFA Rules not processed for user `40dd5ef154544a66a43f313383e28e77`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:52:44.811135 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-9cbfac1e-1557-4a28-96a1-34ea724c0efc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:52:44.881214 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1395/2776] 10.222.0.67 () {58 vars in 957 bytes} [Wed May 25 14:52:44 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 14:52:44.885941 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2560da58-a950-41cf-80d8-a3f4fae85ae7 admin admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:52:44.950277 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2560da58-a950-41cf-80d8-a3f4fae85ae7 admin admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:52:44.955160 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caca36a6-5a04-4a3e-b3f5-e5e5444266d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:52:44.955823 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caca36a6-5a04-4a3e-b3f5-e5e5444266d3 admin admin] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:52:44.956113 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caca36a6-5a04-4a3e-b3f5-e5e5444266d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:52:44.956393 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caca36a6-5a04-4a3e-b3f5-e5e5444266d3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:52:44.957101 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caca36a6-5a04-4a3e-b3f5-e5e5444266d3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:52:44.959025 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caca36a6-5a04-4a3e-b3f5-e5e5444266d3 admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:52:44.985675 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1382/2777] 10.222.0.67 () {60 vars in 1152 bytes} [Wed May 25 14:52:44 2022] POST /identity/v3/projects => generated 387 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 14:52:44.991064 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbfac1e-1557-4a28-96a1-34ea724c0efc None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:52:45.007799 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbfac1e-1557-4a28-96a1-34ea724c0efc None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:52:45.073317 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920d836a-b332-4b79-b8e5-b8b16623da82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:52:45.073907 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920d836a-b332-4b79-b8e5-b8b16623da82 admin admin] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:52:45.074199 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920d836a-b332-4b79-b8e5-b8b16623da82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:52:45.074478 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920d836a-b332-4b79-b8e5-b8b16623da82 admin admin] PATH_INFO: `/v3/users` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:52:45.075216 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920d836a-b332-4b79-b8e5-b8b16623da82 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:52:45.077148 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920d836a-b332-4b79-b8e5-b8b16623da82 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:52:45.101354 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1396/2778] 10.222.0.67 () {60 vars in 1143 bytes} [Wed May 25 14:52:44 2022] POST /identity/v3/users => generated 294 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:52:45.105896 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caca36a6-5a04-4a3e-b3f5-e5e5444266d3 admin admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:52:45.116378 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caca36a6-5a04-4a3e-b3f5-e5e5444266d3 admin admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:52:45.121144 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0604cd18-69f6-4553-86fb-838331c5ab4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:52:45.121799 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0604cd18-69f6-4553-86fb-838331c5ab4e admin admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:52:45.122081 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0604cd18-69f6-4553-86fb-838331c5ab4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:52:45.122356 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0604cd18-69f6-4553-86fb-838331c5ab4e admin admin] PATH_INFO: `/v3/roles` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:52:45.123158 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0604cd18-69f6-4553-86fb-838331c5ab4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:52:45.124767 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0604cd18-69f6-4553-86fb-838331c5ab4e admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:52:45.137151 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1383/2779] 10.222.0.67 () {58 vars in 1121 bytes} [Wed May 25 14:52:45 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:52:45.141451 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920d836a-b332-4b79-b8e5-b8b16623da82 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:52:45.152161 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920d836a-b332-4b79-b8e5-b8b16623da82 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:52:45.156939 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78aec6d-3eeb-48ed-b6d8-1b5adfebb0e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:52:45.157599 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78aec6d-3eeb-48ed-b6d8-1b5adfebb0e8 admin admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:52:45.157882 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78aec6d-3eeb-48ed-b6d8-1b5adfebb0e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:52:45.158153 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78aec6d-3eeb-48ed-b6d8-1b5adfebb0e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:52:45.158877 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78aec6d-3eeb-48ed-b6d8-1b5adfebb0e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:52:45.160517 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78aec6d-3eeb-48ed-b6d8-1b5adfebb0e8 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:52:45.170858 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1397/2780] 10.222.0.67 () {58 vars in 1121 bytes} [Wed May 25 14:52:45 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:52:45.175398 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0604cd18-69f6-4553-86fb-838331c5ab4e admin admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:52:45.186614 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0604cd18-69f6-4553-86fb-838331c5ab4e admin admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:52:45.191641 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16256c38-d4c5-4248-947b-9f6f07ee70c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:52:45.192544 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16256c38-d4c5-4248-947b-9f6f07ee70c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:52:45.192829 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16256c38-d4c5-4248-947b-9f6f07ee70c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:52:45.193698 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16256c38-d4c5-4248-947b-9f6f07ee70c6 admin admin] PATH_INFO: `/v3/projects/a1337b6a4ee14710a736f713b398f8f0/users/d11979e8acb84a6d88735157323ebf67/roles/48808901834b4d5eab2c7e6b5b03791e` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:52:45.213317 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16256c38-d4c5-4248-947b-9f6f07ee70c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a1337b6a4ee14710a736f713b398f8f0, user_id=d11979e8acb84a6d88735157323ebf67, role_id=48808901834b4d5eab2c7e6b5b03791e)` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:52:45.216078 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16256c38-d4c5-4248-947b-9f6f07ee70c6 admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:52:45.230312 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1384/2781] 10.222.0.67 () {60 vars in 1482 bytes} [Wed May 25 14:52:45 2022] PUT /identity/v3/projects/a1337b6a4ee14710a736f713b398f8f0/users/d11979e8acb84a6d88735157323ebf67/roles/48808901834b4d5eab2c7e6b5b03791e => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:52:45.242746 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2661f05c-1b42-415b-a5b9-12445afb06d4 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:52:45.243066 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2661f05c-1b42-415b-a5b9-12445afb06d4 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:52:45.243349 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2661f05c-1b42-415b-a5b9-12445afb06d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:52:45.274079 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-2661f05c-1b42-415b-a5b9-12445afb06d4 None None] MFA Rules not processed for user `d11979e8acb84a6d88735157323ebf67`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:52:45.275481 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-2661f05c-1b42-415b-a5b9-12445afb06d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:52:45.342958 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1398/2782] 10.222.0.67 () {58 vars in 957 bytes} [Wed May 25 14:52:45 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:52:45.347431 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16256c38-d4c5-4248-947b-9f6f07ee70c6 admin admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:52:45.421018 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16256c38-d4c5-4248-947b-9f6f07ee70c6 admin admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:52:45.425979 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6046c0a7-245c-4923-aa9a-ab1b53d19bd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:52:45.426655 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6046c0a7-245c-4923-aa9a-ab1b53d19bd8 admin admin] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:52:45.426946 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6046c0a7-245c-4923-aa9a-ab1b53d19bd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:52:45.427748 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6046c0a7-245c-4923-aa9a-ab1b53d19bd8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:52:45.428487 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6046c0a7-245c-4923-aa9a-ab1b53d19bd8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:52:45.430400 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6046c0a7-245c-4923-aa9a-ab1b53d19bd8 admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:52:45.440685 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:52:45.460642 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1385/2783] 10.222.0.67 () {60 vars in 1152 bytes} [Wed May 25 14:52:45 2022] POST /identity/v3/projects => generated 385 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:52:45.464722 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2661f05c-1b42-415b-a5b9-12445afb06d4 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:52:45.475736 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2661f05c-1b42-415b-a5b9-12445afb06d4 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:52:45.479638 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:52:45.542547 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add3f33c-c9ac-463a-8f57-dc7366cdde0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:52:45.543243 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add3f33c-c9ac-463a-8f57-dc7366cdde0a admin admin] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:52:45.543582 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add3f33c-c9ac-463a-8f57-dc7366cdde0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:52:45.543858 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add3f33c-c9ac-463a-8f57-dc7366cdde0a admin admin] PATH_INFO: `/v3/users` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:52:45.544550 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add3f33c-c9ac-463a-8f57-dc7366cdde0a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:52:45.546466 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add3f33c-c9ac-463a-8f57-dc7366cdde0a admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:52:45.568997 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1399/2784] 10.222.0.67 () {60 vars in 1143 bytes} [Wed May 25 14:52:45 2022] POST /identity/v3/users => generated 299 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:52:45.573012 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6046c0a7-245c-4923-aa9a-ab1b53d19bd8 admin admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:52:45.584701 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6046c0a7-245c-4923-aa9a-ab1b53d19bd8 admin admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:52:45.589483 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8d0f1d-06e0-44ff-9377-413ded38adf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:52:45.590160 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8d0f1d-06e0-44ff-9377-413ded38adf0 admin admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:52:45.590445 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8d0f1d-06e0-44ff-9377-413ded38adf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:52:45.590731 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8d0f1d-06e0-44ff-9377-413ded38adf0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:52:45.591518 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8d0f1d-06e0-44ff-9377-413ded38adf0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:52:45.593176 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8d0f1d-06e0-44ff-9377-413ded38adf0 admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:52:45.606086 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1386/2785] 10.222.0.67 () {58 vars in 1121 bytes} [Wed May 25 14:52:45 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:52:45.610515 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add3f33c-c9ac-463a-8f57-dc7366cdde0a admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:52:45.621388 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add3f33c-c9ac-463a-8f57-dc7366cdde0a admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:52:45.626513 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3babc6b-717c-4291-be63-b7d3030a30c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:52:45.627433 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3babc6b-717c-4291-be63-b7d3030a30c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:52:45.627716 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3babc6b-717c-4291-be63-b7d3030a30c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:52:45.627993 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3babc6b-717c-4291-be63-b7d3030a30c5 admin admin] PATH_INFO: `/v3/projects/746bf5ad096346e7a0ede50e30016c74/users/679d06b054534b3193a90f72ddb81e2d/roles/399893e19eac4ab5a8e596f7c07be13c` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:52:45.644760 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3babc6b-717c-4291-be63-b7d3030a30c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=746bf5ad096346e7a0ede50e30016c74, user_id=679d06b054534b3193a90f72ddb81e2d, role_id=399893e19eac4ab5a8e596f7c07be13c)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:52:45.647549 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3babc6b-717c-4291-be63-b7d3030a30c5 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:52:45.660756 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1400/2786] 10.222.0.67 () {60 vars in 1482 bytes} [Wed May 25 14:52:45 2022] PUT /identity/v3/projects/746bf5ad096346e7a0ede50e30016c74/users/679d06b054534b3193a90f72ddb81e2d/roles/399893e19eac4ab5a8e596f7c07be13c => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:52:45.665420 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8d0f1d-06e0-44ff-9377-413ded38adf0 admin admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:52:45.675993 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8d0f1d-06e0-44ff-9377-413ded38adf0 admin admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:52:45.738619 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0beeff98-d839-4f23-843a-28907b1563a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:52:45.739309 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0beeff98-d839-4f23-843a-28907b1563a6 admin admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:52:45.739597 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0beeff98-d839-4f23-843a-28907b1563a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:52:45.740483 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0beeff98-d839-4f23-843a-28907b1563a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:52:45.741768 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0beeff98-d839-4f23-843a-28907b1563a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:52:45.743417 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0beeff98-d839-4f23-843a-28907b1563a6 admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:52:45.753787 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1387/2787] 10.222.0.67 () {58 vars in 1121 bytes} [Wed May 25 14:52:45 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:52:45.758440 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3babc6b-717c-4291-be63-b7d3030a30c5 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:52:45.769185 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3babc6b-717c-4291-be63-b7d3030a30c5 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:52:45.774064 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c39ed6-a07e-4cc0-ae66-d7df3de07b34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:52:45.774950 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c39ed6-a07e-4cc0-ae66-d7df3de07b34 admin admin] REQUEST_METHOD: `PUT` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:52:45.775268 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c39ed6-a07e-4cc0-ae66-d7df3de07b34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:52:45.775540 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c39ed6-a07e-4cc0-ae66-d7df3de07b34 admin admin] PATH_INFO: `/v3/projects/746bf5ad096346e7a0ede50e30016c74/users/679d06b054534b3193a90f72ddb81e2d/roles/399893e19eac4ab5a8e596f7c07be13c` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:52:45.777525 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c39ed6-a07e-4cc0-ae66-d7df3de07b34 admin admin] RBAC: Authorizing `identity:create_grant(project_id=746bf5ad096346e7a0ede50e30016c74, user_id=679d06b054534b3193a90f72ddb81e2d, role_id=399893e19eac4ab5a8e596f7c07be13c)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:52:45.780249 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c39ed6-a07e-4cc0-ae66-d7df3de07b34 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:52:45.792230 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1401/2788] 10.222.0.67 () {60 vars in 1482 bytes} [Wed May 25 14:52:45 2022] PUT /identity/v3/projects/746bf5ad096346e7a0ede50e30016c74/users/679d06b054534b3193a90f72ddb81e2d/roles/399893e19eac4ab5a8e596f7c07be13c => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:52:45.803955 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6be4b9-b133-47ec-a258-45d48b984137 None None] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:52:45.804256 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6be4b9-b133-47ec-a258-45d48b984137 None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:52:45.804631 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6be4b9-b133-47ec-a258-45d48b984137 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:52:45.832801 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.auth.core [None req-0c6be4b9-b133-47ec-a258-45d48b984137 None None] MFA Rules not processed for user `679d06b054534b3193a90f72ddb81e2d`. Rule list: `[]` (Enabled: `True`). {{(pid=80474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:52:45.834116 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-0c6be4b9-b133-47ec-a258-45d48b984137 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:52:45.911166 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1388/2789] 10.222.0.67 () {58 vars in 957 bytes} [Wed May 25 14:52:45 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:52:45.922654 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c39ed6-a07e-4cc0-ae66-d7df3de07b34 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:52:45.924436 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-b9c39ed6-a07e-4cc0-ae66-d7df3de07b34 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:52:45.985001 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c39ed6-a07e-4cc0-ae66-d7df3de07b34 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:52:45.988771 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf8dbcd-5407-4692-8936-bd88fe418283 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e462acc9da84a61bb23998dd54e1858', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfe93ee8d32a441295efc0b885de4bd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:52:45.989422 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf8dbcd-5407-4692-8936-bd88fe418283 service cinder] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:52:45.990302 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf8dbcd-5407-4692-8936-bd88fe418283 service cinder] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:52:45.990680 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf8dbcd-5407-4692-8936-bd88fe418283 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:52:46.001110 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf8dbcd-5407-4692-8936-bd88fe418283 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:52:46.002565 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf8dbcd-5407-4692-8936-bd88fe418283 service cinder] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:52:46.013794 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1402/2790] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 14:52:45 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:52:46.607109 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6be4b9-b133-47ec-a258-45d48b984137 None None] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:52:46.608559 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-0c6be4b9-b133-47ec-a258-45d48b984137 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:52:46.624830 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6be4b9-b133-47ec-a258-45d48b984137 None None] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:52:46.632329 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc60867-9fb1-4b94-8286-cf0099925742 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e462acc9da84a61bb23998dd54e1858', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfe93ee8d32a441295efc0b885de4bd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:52:46.633000 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc60867-9fb1-4b94-8286-cf0099925742 service cinder] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:52:46.633306 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc60867-9fb1-4b94-8286-cf0099925742 service cinder] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:52:46.633545 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc60867-9fb1-4b94-8286-cf0099925742 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:52:46.717556 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc60867-9fb1-4b94-8286-cf0099925742 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:52:46.718965 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc60867-9fb1-4b94-8286-cf0099925742 service cinder] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:52:46.724023 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:52:46.729517 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1389/2791] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 14:52:46 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:52:50.876155 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf8dbcd-5407-4692-8936-bd88fe418283 service cinder] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:52:50.885511 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf8dbcd-5407-4692-8936-bd88fe418283 service cinder] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:52:50.889457 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ca4dfe-4a06-4552-9167-9607906d3a24 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e462acc9da84a61bb23998dd54e1858', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfe93ee8d32a441295efc0b885de4bd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:52:50.890096 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ca4dfe-4a06-4552-9167-9607906d3a24 service cinder] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:52:50.890376 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ca4dfe-4a06-4552-9167-9607906d3a24 service cinder] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:52:50.890650 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ca4dfe-4a06-4552-9167-9607906d3a24 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:52:50.951154 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ca4dfe-4a06-4552-9167-9607906d3a24 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:52:50.952545 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ca4dfe-4a06-4552-9167-9607906d3a24 service cinder] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:52:50.957566 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:52:50.964406 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1403/2792] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 14:52:50 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:52:53.160717 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc60867-9fb1-4b94-8286-cf0099925742 service cinder] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:52:53.227278 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc60867-9fb1-4b94-8286-cf0099925742 service cinder] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:52:53.231804 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5067b17-3598-48b3-9318-e4cf6bfebdb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:52:53.232680 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5067b17-3598-48b3-9318-e4cf6bfebdb3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:52:53.232967 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5067b17-3598-48b3-9318-e4cf6bfebdb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:52:53.233246 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5067b17-3598-48b3-9318-e4cf6bfebdb3 admin admin] PATH_INFO: `/v3/users/40dd5ef154544a66a43f313383e28e77` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:52:53.234436 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5067b17-3598-48b3-9318-e4cf6bfebdb3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=40dd5ef154544a66a43f313383e28e77)` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:52:53.236394 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5067b17-3598-48b3-9318-e4cf6bfebdb3 admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:52:53.291966 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-e5067b17-3598-48b3-9318-e4cf6bfebdb3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '40dd5ef154544a66a43f313383e28e77'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:52:53.292630 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-e5067b17-3598-48b3-9318-e4cf6bfebdb3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '40dd5ef154544a66a43f313383e28e77'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:52:53.293238 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-e5067b17-3598-48b3-9318-e4cf6bfebdb3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '40dd5ef154544a66a43f313383e28e77'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:52:53.307275 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-e5067b17-3598-48b3-9318-e4cf6bfebdb3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '40dd5ef154544a66a43f313383e28e77'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:52:53.314081 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-e5067b17-3598-48b3-9318-e4cf6bfebdb3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '40dd5ef154544a66a43f313383e28e77'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:52:53.328511 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1390/2793] 10.222.0.67 () {58 vars in 1223 bytes} [Wed May 25 14:52:53 2022] DELETE /identity/v3/users/40dd5ef154544a66a43f313383e28e77 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:52:53.333103 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda3fabe-d53c-4cfc-91a9-7a11e40909c0 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:52:53.333836 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda3fabe-d53c-4cfc-91a9-7a11e40909c0 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:52:53.333836 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda3fabe-d53c-4cfc-91a9-7a11e40909c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:52:53.351543 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-dda3fabe-d53c-4cfc-91a9-7a11e40909c0 None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:52:53.352768 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-dda3fabe-d53c-4cfc-91a9-7a11e40909c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:52:53.416052 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1404/2794] 10.222.0.67 () {58 vars in 957 bytes} [Wed May 25 14:52:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:52:53.425822 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5067b17-3598-48b3-9318-e4cf6bfebdb3 admin admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:52:53.427781 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-e5067b17-3598-48b3-9318-e4cf6bfebdb3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:52:53.487074 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5067b17-3598-48b3-9318-e4cf6bfebdb3 admin admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:52:53.491546 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35dc40fb-0d31-4194-beb8-c501aaf7a951 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b68eed985c7b49839bcdd173186ad4ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfe93ee8d32a441295efc0b885de4bd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:52:53.492210 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dc40fb-0d31-4194-beb8-c501aaf7a951 service neutron] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:52:53.492492 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dc40fb-0d31-4194-beb8-c501aaf7a951 service neutron] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:52:53.492772 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dc40fb-0d31-4194-beb8-c501aaf7a951 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:52:53.502778 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35dc40fb-0d31-4194-beb8-c501aaf7a951 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:52:53.504377 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35dc40fb-0d31-4194-beb8-c501aaf7a951 service neutron] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:52:53.516091 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1391/2795] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 14:52:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:52:53.808994 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda3fabe-d53c-4cfc-91a9-7a11e40909c0 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:52:53.810491 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-dda3fabe-d53c-4cfc-91a9-7a11e40909c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:52:53.826062 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda3fabe-d53c-4cfc-91a9-7a11e40909c0 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:52:53.831344 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a99205-8a7e-4d9e-b413-207dacbef9f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:52:53.832159 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a99205-8a7e-4d9e-b413-207dacbef9f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:52:53.832444 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a99205-8a7e-4d9e-b413-207dacbef9f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:52:53.832721 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a99205-8a7e-4d9e-b413-207dacbef9f2 admin admin] PATH_INFO: `/v3/projects/c5bebea1f919491fad0711a951ad315f` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:52:53.834111 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a99205-8a7e-4d9e-b413-207dacbef9f2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c5bebea1f919491fad0711a951ad315f)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:52:53.836182 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a99205-8a7e-4d9e-b413-207dacbef9f2 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:52:53.888491 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-48a99205-8a7e-4d9e-b413-207dacbef9f2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c5bebea1f919491fad0711a951ad315f', 'request_id': 'req-48a99205-8a7e-4d9e-b413-207dacbef9f2'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:52:53.894241 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-48a99205-8a7e-4d9e-b413-207dacbef9f2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c5bebea1f919491fad0711a951ad315f', 'request_id': 'req-48a99205-8a7e-4d9e-b413-207dacbef9f2'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:52:53.900825 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-48a99205-8a7e-4d9e-b413-207dacbef9f2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c5bebea1f919491fad0711a951ad315f', 'request_id': 'req-48a99205-8a7e-4d9e-b413-207dacbef9f2'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:52:53.914741 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-48a99205-8a7e-4d9e-b413-207dacbef9f2 admin admin] The token cache is being invalidate because project c5bebea1f919491fad0711a951ad315f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80475) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 14:52:53.915131 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-48a99205-8a7e-4d9e-b413-207dacbef9f2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:52:53.915748 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-48a99205-8a7e-4d9e-b413-207dacbef9f2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:52:53.917414 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1405/2796] 10.222.0.67 () {58 vars in 1232 bytes} [Wed May 25 14:52:53 2022] DELETE /identity/v3/projects/c5bebea1f919491fad0711a951ad315f => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:52:53.921638 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35dc40fb-0d31-4194-beb8-c501aaf7a951 service neutron] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:52:53.932417 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35dc40fb-0d31-4194-beb8-c501aaf7a951 service neutron] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:52:53.951246 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:52:53.993018 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3a9fa3-441a-4d33-9454-74bdae9e560c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:52:53.993938 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3a9fa3-441a-4d33-9454-74bdae9e560c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:52:53.994220 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3a9fa3-441a-4d33-9454-74bdae9e560c admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:52:53.994498 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3a9fa3-441a-4d33-9454-74bdae9e560c admin admin] PATH_INFO: `/v3/users/d11979e8acb84a6d88735157323ebf67` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:52:53.995731 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3a9fa3-441a-4d33-9454-74bdae9e560c admin admin] RBAC: Authorizing `identity:delete_user(user_id=d11979e8acb84a6d88735157323ebf67)` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:52:53.997656 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3a9fa3-441a-4d33-9454-74bdae9e560c admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:52:54.051878 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-ad3a9fa3-441a-4d33-9454-74bdae9e560c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd11979e8acb84a6d88735157323ebf67'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:52:54.053295 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-ad3a9fa3-441a-4d33-9454-74bdae9e560c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd11979e8acb84a6d88735157323ebf67'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:52:54.053941 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-ad3a9fa3-441a-4d33-9454-74bdae9e560c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd11979e8acb84a6d88735157323ebf67'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:52:54.070008 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-ad3a9fa3-441a-4d33-9454-74bdae9e560c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd11979e8acb84a6d88735157323ebf67'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:52:54.077333 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-ad3a9fa3-441a-4d33-9454-74bdae9e560c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd11979e8acb84a6d88735157323ebf67'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:52:54.091844 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1392/2797] 10.222.0.67 () {58 vars in 1223 bytes} [Wed May 25 14:52:53 2022] DELETE /identity/v3/users/d11979e8acb84a6d88735157323ebf67 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:52:54.386026 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a99205-8a7e-4d9e-b413-207dacbef9f2 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:52:54.387477 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-48a99205-8a7e-4d9e-b413-207dacbef9f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:52:54.403876 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a99205-8a7e-4d9e-b413-207dacbef9f2 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:52:54.465463 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b204da-1ae4-4f69-9eb3-f72f0321c241 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:52:54.466327 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b204da-1ae4-4f69-9eb3-f72f0321c241 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:52:54.466612 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b204da-1ae4-4f69-9eb3-f72f0321c241 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:52:54.466885 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b204da-1ae4-4f69-9eb3-f72f0321c241 admin admin] PATH_INFO: `/v3/projects/a1337b6a4ee14710a736f713b398f8f0` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:52:54.468280 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b204da-1ae4-4f69-9eb3-f72f0321c241 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a1337b6a4ee14710a736f713b398f8f0)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:52:54.470227 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b204da-1ae4-4f69-9eb3-f72f0321c241 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:52:54.506701 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:52:54.529362 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-10b204da-1ae4-4f69-9eb3-f72f0321c241 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a1337b6a4ee14710a736f713b398f8f0', 'request_id': 'req-10b204da-1ae4-4f69-9eb3-f72f0321c241'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:52:54.534887 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-10b204da-1ae4-4f69-9eb3-f72f0321c241 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a1337b6a4ee14710a736f713b398f8f0', 'request_id': 'req-10b204da-1ae4-4f69-9eb3-f72f0321c241'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:52:54.541842 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-10b204da-1ae4-4f69-9eb3-f72f0321c241 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a1337b6a4ee14710a736f713b398f8f0', 'request_id': 'req-10b204da-1ae4-4f69-9eb3-f72f0321c241'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:52:54.558468 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-10b204da-1ae4-4f69-9eb3-f72f0321c241 admin admin] The token cache is being invalidate because project a1337b6a4ee14710a736f713b398f8f0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80475) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 14:52:54.558772 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-10b204da-1ae4-4f69-9eb3-f72f0321c241 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:52:54.559425 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-10b204da-1ae4-4f69-9eb3-f72f0321c241 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:52:54.560980 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1406/2798] 10.222.0.67 () {58 vars in 1232 bytes} [Wed May 25 14:52:54 2022] DELETE /identity/v3/projects/a1337b6a4ee14710a736f713b398f8f0 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:52:54.565072 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3a9fa3-441a-4d33-9454-74bdae9e560c admin admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:52:54.566500 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-ad3a9fa3-441a-4d33-9454-74bdae9e560c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:52:54.581170 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3a9fa3-441a-4d33-9454-74bdae9e560c admin admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:52:54.644473 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdfc29c-66e1-49d3-b349-72f73c4abef5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:52:54.645441 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdfc29c-66e1-49d3-b349-72f73c4abef5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:52:54.645740 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdfc29c-66e1-49d3-b349-72f73c4abef5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:52:54.646902 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdfc29c-66e1-49d3-b349-72f73c4abef5 admin admin] PATH_INFO: `/v3/users/679d06b054534b3193a90f72ddb81e2d` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:52:54.648238 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdfc29c-66e1-49d3-b349-72f73c4abef5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=679d06b054534b3193a90f72ddb81e2d)` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:52:54.650271 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdfc29c-66e1-49d3-b349-72f73c4abef5 admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:52:54.705709 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:52:54.709773 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-ebdfc29c-66e1-49d3-b349-72f73c4abef5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '679d06b054534b3193a90f72ddb81e2d'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:52:54.711181 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-ebdfc29c-66e1-49d3-b349-72f73c4abef5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '679d06b054534b3193a90f72ddb81e2d'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:52:54.712017 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-ebdfc29c-66e1-49d3-b349-72f73c4abef5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '679d06b054534b3193a90f72ddb81e2d'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:52:54.729156 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-ebdfc29c-66e1-49d3-b349-72f73c4abef5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '679d06b054534b3193a90f72ddb81e2d'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:52:54.736569 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-ebdfc29c-66e1-49d3-b349-72f73c4abef5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '679d06b054534b3193a90f72ddb81e2d'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:52:54.750316 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1393/2799] 10.222.0.67 () {58 vars in 1223 bytes} [Wed May 25 14:52:54 2022] DELETE /identity/v3/users/679d06b054534b3193a90f72ddb81e2d => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:52:55.034474 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b204da-1ae4-4f69-9eb3-f72f0321c241 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:52:55.036276 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-10b204da-1ae4-4f69-9eb3-f72f0321c241 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:52:55.053324 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b204da-1ae4-4f69-9eb3-f72f0321c241 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:52:55.122467 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276523ab-d10c-419d-bd07-fa260f357798 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:52:55.124631 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276523ab-d10c-419d-bd07-fa260f357798 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:52:55.124631 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276523ab-d10c-419d-bd07-fa260f357798 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:52:55.124631 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276523ab-d10c-419d-bd07-fa260f357798 admin admin] PATH_INFO: `/v3/projects/746bf5ad096346e7a0ede50e30016c74` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:52:55.125621 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276523ab-d10c-419d-bd07-fa260f357798 admin admin] RBAC: Authorizing `identity:delete_project(project_id=746bf5ad096346e7a0ede50e30016c74)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:52:55.127233 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276523ab-d10c-419d-bd07-fa260f357798 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:52:55.179714 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-276523ab-d10c-419d-bd07-fa260f357798 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '746bf5ad096346e7a0ede50e30016c74', 'request_id': 'req-276523ab-d10c-419d-bd07-fa260f357798'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:52:55.185238 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-276523ab-d10c-419d-bd07-fa260f357798 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '746bf5ad096346e7a0ede50e30016c74', 'request_id': 'req-276523ab-d10c-419d-bd07-fa260f357798'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:52:55.191534 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-276523ab-d10c-419d-bd07-fa260f357798 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '746bf5ad096346e7a0ede50e30016c74', 'request_id': 'req-276523ab-d10c-419d-bd07-fa260f357798'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:52:55.205966 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-276523ab-d10c-419d-bd07-fa260f357798 admin admin] The token cache is being invalidate because project 746bf5ad096346e7a0ede50e30016c74 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80475) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 14:52:55.206255 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-276523ab-d10c-419d-bd07-fa260f357798 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:52:55.206903 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-276523ab-d10c-419d-bd07-fa260f357798 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:52:55.208521 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1407/2800] 10.222.0.67 () {58 vars in 1232 bytes} [Wed May 25 14:52:55 2022] DELETE /identity/v3/projects/746bf5ad096346e7a0ede50e30016c74 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:52:55.215390 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16446b9-8e13-46e2-ac27-982a77cdec8e None None] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:52:55.215680 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16446b9-8e13-46e2-ac27-982a77cdec8e None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:52:55.215989 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16446b9-8e13-46e2-ac27-982a77cdec8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:52:55.234807 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.auth.core [None req-e16446b9-8e13-46e2-ac27-982a77cdec8e None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:52:55.236094 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-e16446b9-8e13-46e2-ac27-982a77cdec8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:52:55.303719 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1394/2801] 10.222.0.67 () {58 vars in 957 bytes} [Wed May 25 14:52:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:52:55.312304 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79b6d6b-91f7-4a35-8dd4-249c3a63f62a None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:52:55.312595 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79b6d6b-91f7-4a35-8dd4-249c3a63f62a None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:52:55.312881 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79b6d6b-91f7-4a35-8dd4-249c3a63f62a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:52:55.331587 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-d79b6d6b-91f7-4a35-8dd4-249c3a63f62a None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:52:55.332810 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-d79b6d6b-91f7-4a35-8dd4-249c3a63f62a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:52:55.341382 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1408/2802] 10.222.0.67 () {58 vars in 957 bytes} [Wed May 25 14:52:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:52:55.345835 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16446b9-8e13-46e2-ac27-982a77cdec8e None None] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:52:55.356439 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16446b9-8e13-46e2-ac27-982a77cdec8e None None] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:52:55.364429 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2d37f9-44ec-4545-8886-b515272db02b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:52:55.364429 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2d37f9-44ec-4545-8886-b515272db02b admin admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:52:55.364429 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2d37f9-44ec-4545-8886-b515272db02b admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:52:55.364429 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2d37f9-44ec-4545-8886-b515272db02b admin admin] PATH_INFO: `/v3/domains` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:52:55.366224 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2d37f9-44ec-4545-8886-b515272db02b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:52:55.366224 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2d37f9-44ec-4545-8886-b515272db02b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:52:55.366224 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2d37f9-44ec-4545-8886-b515272db02b admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:52:55.379152 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1395/2803] 10.222.0.67 () {58 vars in 1152 bytes} [Wed May 25 14:52:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:52:55.384151 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79b6d6b-91f7-4a35-8dd4-249c3a63f62a None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:52:55.394551 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79b6d6b-91f7-4a35-8dd4-249c3a63f62a None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:52:55.401231 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18a025e-4fad-4156-b02d-8100e00ed3ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:52:55.401898 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18a025e-4fad-4156-b02d-8100e00ed3ae admin admin] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:52:55.402180 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18a025e-4fad-4156-b02d-8100e00ed3ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:52:55.402456 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18a025e-4fad-4156-b02d-8100e00ed3ae admin admin] PATH_INFO: `/v3/projects` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:52:55.403200 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18a025e-4fad-4156-b02d-8100e00ed3ae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:52:55.405108 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18a025e-4fad-4156-b02d-8100e00ed3ae admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:52:55.431688 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1409/2804] 10.222.0.67 () {60 vars in 1152 bytes} [Wed May 25 14:52:55 2022] POST /identity/v3/projects => generated 401 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:52:55.436372 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2d37f9-44ec-4545-8886-b515272db02b admin admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:52:55.448055 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2d37f9-44ec-4545-8886-b515272db02b admin admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:52:55.507965 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee40774-fc8d-430c-8281-d9db318c4cee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:52:55.508643 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee40774-fc8d-430c-8281-d9db318c4cee admin admin] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:52:55.508938 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee40774-fc8d-430c-8281-d9db318c4cee admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:52:55.509219 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee40774-fc8d-430c-8281-d9db318c4cee admin admin] PATH_INFO: `/v3/users` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:52:55.509918 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee40774-fc8d-430c-8281-d9db318c4cee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:52:55.511913 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee40774-fc8d-430c-8281-d9db318c4cee admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:52:55.536515 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1396/2805] 10.222.0.67 () {60 vars in 1143 bytes} [Wed May 25 14:52:55 2022] POST /identity/v3/users => generated 301 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:52:55.541056 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18a025e-4fad-4156-b02d-8100e00ed3ae admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:52:55.551754 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18a025e-4fad-4156-b02d-8100e00ed3ae admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:52:55.556541 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee6b8df-8902-42f1-b6e8-e28d4158baff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:52:55.557222 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee6b8df-8902-42f1-b6e8-e28d4158baff admin admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:52:55.557511 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee6b8df-8902-42f1-b6e8-e28d4158baff admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:52:55.557791 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee6b8df-8902-42f1-b6e8-e28d4158baff admin admin] PATH_INFO: `/v3/roles` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:52:55.558529 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee6b8df-8902-42f1-b6e8-e28d4158baff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:52:55.560197 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee6b8df-8902-42f1-b6e8-e28d4158baff admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:52:55.571971 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1410/2806] 10.222.0.67 () {58 vars in 1121 bytes} [Wed May 25 14:52:55 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:52:55.576029 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee40774-fc8d-430c-8281-d9db318c4cee admin admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:52:55.587728 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee40774-fc8d-430c-8281-d9db318c4cee admin admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:52:55.592690 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68646d1-184f-4846-b34a-9b79fb09336f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:52:55.593365 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68646d1-184f-4846-b34a-9b79fb09336f admin admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:52:55.593655 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68646d1-184f-4846-b34a-9b79fb09336f admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:52:55.593937 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68646d1-184f-4846-b34a-9b79fb09336f admin admin] PATH_INFO: `/v3/roles` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:52:55.594681 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68646d1-184f-4846-b34a-9b79fb09336f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:52:55.596340 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68646d1-184f-4846-b34a-9b79fb09336f admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:52:55.609134 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1397/2807] 10.222.0.67 () {58 vars in 1121 bytes} [Wed May 25 14:52:55 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:52:55.613444 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee6b8df-8902-42f1-b6e8-e28d4158baff admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:52:55.621292 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:DELETE=13,keystone:SELECT=84,keystone:INSERT=3 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:52:55.625245 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee6b8df-8902-42f1-b6e8-e28d4158baff admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:52:55.631834 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3713ed9-88d3-43c0-b8b6-0317a91c2def admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:52:55.632737 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3713ed9-88d3-43c0-b8b6-0317a91c2def admin admin] REQUEST_METHOD: `PUT` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:52:55.633227 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3713ed9-88d3-43c0-b8b6-0317a91c2def admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:52:55.633728 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3713ed9-88d3-43c0-b8b6-0317a91c2def admin admin] PATH_INFO: `/v3/projects/34a9d529838f487ea40e1af60b77c784/users/7d8872dc23284306815c047d3f5a3769/roles/48808901834b4d5eab2c7e6b5b03791e` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:52:55.649743 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3713ed9-88d3-43c0-b8b6-0317a91c2def admin admin] RBAC: Authorizing `identity:create_grant(project_id=34a9d529838f487ea40e1af60b77c784, user_id=7d8872dc23284306815c047d3f5a3769, role_id=48808901834b4d5eab2c7e6b5b03791e)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:52:55.652448 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3713ed9-88d3-43c0-b8b6-0317a91c2def admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:52:55.667224 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1411/2808] 10.222.0.67 () {60 vars in 1482 bytes} [Wed May 25 14:52:55 2022] PUT /identity/v3/projects/34a9d529838f487ea40e1af60b77c784/users/7d8872dc23284306815c047d3f5a3769/roles/48808901834b4d5eab2c7e6b5b03791e => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 14:52:55.680264 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f441f55-2039-4916-8b4e-bd74055ae20b None None] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:52:55.680768 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f441f55-2039-4916-8b4e-bd74055ae20b None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:52:55.681109 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f441f55-2039-4916-8b4e-bd74055ae20b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:52:55.710399 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.auth.core [None req-0f441f55-2039-4916-8b4e-bd74055ae20b None None] MFA Rules not processed for user `7d8872dc23284306815c047d3f5a3769`. Rule list: `[]` (Enabled: `True`). {{(pid=80474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:52:55.711566 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-0f441f55-2039-4916-8b4e-bd74055ae20b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:52:55.726747 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:DELETE=4,keystone:SELECT=92,keystone:INSERT=4 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:52:55.783759 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1398/2809] 10.222.0.67 () {58 vars in 957 bytes} [Wed May 25 14:52:55 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:52:55.789505 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3713ed9-88d3-43c0-b8b6-0317a91c2def admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:52:55.854175 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3713ed9-88d3-43c0-b8b6-0317a91c2def admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:52:55.858876 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26549c07-d56f-4478-93da-5a015c772e41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:52:55.859574 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26549c07-d56f-4478-93da-5a015c772e41 admin admin] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:52:55.859863 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26549c07-d56f-4478-93da-5a015c772e41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:52:55.860146 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26549c07-d56f-4478-93da-5a015c772e41 admin admin] PATH_INFO: `/v3/projects` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:52:55.860853 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26549c07-d56f-4478-93da-5a015c772e41 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:52:55.862753 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26549c07-d56f-4478-93da-5a015c772e41 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:52:55.888653 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1412/2810] 10.222.0.67 () {60 vars in 1152 bytes} [Wed May 25 14:52:55 2022] POST /identity/v3/projects => generated 399 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:52:55.892861 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f441f55-2039-4916-8b4e-bd74055ae20b None None] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:52:55.904603 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f441f55-2039-4916-8b4e-bd74055ae20b None None] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:52:55.962234 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411911e5-d69e-4f21-8352-345761a23782 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:52:55.962824 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411911e5-d69e-4f21-8352-345761a23782 admin admin] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:52:55.963150 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411911e5-d69e-4f21-8352-345761a23782 admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:52:55.963426 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411911e5-d69e-4f21-8352-345761a23782 admin admin] PATH_INFO: `/v3/users` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:52:55.964115 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411911e5-d69e-4f21-8352-345761a23782 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:52:55.966035 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411911e5-d69e-4f21-8352-345761a23782 admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:52:55.986295 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1399/2811] 10.222.0.67 () {60 vars in 1143 bytes} [Wed May 25 14:52:55 2022] POST /identity/v3/users => generated 306 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:52:55.991110 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26549c07-d56f-4478-93da-5a015c772e41 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:52:56.001267 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26549c07-d56f-4478-93da-5a015c772e41 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:52:56.006613 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32762cce-1217-474b-9407-46a1eefb2f7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:52:56.007312 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32762cce-1217-474b-9407-46a1eefb2f7f admin admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:52:56.007605 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32762cce-1217-474b-9407-46a1eefb2f7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:52:56.007885 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32762cce-1217-474b-9407-46a1eefb2f7f admin admin] PATH_INFO: `/v3/roles` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:52:56.008614 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32762cce-1217-474b-9407-46a1eefb2f7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:52:56.010216 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32762cce-1217-474b-9407-46a1eefb2f7f admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:52:56.021758 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1413/2812] 10.222.0.67 () {58 vars in 1121 bytes} [Wed May 25 14:52:55 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:52:56.025811 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411911e5-d69e-4f21-8352-345761a23782 admin admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:52:56.036958 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411911e5-d69e-4f21-8352-345761a23782 admin admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:52:56.041951 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8864d87-e246-41ba-9447-25f00fe6a98c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:52:56.042843 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8864d87-e246-41ba-9447-25f00fe6a98c admin admin] REQUEST_METHOD: `PUT` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:52:56.043156 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8864d87-e246-41ba-9447-25f00fe6a98c admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:52:56.043435 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8864d87-e246-41ba-9447-25f00fe6a98c admin admin] PATH_INFO: `/v3/projects/2a4e16933c4f4f43be2ef418f91a5204/users/4c1284a42d564ef883e71681abef3fcd/roles/399893e19eac4ab5a8e596f7c07be13c` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:52:56.058386 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8864d87-e246-41ba-9447-25f00fe6a98c admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a4e16933c4f4f43be2ef418f91a5204, user_id=4c1284a42d564ef883e71681abef3fcd, role_id=399893e19eac4ab5a8e596f7c07be13c)` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:52:56.061096 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8864d87-e246-41ba-9447-25f00fe6a98c admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:52:56.074394 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1400/2813] 10.222.0.67 () {60 vars in 1482 bytes} [Wed May 25 14:52:56 2022] PUT /identity/v3/projects/2a4e16933c4f4f43be2ef418f91a5204/users/4c1284a42d564ef883e71681abef3fcd/roles/399893e19eac4ab5a8e596f7c07be13c => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:52:56.078390 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32762cce-1217-474b-9407-46a1eefb2f7f admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:52:56.090522 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32762cce-1217-474b-9407-46a1eefb2f7f admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:52:56.151191 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e912fb20-0a67-42f6-aa8f-bbb48c580a6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:52:56.151873 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e912fb20-0a67-42f6-aa8f-bbb48c580a6a admin admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:52:56.152190 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e912fb20-0a67-42f6-aa8f-bbb48c580a6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:52:56.152472 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e912fb20-0a67-42f6-aa8f-bbb48c580a6a admin admin] PATH_INFO: `/v3/roles` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:52:56.153205 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e912fb20-0a67-42f6-aa8f-bbb48c580a6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:52:56.154857 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e912fb20-0a67-42f6-aa8f-bbb48c580a6a admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:52:56.165823 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1414/2814] 10.222.0.67 () {58 vars in 1121 bytes} [Wed May 25 14:52:56 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:52:56.171054 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8864d87-e246-41ba-9447-25f00fe6a98c admin admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:52:56.186469 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8864d87-e246-41ba-9447-25f00fe6a98c admin admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:52:56.188837 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1093c0f4-48cc-47b3-aa6e-e03e674d1c1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:52:56.189727 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1093c0f4-48cc-47b3-aa6e-e03e674d1c1d admin admin] REQUEST_METHOD: `PUT` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:52:56.190007 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1093c0f4-48cc-47b3-aa6e-e03e674d1c1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:52:56.190279 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1093c0f4-48cc-47b3-aa6e-e03e674d1c1d admin admin] PATH_INFO: `/v3/projects/2a4e16933c4f4f43be2ef418f91a5204/users/4c1284a42d564ef883e71681abef3fcd/roles/399893e19eac4ab5a8e596f7c07be13c` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:52:56.192237 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1093c0f4-48cc-47b3-aa6e-e03e674d1c1d admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a4e16933c4f4f43be2ef418f91a5204, user_id=4c1284a42d564ef883e71681abef3fcd, role_id=399893e19eac4ab5a8e596f7c07be13c)` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:52:56.195673 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1093c0f4-48cc-47b3-aa6e-e03e674d1c1d admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:52:56.206881 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1401/2815] 10.222.0.67 () {60 vars in 1482 bytes} [Wed May 25 14:52:56 2022] PUT /identity/v3/projects/2a4e16933c4f4f43be2ef418f91a5204/users/4c1284a42d564ef883e71681abef3fcd/roles/399893e19eac4ab5a8e596f7c07be13c => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:52:56.218250 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264b52b0-43c8-45f6-8478-dfd118abbe47 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:52:56.218454 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264b52b0-43c8-45f6-8478-dfd118abbe47 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:52:56.218742 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264b52b0-43c8-45f6-8478-dfd118abbe47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:52:56.247266 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-264b52b0-43c8-45f6-8478-dfd118abbe47 None None] MFA Rules not processed for user `4c1284a42d564ef883e71681abef3fcd`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:52:56.248503 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-264b52b0-43c8-45f6-8478-dfd118abbe47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:52:56.291793 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:52:56.325033 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1415/2816] 10.222.0.67 () {58 vars in 957 bytes} [Wed May 25 14:52:56 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:52:56.338320 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1093c0f4-48cc-47b3-aa6e-e03e674d1c1d admin admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:52:56.340124 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-1093c0f4-48cc-47b3-aa6e-e03e674d1c1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:52:56.413304 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1093c0f4-48cc-47b3-aa6e-e03e674d1c1d admin admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:52:56.417259 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30151195-9b9f-4c95-ae68-7da32cedfbe0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e462acc9da84a61bb23998dd54e1858', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfe93ee8d32a441295efc0b885de4bd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:52:56.417918 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30151195-9b9f-4c95-ae68-7da32cedfbe0 service cinder] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:52:56.418202 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30151195-9b9f-4c95-ae68-7da32cedfbe0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:52:56.418481 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30151195-9b9f-4c95-ae68-7da32cedfbe0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:52:56.433343 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30151195-9b9f-4c95-ae68-7da32cedfbe0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:52:56.434797 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30151195-9b9f-4c95-ae68-7da32cedfbe0 service cinder] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:52:56.447328 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1402/2817] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 14:52:56 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:52:56.531326 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264b52b0-43c8-45f6-8478-dfd118abbe47 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:52:56.542680 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264b52b0-43c8-45f6-8478-dfd118abbe47 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:52:56.546276 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8bcb1d-8bfd-40c4-83f9-b50c20266a9c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e462acc9da84a61bb23998dd54e1858', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfe93ee8d32a441295efc0b885de4bd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:52:56.546917 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8bcb1d-8bfd-40c4-83f9-b50c20266a9c service cinder] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:52:56.547420 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8bcb1d-8bfd-40c4-83f9-b50c20266a9c service cinder] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:52:56.547787 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8bcb1d-8bfd-40c4-83f9-b50c20266a9c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:52:56.614500 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8bcb1d-8bfd-40c4-83f9-b50c20266a9c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:52:56.616386 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8bcb1d-8bfd-40c4-83f9-b50c20266a9c service cinder] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:52:56.628111 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1416/2818] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 14:52:56 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:53:00.754949 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30151195-9b9f-4c95-ae68-7da32cedfbe0 service cinder] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:53:00.769234 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:53:00.825440 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30151195-9b9f-4c95-ae68-7da32cedfbe0 service cinder] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:53:00.830319 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59340573-7f3b-4e66-9982-c5844b61af9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:53:00.831563 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59340573-7f3b-4e66-9982-c5844b61af9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:53:00.831950 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59340573-7f3b-4e66-9982-c5844b61af9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:53:00.832333 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59340573-7f3b-4e66-9982-c5844b61af9e admin admin] PATH_INFO: `/v3/users/7d8872dc23284306815c047d3f5a3769` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:53:00.834198 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59340573-7f3b-4e66-9982-c5844b61af9e admin admin] RBAC: Authorizing `identity:delete_user(user_id=7d8872dc23284306815c047d3f5a3769)` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:53:00.836301 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59340573-7f3b-4e66-9982-c5844b61af9e admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:53:00.885277 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-59340573-7f3b-4e66-9982-c5844b61af9e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7d8872dc23284306815c047d3f5a3769'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:53:00.885947 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-59340573-7f3b-4e66-9982-c5844b61af9e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7d8872dc23284306815c047d3f5a3769'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:53:00.886560 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-59340573-7f3b-4e66-9982-c5844b61af9e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7d8872dc23284306815c047d3f5a3769'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:53:00.900644 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-59340573-7f3b-4e66-9982-c5844b61af9e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7d8872dc23284306815c047d3f5a3769'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:53:00.907536 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-59340573-7f3b-4e66-9982-c5844b61af9e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7d8872dc23284306815c047d3f5a3769'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:53:00.921140 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1403/2819] 10.222.0.67 () {58 vars in 1223 bytes} [Wed May 25 14:53:00 2022] DELETE /identity/v3/users/7d8872dc23284306815c047d3f5a3769 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:53:00.925665 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9aca087-3f1c-4e5a-971c-0fe835d73d9f None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:53:00.926197 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9aca087-3f1c-4e5a-971c-0fe835d73d9f None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:53:00.926306 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9aca087-3f1c-4e5a-971c-0fe835d73d9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:53:00.943894 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-b9aca087-3f1c-4e5a-971c-0fe835d73d9f None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:53:00.945050 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-b9aca087-3f1c-4e5a-971c-0fe835d73d9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:53:01.005599 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1417/2820] 10.222.0.67 () {58 vars in 957 bytes} [Wed May 25 14:53:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:53:01.015812 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59340573-7f3b-4e66-9982-c5844b61af9e admin admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:53:01.017210 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-59340573-7f3b-4e66-9982-c5844b61af9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:53:01.076448 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59340573-7f3b-4e66-9982-c5844b61af9e admin admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:53:01.080133 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf93d6c7-2627-4a41-8016-e4318293fd3d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b68eed985c7b49839bcdd173186ad4ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfe93ee8d32a441295efc0b885de4bd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:53:01.080791 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf93d6c7-2627-4a41-8016-e4318293fd3d service neutron] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:53:01.081075 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf93d6c7-2627-4a41-8016-e4318293fd3d service neutron] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:53:01.081353 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf93d6c7-2627-4a41-8016-e4318293fd3d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:53:01.094278 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf93d6c7-2627-4a41-8016-e4318293fd3d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:53:01.095692 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf93d6c7-2627-4a41-8016-e4318293fd3d service neutron] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:53:01.106326 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1404/2821] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 14:53:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:53:01.382755 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9aca087-3f1c-4e5a-971c-0fe835d73d9f None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:53:01.384211 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-b9aca087-3f1c-4e5a-971c-0fe835d73d9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:53:01.397622 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9aca087-3f1c-4e5a-971c-0fe835d73d9f None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:53:01.402334 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5fc8bc-8ed0-4404-81df-69d4e0ad1abb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:53:01.403258 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5fc8bc-8ed0-4404-81df-69d4e0ad1abb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:53:01.403600 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5fc8bc-8ed0-4404-81df-69d4e0ad1abb admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:53:01.403836 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5fc8bc-8ed0-4404-81df-69d4e0ad1abb admin admin] PATH_INFO: `/v3/projects/34a9d529838f487ea40e1af60b77c784` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:53:01.405064 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5fc8bc-8ed0-4404-81df-69d4e0ad1abb admin admin] RBAC: Authorizing `identity:delete_project(project_id=34a9d529838f487ea40e1af60b77c784)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:53:01.407041 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5fc8bc-8ed0-4404-81df-69d4e0ad1abb admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:53:01.461217 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-bf5fc8bc-8ed0-4404-81df-69d4e0ad1abb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '34a9d529838f487ea40e1af60b77c784', 'request_id': 'req-bf5fc8bc-8ed0-4404-81df-69d4e0ad1abb'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:53:01.466908 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-bf5fc8bc-8ed0-4404-81df-69d4e0ad1abb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '34a9d529838f487ea40e1af60b77c784', 'request_id': 'req-bf5fc8bc-8ed0-4404-81df-69d4e0ad1abb'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:53:01.474009 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-bf5fc8bc-8ed0-4404-81df-69d4e0ad1abb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '34a9d529838f487ea40e1af60b77c784', 'request_id': 'req-bf5fc8bc-8ed0-4404-81df-69d4e0ad1abb'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:53:01.482466 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:53:01.487997 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-bf5fc8bc-8ed0-4404-81df-69d4e0ad1abb admin admin] The token cache is being invalidate because project 34a9d529838f487ea40e1af60b77c784 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80475) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 14:53:01.488518 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-bf5fc8bc-8ed0-4404-81df-69d4e0ad1abb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:53:01.489724 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-bf5fc8bc-8ed0-4404-81df-69d4e0ad1abb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:53:01.491626 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1418/2822] 10.222.0.67 () {58 vars in 1232 bytes} [Wed May 25 14:53:01 2022] DELETE /identity/v3/projects/34a9d529838f487ea40e1af60b77c784 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:53:01.495683 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf93d6c7-2627-4a41-8016-e4318293fd3d service neutron] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:53:01.506018 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf93d6c7-2627-4a41-8016-e4318293fd3d service neutron] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:53:01.536973 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:53:01.566700 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed17f658-89ba-4e05-87bc-080646e8ebcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:53:01.568188 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed17f658-89ba-4e05-87bc-080646e8ebcc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:53:01.568649 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed17f658-89ba-4e05-87bc-080646e8ebcc admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:53:01.568925 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed17f658-89ba-4e05-87bc-080646e8ebcc admin admin] PATH_INFO: `/v3/users/4c1284a42d564ef883e71681abef3fcd` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:53:01.570116 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed17f658-89ba-4e05-87bc-080646e8ebcc admin admin] RBAC: Authorizing `identity:delete_user(user_id=4c1284a42d564ef883e71681abef3fcd)` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:53:01.572199 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed17f658-89ba-4e05-87bc-080646e8ebcc admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:53:01.621937 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-ed17f658-89ba-4e05-87bc-080646e8ebcc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4c1284a42d564ef883e71681abef3fcd'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:53:01.622606 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-ed17f658-89ba-4e05-87bc-080646e8ebcc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4c1284a42d564ef883e71681abef3fcd'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:53:01.623241 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-ed17f658-89ba-4e05-87bc-080646e8ebcc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4c1284a42d564ef883e71681abef3fcd'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:53:01.636935 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-ed17f658-89ba-4e05-87bc-080646e8ebcc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4c1284a42d564ef883e71681abef3fcd'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:53:01.643933 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-ed17f658-89ba-4e05-87bc-080646e8ebcc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4c1284a42d564ef883e71681abef3fcd'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:53:01.656939 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1405/2823] 10.222.0.67 () {58 vars in 1223 bytes} [Wed May 25 14:53:01 2022] DELETE /identity/v3/users/4c1284a42d564ef883e71681abef3fcd => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:53:01.966056 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5fc8bc-8ed0-4404-81df-69d4e0ad1abb admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:53:01.968010 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-bf5fc8bc-8ed0-4404-81df-69d4e0ad1abb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:53:01.987784 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5fc8bc-8ed0-4404-81df-69d4e0ad1abb admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:53:02.060173 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb05bbc-1339-4f15-98e8-05220989fbfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:53:02.061041 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb05bbc-1339-4f15-98e8-05220989fbfd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:53:02.061324 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb05bbc-1339-4f15-98e8-05220989fbfd admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:53:02.061603 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb05bbc-1339-4f15-98e8-05220989fbfd admin admin] PATH_INFO: `/v3/projects/2a4e16933c4f4f43be2ef418f91a5204` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:53:02.062821 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb05bbc-1339-4f15-98e8-05220989fbfd admin admin] RBAC: Authorizing `identity:delete_project(project_id=2a4e16933c4f4f43be2ef418f91a5204)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:53:02.064764 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb05bbc-1339-4f15-98e8-05220989fbfd admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:53:02.116065 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-5cb05bbc-1339-4f15-98e8-05220989fbfd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2a4e16933c4f4f43be2ef418f91a5204', 'request_id': 'req-5cb05bbc-1339-4f15-98e8-05220989fbfd'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:53:02.121844 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-5cb05bbc-1339-4f15-98e8-05220989fbfd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2a4e16933c4f4f43be2ef418f91a5204', 'request_id': 'req-5cb05bbc-1339-4f15-98e8-05220989fbfd'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:53:02.128224 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-5cb05bbc-1339-4f15-98e8-05220989fbfd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2a4e16933c4f4f43be2ef418f91a5204', 'request_id': 'req-5cb05bbc-1339-4f15-98e8-05220989fbfd'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:53:02.143258 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-5cb05bbc-1339-4f15-98e8-05220989fbfd admin admin] The token cache is being invalidate because project 2a4e16933c4f4f43be2ef418f91a5204 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80475) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 14:53:02.143693 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-5cb05bbc-1339-4f15-98e8-05220989fbfd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:53:02.144347 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-5cb05bbc-1339-4f15-98e8-05220989fbfd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:53:02.146530 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1419/2824] 10.222.0.67 () {58 vars in 1232 bytes} [Wed May 25 14:53:01 2022] DELETE /identity/v3/projects/2a4e16933c4f4f43be2ef418f91a5204 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:53:02.151907 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f52d4f-65f5-4859-96f3-169848877feb None None] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:53:02.152420 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f52d4f-65f5-4859-96f3-169848877feb None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:53:02.152420 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f52d4f-65f5-4859-96f3-169848877feb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:53:02.171590 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.auth.core [None req-f9f52d4f-65f5-4859-96f3-169848877feb None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:53:02.172799 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-f9f52d4f-65f5-4859-96f3-169848877feb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:53:02.233982 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1406/2825] 10.222.0.67 () {58 vars in 957 bytes} [Wed May 25 14:53:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:53:02.243558 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d60c72-26b6-4ec8-92bb-ac7175146f19 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:53:02.243849 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d60c72-26b6-4ec8-92bb-ac7175146f19 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:53:02.244131 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d60c72-26b6-4ec8-92bb-ac7175146f19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:53:02.263240 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-44d60c72-26b6-4ec8-92bb-ac7175146f19 None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:53:02.264468 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-44d60c72-26b6-4ec8-92bb-ac7175146f19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:53:02.272970 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1420/2826] 10.222.0.67 () {58 vars in 957 bytes} [Wed May 25 14:53:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:53:02.277223 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f52d4f-65f5-4859-96f3-169848877feb None None] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:53:02.288199 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f52d4f-65f5-4859-96f3-169848877feb None None] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:53:02.293027 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192f50fe-8997-4d69-af4c-6d760d92e382 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:53:02.293936 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192f50fe-8997-4d69-af4c-6d760d92e382 admin admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:53:02.294078 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192f50fe-8997-4d69-af4c-6d760d92e382 admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:53:02.295563 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192f50fe-8997-4d69-af4c-6d760d92e382 admin admin] PATH_INFO: `/v3/domains` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:53:02.295563 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192f50fe-8997-4d69-af4c-6d760d92e382 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:53:02.295563 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192f50fe-8997-4d69-af4c-6d760d92e382 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:53:02.296920 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192f50fe-8997-4d69-af4c-6d760d92e382 admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:53:02.311561 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1407/2827] 10.222.0.67 () {58 vars in 1152 bytes} [Wed May 25 14:53:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:53:02.315998 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d60c72-26b6-4ec8-92bb-ac7175146f19 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:53:02.326084 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d60c72-26b6-4ec8-92bb-ac7175146f19 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:53:02.330911 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0415cef0-5541-46c1-acf9-8cee5fe0229d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:53:02.331688 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0415cef0-5541-46c1-acf9-8cee5fe0229d admin admin] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:53:02.331994 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0415cef0-5541-46c1-acf9-8cee5fe0229d admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:53:02.332277 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0415cef0-5541-46c1-acf9-8cee5fe0229d admin admin] PATH_INFO: `/v3/projects` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:53:02.332988 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0415cef0-5541-46c1-acf9-8cee5fe0229d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:53:02.335173 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0415cef0-5541-46c1-acf9-8cee5fe0229d admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:53:02.362387 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1421/2828] 10.222.0.67 () {60 vars in 1152 bytes} [Wed May 25 14:53:02 2022] POST /identity/v3/projects => generated 379 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:53:02.367442 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192f50fe-8997-4d69-af4c-6d760d92e382 admin admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:53:02.377507 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192f50fe-8997-4d69-af4c-6d760d92e382 admin admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:53:02.419077 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:53:02.438525 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7d876f-ea57-4acb-af31-242bafd4a9be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:53:02.439227 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7d876f-ea57-4acb-af31-242bafd4a9be admin admin] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:53:02.439515 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7d876f-ea57-4acb-af31-242bafd4a9be admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:53:02.439793 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7d876f-ea57-4acb-af31-242bafd4a9be admin admin] PATH_INFO: `/v3/users` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:53:02.440518 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7d876f-ea57-4acb-af31-242bafd4a9be admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:53:02.442492 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7d876f-ea57-4acb-af31-242bafd4a9be admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:53:02.461247 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1408/2829] 10.222.0.67 () {60 vars in 1143 bytes} [Wed May 25 14:53:02 2022] POST /identity/v3/users => generated 290 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 14:53:02.465321 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0415cef0-5541-46c1-acf9-8cee5fe0229d admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:53:02.475810 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0415cef0-5541-46c1-acf9-8cee5fe0229d admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:53:02.480447 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25df16e6-e826-4498-9c82-91ca4818bf33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:53:02.481105 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25df16e6-e826-4498-9c82-91ca4818bf33 admin admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:53:02.481392 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25df16e6-e826-4498-9c82-91ca4818bf33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:53:02.481670 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25df16e6-e826-4498-9c82-91ca4818bf33 admin admin] PATH_INFO: `/v3/roles` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:53:02.482399 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25df16e6-e826-4498-9c82-91ca4818bf33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:53:02.484114 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25df16e6-e826-4498-9c82-91ca4818bf33 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:53:02.495910 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1422/2830] 10.222.0.67 () {58 vars in 1121 bytes} [Wed May 25 14:53:02 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:53:02.499876 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7d876f-ea57-4acb-af31-242bafd4a9be admin admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:53:02.510209 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7d876f-ea57-4acb-af31-242bafd4a9be admin admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:53:02.514977 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb1df8b-6802-469a-b7e2-6ea59798673f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:53:02.515645 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb1df8b-6802-469a-b7e2-6ea59798673f admin admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:53:02.515928 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb1df8b-6802-469a-b7e2-6ea59798673f admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:53:02.516200 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb1df8b-6802-469a-b7e2-6ea59798673f admin admin] PATH_INFO: `/v3/roles` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:53:02.516968 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb1df8b-6802-469a-b7e2-6ea59798673f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:53:02.518541 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb1df8b-6802-469a-b7e2-6ea59798673f admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:53:02.529163 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1409/2831] 10.222.0.67 () {58 vars in 1121 bytes} [Wed May 25 14:53:02 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 25 14:53:02.533178 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25df16e6-e826-4498-9c82-91ca4818bf33 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:53:02.547818 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25df16e6-e826-4498-9c82-91ca4818bf33 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:53:02.552804 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ead263-9c72-40cc-863b-a1a3841242ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:53:02.553688 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ead263-9c72-40cc-863b-a1a3841242ad admin admin] REQUEST_METHOD: `PUT` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:53:02.553972 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ead263-9c72-40cc-863b-a1a3841242ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:53:02.554249 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ead263-9c72-40cc-863b-a1a3841242ad admin admin] PATH_INFO: `/v3/projects/61a8e9e096cf4cf09e2be00f4c3b3005/users/75664d5db95d4d7482a52654bed784f5/roles/48808901834b4d5eab2c7e6b5b03791e` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:53:02.569087 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ead263-9c72-40cc-863b-a1a3841242ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=61a8e9e096cf4cf09e2be00f4c3b3005, user_id=75664d5db95d4d7482a52654bed784f5, role_id=48808901834b4d5eab2c7e6b5b03791e)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:53:02.571784 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ead263-9c72-40cc-863b-a1a3841242ad admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:53:02.585651 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1423/2832] 10.222.0.67 () {60 vars in 1482 bytes} [Wed May 25 14:53:02 2022] PUT /identity/v3/projects/61a8e9e096cf4cf09e2be00f4c3b3005/users/75664d5db95d4d7482a52654bed784f5/roles/48808901834b4d5eab2c7e6b5b03791e => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:53:02.595747 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014d93f8-6da8-4376-b210-8f64516797c1 None None] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:53:02.596129 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014d93f8-6da8-4376-b210-8f64516797c1 None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:53:02.596414 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014d93f8-6da8-4376-b210-8f64516797c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:53:02.623171 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.auth.core [None req-014d93f8-6da8-4376-b210-8f64516797c1 None None] MFA Rules not processed for user `75664d5db95d4d7482a52654bed784f5`. Rule list: `[]` (Enabled: `True`). {{(pid=80474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:53:02.624415 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-014d93f8-6da8-4376-b210-8f64516797c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:53:02.688847 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1410/2833] 10.222.0.67 () {58 vars in 957 bytes} [Wed May 25 14:53:02 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:53:02.693230 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ead263-9c72-40cc-863b-a1a3841242ad admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:53:02.721139 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:53:02.758094 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ead263-9c72-40cc-863b-a1a3841242ad admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:53:02.763219 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be8798e-30b8-44e7-8ed6-0730fe84c37c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:53:02.763895 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be8798e-30b8-44e7-8ed6-0730fe84c37c admin admin] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:53:02.764158 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be8798e-30b8-44e7-8ed6-0730fe84c37c admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:53:02.764431 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be8798e-30b8-44e7-8ed6-0730fe84c37c admin admin] PATH_INFO: `/v3/projects` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:53:02.765142 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be8798e-30b8-44e7-8ed6-0730fe84c37c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:53:02.767046 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be8798e-30b8-44e7-8ed6-0730fe84c37c admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:53:02.792308 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1424/2834] 10.222.0.67 () {60 vars in 1152 bytes} [Wed May 25 14:53:02 2022] POST /identity/v3/projects => generated 377 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:53:02.796489 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014d93f8-6da8-4376-b210-8f64516797c1 None None] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:53:02.807802 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014d93f8-6da8-4376-b210-8f64516797c1 None None] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:53:02.867075 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f656e0d3-de84-4cea-833c-4afcb92dd5b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:53:02.867752 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f656e0d3-de84-4cea-833c-4afcb92dd5b6 admin admin] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:53:02.868041 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f656e0d3-de84-4cea-833c-4afcb92dd5b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:53:02.868331 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f656e0d3-de84-4cea-833c-4afcb92dd5b6 admin admin] PATH_INFO: `/v3/users` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:53:02.869017 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f656e0d3-de84-4cea-833c-4afcb92dd5b6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:53:02.870920 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f656e0d3-de84-4cea-833c-4afcb92dd5b6 admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:53:02.891418 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1411/2835] 10.222.0.67 () {60 vars in 1143 bytes} [Wed May 25 14:53:02 2022] POST /identity/v3/users => generated 289 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 14:53:02.895427 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be8798e-30b8-44e7-8ed6-0730fe84c37c admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:53:02.906332 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be8798e-30b8-44e7-8ed6-0730fe84c37c admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:53:02.910842 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae62f9c7-5a8b-4390-8cd8-d06069c46f6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:53:02.911593 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae62f9c7-5a8b-4390-8cd8-d06069c46f6a admin admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:53:02.911869 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae62f9c7-5a8b-4390-8cd8-d06069c46f6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:53:02.912143 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae62f9c7-5a8b-4390-8cd8-d06069c46f6a admin admin] PATH_INFO: `/v3/roles` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:53:02.912863 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae62f9c7-5a8b-4390-8cd8-d06069c46f6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:53:02.914473 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae62f9c7-5a8b-4390-8cd8-d06069c46f6a admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:53:02.924855 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1425/2836] 10.222.0.67 () {58 vars in 1121 bytes} [Wed May 25 14:53:02 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:53:02.928719 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f656e0d3-de84-4cea-833c-4afcb92dd5b6 admin admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:53:02.938605 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f656e0d3-de84-4cea-833c-4afcb92dd5b6 admin admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:53:02.943965 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ecbf30-9d2a-4f9e-bd62-ab08f3e617c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:53:02.944570 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ecbf30-9d2a-4f9e-bd62-ab08f3e617c4 admin admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:53:02.944863 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ecbf30-9d2a-4f9e-bd62-ab08f3e617c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:53:02.945168 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ecbf30-9d2a-4f9e-bd62-ab08f3e617c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:53:02.945886 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ecbf30-9d2a-4f9e-bd62-ab08f3e617c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:53:02.947518 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ecbf30-9d2a-4f9e-bd62-ab08f3e617c4 admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:53:02.957786 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1412/2837] 10.222.0.67 () {58 vars in 1121 bytes} [Wed May 25 14:53:02 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:53:02.962381 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae62f9c7-5a8b-4390-8cd8-d06069c46f6a admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:53:02.972401 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae62f9c7-5a8b-4390-8cd8-d06069c46f6a admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:53:02.977178 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e33dafb-1cb7-49d1-84b5-118c7a994d8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:53:02.978050 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e33dafb-1cb7-49d1-84b5-118c7a994d8a admin admin] REQUEST_METHOD: `PUT` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:53:02.978333 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e33dafb-1cb7-49d1-84b5-118c7a994d8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:53:02.978609 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e33dafb-1cb7-49d1-84b5-118c7a994d8a admin admin] PATH_INFO: `/v3/projects/279887e1f79e413aa4abcaf035cd14e7/users/8cf7706c3cd748fba266427fc2287f9a/roles/48808901834b4d5eab2c7e6b5b03791e` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:53:02.993010 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e33dafb-1cb7-49d1-84b5-118c7a994d8a admin admin] RBAC: Authorizing `identity:create_grant(project_id=279887e1f79e413aa4abcaf035cd14e7, user_id=8cf7706c3cd748fba266427fc2287f9a, role_id=48808901834b4d5eab2c7e6b5b03791e)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:53:02.995700 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e33dafb-1cb7-49d1-84b5-118c7a994d8a admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:53:03.008961 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1426/2838] 10.222.0.67 () {60 vars in 1482 bytes} [Wed May 25 14:53:02 2022] PUT /identity/v3/projects/279887e1f79e413aa4abcaf035cd14e7/users/8cf7706c3cd748fba266427fc2287f9a/roles/48808901834b4d5eab2c7e6b5b03791e => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:53:03.019380 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe57d1a5-bce8-4a9f-bd63-1d476b5c8b7a None None] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:53:03.019676 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe57d1a5-bce8-4a9f-bd63-1d476b5c8b7a None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:53:03.019960 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe57d1a5-bce8-4a9f-bd63-1d476b5c8b7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:53:03.047160 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.auth.core [None req-fe57d1a5-bce8-4a9f-bd63-1d476b5c8b7a None None] MFA Rules not processed for user `8cf7706c3cd748fba266427fc2287f9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:53:03.048658 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-fe57d1a5-bce8-4a9f-bd63-1d476b5c8b7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:53:03.065749 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:53:03.116617 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1413/2839] 10.222.0.67 () {58 vars in 957 bytes} [Wed May 25 14:53:03 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:53:03.121212 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e33dafb-1cb7-49d1-84b5-118c7a994d8a admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:53:03.183731 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e33dafb-1cb7-49d1-84b5-118c7a994d8a admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:53:03.188341 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c80d0c-ebed-40bb-bebf-1ed7a5868d6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:53:03.188991 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c80d0c-ebed-40bb-bebf-1ed7a5868d6f admin admin] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:53:03.189331 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c80d0c-ebed-40bb-bebf-1ed7a5868d6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:53:03.189609 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c80d0c-ebed-40bb-bebf-1ed7a5868d6f admin admin] PATH_INFO: `/v3/projects` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:53:03.190292 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c80d0c-ebed-40bb-bebf-1ed7a5868d6f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:53:03.192223 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c80d0c-ebed-40bb-bebf-1ed7a5868d6f admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:53:03.217294 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1427/2840] 10.222.0.67 () {60 vars in 1152 bytes} [Wed May 25 14:53:03 2022] POST /identity/v3/projects => generated 379 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:53:03.221294 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe57d1a5-bce8-4a9f-bd63-1d476b5c8b7a None None] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:53:03.232311 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe57d1a5-bce8-4a9f-bd63-1d476b5c8b7a None None] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:53:03.291799 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f298db-1070-4572-b66f-fd4def092610 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:53:03.292484 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f298db-1070-4572-b66f-fd4def092610 admin admin] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:53:03.292772 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f298db-1070-4572-b66f-fd4def092610 admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:53:03.293396 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f298db-1070-4572-b66f-fd4def092610 admin admin] PATH_INFO: `/v3/users` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:53:03.294020 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f298db-1070-4572-b66f-fd4def092610 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:53:03.295853 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f298db-1070-4572-b66f-fd4def092610 admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:53:03.321466 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1414/2841] 10.222.0.67 () {60 vars in 1143 bytes} [Wed May 25 14:53:03 2022] POST /identity/v3/users => generated 296 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:53:03.323108 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c80d0c-ebed-40bb-bebf-1ed7a5868d6f admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:53:03.335676 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c80d0c-ebed-40bb-bebf-1ed7a5868d6f admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:53:03.340998 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da45442-a7fd-4718-ab25-2be820bc5d78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:53:03.341862 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da45442-a7fd-4718-ab25-2be820bc5d78 admin admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:53:03.342150 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da45442-a7fd-4718-ab25-2be820bc5d78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:53:03.342431 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da45442-a7fd-4718-ab25-2be820bc5d78 admin admin] PATH_INFO: `/v3/roles` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:53:03.343346 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da45442-a7fd-4718-ab25-2be820bc5d78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:53:03.345006 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da45442-a7fd-4718-ab25-2be820bc5d78 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:53:03.357674 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1428/2842] 10.222.0.67 () {58 vars in 1121 bytes} [Wed May 25 14:53:03 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:53:03.362404 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f298db-1070-4572-b66f-fd4def092610 admin admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:53:03.373298 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f298db-1070-4572-b66f-fd4def092610 admin admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:53:03.378096 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1e15d7-4740-4666-be12-811700da61c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:53:03.378984 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1e15d7-4740-4666-be12-811700da61c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:53:03.379296 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1e15d7-4740-4666-be12-811700da61c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:53:03.379579 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1e15d7-4740-4666-be12-811700da61c6 admin admin] PATH_INFO: `/v3/projects/9e7ae0cec613475480c15c615ff1b860/users/725fdb8a7df84707bebf7de992e624c0/roles/399893e19eac4ab5a8e596f7c07be13c` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:53:03.397438 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1e15d7-4740-4666-be12-811700da61c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e7ae0cec613475480c15c615ff1b860, user_id=725fdb8a7df84707bebf7de992e624c0, role_id=399893e19eac4ab5a8e596f7c07be13c)` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:53:03.400440 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1e15d7-4740-4666-be12-811700da61c6 admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:53:03.418236 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1415/2843] 10.222.0.67 () {60 vars in 1482 bytes} [Wed May 25 14:53:03 2022] PUT /identity/v3/projects/9e7ae0cec613475480c15c615ff1b860/users/725fdb8a7df84707bebf7de992e624c0/roles/399893e19eac4ab5a8e596f7c07be13c => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:53:03.422627 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da45442-a7fd-4718-ab25-2be820bc5d78 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:53:03.435974 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da45442-a7fd-4718-ab25-2be820bc5d78 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:53:03.486607 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:53:03.500424 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a31b02-ebf9-4693-84ab-955b8e7dced5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:53:03.501102 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a31b02-ebf9-4693-84ab-955b8e7dced5 admin admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:53:03.501394 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a31b02-ebf9-4693-84ab-955b8e7dced5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:53:03.501679 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a31b02-ebf9-4693-84ab-955b8e7dced5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:53:03.502418 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a31b02-ebf9-4693-84ab-955b8e7dced5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:53:03.504067 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a31b02-ebf9-4693-84ab-955b8e7dced5 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:53:03.515952 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1429/2844] 10.222.0.67 () {58 vars in 1121 bytes} [Wed May 25 14:53:03 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:53:03.520458 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1e15d7-4740-4666-be12-811700da61c6 admin admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:53:03.530826 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1e15d7-4740-4666-be12-811700da61c6 admin admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:53:03.535512 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe9737a-4a72-4234-b4da-a514b1d7f56d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:53:03.536969 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe9737a-4a72-4234-b4da-a514b1d7f56d admin admin] REQUEST_METHOD: `PUT` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:53:03.537247 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe9737a-4a72-4234-b4da-a514b1d7f56d admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:53:03.537517 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe9737a-4a72-4234-b4da-a514b1d7f56d admin admin] PATH_INFO: `/v3/projects/9e7ae0cec613475480c15c615ff1b860/users/725fdb8a7df84707bebf7de992e624c0/roles/399893e19eac4ab5a8e596f7c07be13c` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:53:03.539521 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe9737a-4a72-4234-b4da-a514b1d7f56d admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e7ae0cec613475480c15c615ff1b860, user_id=725fdb8a7df84707bebf7de992e624c0, role_id=399893e19eac4ab5a8e596f7c07be13c)` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:53:03.542221 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe9737a-4a72-4234-b4da-a514b1d7f56d admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:53:03.553835 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1416/2845] 10.222.0.67 () {60 vars in 1482 bytes} [Wed May 25 14:53:03 2022] PUT /identity/v3/projects/9e7ae0cec613475480c15c615ff1b860/users/725fdb8a7df84707bebf7de992e624c0/roles/399893e19eac4ab5a8e596f7c07be13c => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:53:03.565204 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5976315b-a299-4f3b-98a1-ec61a05ffd2e None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:53:03.565498 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5976315b-a299-4f3b-98a1-ec61a05ffd2e None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:53:03.565784 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5976315b-a299-4f3b-98a1-ec61a05ffd2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:53:03.597110 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-5976315b-a299-4f3b-98a1-ec61a05ffd2e None None] MFA Rules not processed for user `725fdb8a7df84707bebf7de992e624c0`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:53:03.598331 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-5976315b-a299-4f3b-98a1-ec61a05ffd2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:53:03.673338 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1430/2846] 10.222.0.67 () {58 vars in 957 bytes} [Wed May 25 14:53:03 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:53:03.689531 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe9737a-4a72-4234-b4da-a514b1d7f56d admin admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:53:03.691349 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-cfe9737a-4a72-4234-b4da-a514b1d7f56d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:53:03.750454 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe9737a-4a72-4234-b4da-a514b1d7f56d admin admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:53:03.753937 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac85f36-ee8e-4473-8d37-2a2209f00152 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e462acc9da84a61bb23998dd54e1858', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfe93ee8d32a441295efc0b885de4bd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:53:03.754582 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac85f36-ee8e-4473-8d37-2a2209f00152 service cinder] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:53:03.754889 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac85f36-ee8e-4473-8d37-2a2209f00152 service cinder] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:53:03.755263 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac85f36-ee8e-4473-8d37-2a2209f00152 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:53:03.765263 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac85f36-ee8e-4473-8d37-2a2209f00152 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:53:03.766692 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac85f36-ee8e-4473-8d37-2a2209f00152 service cinder] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:53:03.776530 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1417/2847] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 14:53:03 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 14:53:03.822340 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5976315b-a299-4f3b-98a1-ec61a05ffd2e None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:53:03.823758 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-5976315b-a299-4f3b-98a1-ec61a05ffd2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:53:03.837483 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5976315b-a299-4f3b-98a1-ec61a05ffd2e None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:53:03.841920 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4d4947-1e12-4448-ae48-acc670a3e0c0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e462acc9da84a61bb23998dd54e1858', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfe93ee8d32a441295efc0b885de4bd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:53:03.842071 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4d4947-1e12-4448-ae48-acc670a3e0c0 service cinder] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:53:03.842282 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4d4947-1e12-4448-ae48-acc670a3e0c0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:53:03.842564 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4d4947-1e12-4448-ae48-acc670a3e0c0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:53:03.901878 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4d4947-1e12-4448-ae48-acc670a3e0c0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:53:03.903369 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4d4947-1e12-4448-ae48-acc670a3e0c0 service cinder] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:53:03.912949 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1431/2848] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 14:53:03 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:53:06.796407 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac85f36-ee8e-4473-8d37-2a2209f00152 service cinder] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:53:06.812522 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:53:06.865493 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac85f36-ee8e-4473-8d37-2a2209f00152 service cinder] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:53:06.870242 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f00a81-bc7e-4a40-b35d-86a39933e35f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:53:06.871151 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f00a81-bc7e-4a40-b35d-86a39933e35f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:53:06.871439 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f00a81-bc7e-4a40-b35d-86a39933e35f admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:53:06.871719 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f00a81-bc7e-4a40-b35d-86a39933e35f admin admin] PATH_INFO: `/v3/users/75664d5db95d4d7482a52654bed784f5` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:53:06.872908 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f00a81-bc7e-4a40-b35d-86a39933e35f admin admin] RBAC: Authorizing `identity:delete_user(user_id=75664d5db95d4d7482a52654bed784f5)` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:53:06.874846 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f00a81-bc7e-4a40-b35d-86a39933e35f admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:53:06.922481 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-b6f00a81-bc7e-4a40-b35d-86a39933e35f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '75664d5db95d4d7482a52654bed784f5'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:53:06.923172 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-b6f00a81-bc7e-4a40-b35d-86a39933e35f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '75664d5db95d4d7482a52654bed784f5'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:53:06.923772 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-b6f00a81-bc7e-4a40-b35d-86a39933e35f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '75664d5db95d4d7482a52654bed784f5'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:53:06.936129 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-b6f00a81-bc7e-4a40-b35d-86a39933e35f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '75664d5db95d4d7482a52654bed784f5'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:53:06.943218 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-b6f00a81-bc7e-4a40-b35d-86a39933e35f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '75664d5db95d4d7482a52654bed784f5'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:53:06.958631 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1418/2849] 10.222.0.67 () {58 vars in 1223 bytes} [Wed May 25 14:53:06 2022] DELETE /identity/v3/users/75664d5db95d4d7482a52654bed784f5 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:53:06.963208 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b33a31-3b42-49dd-b774-46ceafeb5aec None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:53:06.963693 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b33a31-3b42-49dd-b774-46ceafeb5aec None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:53:06.963810 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b33a31-3b42-49dd-b774-46ceafeb5aec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:53:06.981256 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-d4b33a31-3b42-49dd-b774-46ceafeb5aec None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:53:06.982453 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-d4b33a31-3b42-49dd-b774-46ceafeb5aec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:53:07.043929 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1432/2850] 10.222.0.67 () {58 vars in 957 bytes} [Wed May 25 14:53:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:53:07.053558 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f00a81-bc7e-4a40-b35d-86a39933e35f admin admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:53:07.054967 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-b6f00a81-bc7e-4a40-b35d-86a39933e35f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:53:07.127810 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f00a81-bc7e-4a40-b35d-86a39933e35f admin admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:53:07.131925 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4a0757-ca8a-4a21-90e4-40f5dee8ecc5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b68eed985c7b49839bcdd173186ad4ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfe93ee8d32a441295efc0b885de4bd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:53:07.132590 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4a0757-ca8a-4a21-90e4-40f5dee8ecc5 service neutron] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:53:07.132880 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4a0757-ca8a-4a21-90e4-40f5dee8ecc5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:53:07.133166 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4a0757-ca8a-4a21-90e4-40f5dee8ecc5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:53:07.143233 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4a0757-ca8a-4a21-90e4-40f5dee8ecc5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:53:07.144682 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4a0757-ca8a-4a21-90e4-40f5dee8ecc5 service neutron] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:53:07.155278 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1419/2851] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 14:53:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:53:07.432871 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b33a31-3b42-49dd-b774-46ceafeb5aec None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:53:07.434349 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-d4b33a31-3b42-49dd-b774-46ceafeb5aec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:53:07.450110 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b33a31-3b42-49dd-b774-46ceafeb5aec None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:53:07.459019 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6b867b-8b5f-4ca5-bdf5-3ba89192726c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:53:07.460739 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6b867b-8b5f-4ca5-bdf5-3ba89192726c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:53:07.461100 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6b867b-8b5f-4ca5-bdf5-3ba89192726c admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:53:07.461588 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6b867b-8b5f-4ca5-bdf5-3ba89192726c admin admin] PATH_INFO: `/v3/projects/61a8e9e096cf4cf09e2be00f4c3b3005` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:53:07.462859 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6b867b-8b5f-4ca5-bdf5-3ba89192726c admin admin] RBAC: Authorizing `identity:delete_project(project_id=61a8e9e096cf4cf09e2be00f4c3b3005)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:53:07.464908 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6b867b-8b5f-4ca5-bdf5-3ba89192726c admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:53:07.467547 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:53:07.516581 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-8d6b867b-8b5f-4ca5-bdf5-3ba89192726c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '61a8e9e096cf4cf09e2be00f4c3b3005', 'request_id': 'req-8d6b867b-8b5f-4ca5-bdf5-3ba89192726c'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:53:07.524293 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-8d6b867b-8b5f-4ca5-bdf5-3ba89192726c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '61a8e9e096cf4cf09e2be00f4c3b3005', 'request_id': 'req-8d6b867b-8b5f-4ca5-bdf5-3ba89192726c'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:53:07.532927 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-8d6b867b-8b5f-4ca5-bdf5-3ba89192726c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '61a8e9e096cf4cf09e2be00f4c3b3005', 'request_id': 'req-8d6b867b-8b5f-4ca5-bdf5-3ba89192726c'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:53:07.547860 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-8d6b867b-8b5f-4ca5-bdf5-3ba89192726c admin admin] The token cache is being invalidate because project 61a8e9e096cf4cf09e2be00f4c3b3005 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80475) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 14:53:07.548312 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-8d6b867b-8b5f-4ca5-bdf5-3ba89192726c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:53:07.549366 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-8d6b867b-8b5f-4ca5-bdf5-3ba89192726c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:53:07.552500 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1433/2852] 10.222.0.67 () {58 vars in 1232 bytes} [Wed May 25 14:53:07 2022] DELETE /identity/v3/projects/61a8e9e096cf4cf09e2be00f4c3b3005 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:53:07.558262 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4a0757-ca8a-4a21-90e4-40f5dee8ecc5 service neutron] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:53:07.568906 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4a0757-ca8a-4a21-90e4-40f5dee8ecc5 service neutron] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:53:07.608883 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:53:07.641149 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901a778c-53ca-406c-9c7a-0ced8ed09460 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:53:07.642039 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901a778c-53ca-406c-9c7a-0ced8ed09460 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:53:07.642334 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901a778c-53ca-406c-9c7a-0ced8ed09460 admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:53:07.642610 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901a778c-53ca-406c-9c7a-0ced8ed09460 admin admin] PATH_INFO: `/v3/users/8cf7706c3cd748fba266427fc2287f9a` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:53:07.643895 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901a778c-53ca-406c-9c7a-0ced8ed09460 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8cf7706c3cd748fba266427fc2287f9a)` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:53:07.647444 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901a778c-53ca-406c-9c7a-0ced8ed09460 admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:53:07.709135 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-901a778c-53ca-406c-9c7a-0ced8ed09460 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8cf7706c3cd748fba266427fc2287f9a'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:53:07.709828 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-901a778c-53ca-406c-9c7a-0ced8ed09460 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8cf7706c3cd748fba266427fc2287f9a'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:53:07.710441 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-901a778c-53ca-406c-9c7a-0ced8ed09460 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8cf7706c3cd748fba266427fc2287f9a'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:53:07.734879 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-901a778c-53ca-406c-9c7a-0ced8ed09460 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8cf7706c3cd748fba266427fc2287f9a'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:53:07.742168 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-901a778c-53ca-406c-9c7a-0ced8ed09460 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8cf7706c3cd748fba266427fc2287f9a'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:53:07.757877 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1420/2853] 10.222.0.67 () {58 vars in 1223 bytes} [Wed May 25 14:53:07 2022] DELETE /identity/v3/users/8cf7706c3cd748fba266427fc2287f9a => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:53:08.037497 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6b867b-8b5f-4ca5-bdf5-3ba89192726c admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:53:08.039074 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-8d6b867b-8b5f-4ca5-bdf5-3ba89192726c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:53:08.057530 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6b867b-8b5f-4ca5-bdf5-3ba89192726c admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:53:08.119981 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af199f1-5bdf-4d4a-831a-cd0a50af5df0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:53:08.120877 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af199f1-5bdf-4d4a-831a-cd0a50af5df0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:53:08.121210 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af199f1-5bdf-4d4a-831a-cd0a50af5df0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:53:08.121491 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af199f1-5bdf-4d4a-831a-cd0a50af5df0 admin admin] PATH_INFO: `/v3/projects/279887e1f79e413aa4abcaf035cd14e7` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:53:08.122659 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af199f1-5bdf-4d4a-831a-cd0a50af5df0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=279887e1f79e413aa4abcaf035cd14e7)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:53:08.124713 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af199f1-5bdf-4d4a-831a-cd0a50af5df0 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:53:08.172542 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-7af199f1-5bdf-4d4a-831a-cd0a50af5df0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '279887e1f79e413aa4abcaf035cd14e7', 'request_id': 'req-7af199f1-5bdf-4d4a-831a-cd0a50af5df0'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:53:08.178351 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-7af199f1-5bdf-4d4a-831a-cd0a50af5df0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '279887e1f79e413aa4abcaf035cd14e7', 'request_id': 'req-7af199f1-5bdf-4d4a-831a-cd0a50af5df0'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:53:08.185078 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-7af199f1-5bdf-4d4a-831a-cd0a50af5df0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '279887e1f79e413aa4abcaf035cd14e7', 'request_id': 'req-7af199f1-5bdf-4d4a-831a-cd0a50af5df0'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:53:08.197865 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-7af199f1-5bdf-4d4a-831a-cd0a50af5df0 admin admin] The token cache is being invalidate because project 279887e1f79e413aa4abcaf035cd14e7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80475) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 14:53:08.198150 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-7af199f1-5bdf-4d4a-831a-cd0a50af5df0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:53:08.198754 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-7af199f1-5bdf-4d4a-831a-cd0a50af5df0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:53:08.200319 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1434/2854] 10.222.0.67 () {58 vars in 1232 bytes} [Wed May 25 14:53:08 2022] DELETE /identity/v3/projects/279887e1f79e413aa4abcaf035cd14e7 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:53:08.204884 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901a778c-53ca-406c-9c7a-0ced8ed09460 admin admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:53:08.206315 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-901a778c-53ca-406c-9c7a-0ced8ed09460 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:53:08.220065 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901a778c-53ca-406c-9c7a-0ced8ed09460 admin admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:53:08.278082 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb3330f-11c5-495a-b24b-2206f6a353ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:53:08.278881 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb3330f-11c5-495a-b24b-2206f6a353ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:53:08.279190 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb3330f-11c5-495a-b24b-2206f6a353ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:53:08.279487 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb3330f-11c5-495a-b24b-2206f6a353ca admin admin] PATH_INFO: `/v3/users/725fdb8a7df84707bebf7de992e624c0` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:53:08.280658 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb3330f-11c5-495a-b24b-2206f6a353ca admin admin] RBAC: Authorizing `identity:delete_user(user_id=725fdb8a7df84707bebf7de992e624c0)` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:53:08.282620 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb3330f-11c5-495a-b24b-2206f6a353ca admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:53:08.329890 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-adb3330f-11c5-495a-b24b-2206f6a353ca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '725fdb8a7df84707bebf7de992e624c0'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:53:08.330543 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-adb3330f-11c5-495a-b24b-2206f6a353ca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '725fdb8a7df84707bebf7de992e624c0'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:53:08.331200 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-adb3330f-11c5-495a-b24b-2206f6a353ca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '725fdb8a7df84707bebf7de992e624c0'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:53:08.336404 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=81,keystone:DELETE=18,keystone:INSERT=1 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:53:08.345634 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-adb3330f-11c5-495a-b24b-2206f6a353ca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '725fdb8a7df84707bebf7de992e624c0'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:53:08.353683 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-adb3330f-11c5-495a-b24b-2206f6a353ca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '725fdb8a7df84707bebf7de992e624c0'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:53:08.366968 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1421/2855] 10.222.0.67 () {58 vars in 1223 bytes} [Wed May 25 14:53:08 2022] DELETE /identity/v3/users/725fdb8a7df84707bebf7de992e624c0 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:53:08.640820 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af199f1-5bdf-4d4a-831a-cd0a50af5df0 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:53:08.642273 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-7af199f1-5bdf-4d4a-831a-cd0a50af5df0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:53:08.656799 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af199f1-5bdf-4d4a-831a-cd0a50af5df0 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:53:08.676961 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:53:08.718131 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd96e857-c999-43f0-bd8c-db6665098e88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:53:08.719043 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd96e857-c999-43f0-bd8c-db6665098e88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:53:08.719332 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd96e857-c999-43f0-bd8c-db6665098e88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:53:08.719609 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd96e857-c999-43f0-bd8c-db6665098e88 admin admin] PATH_INFO: `/v3/projects/9e7ae0cec613475480c15c615ff1b860` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:53:08.720822 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd96e857-c999-43f0-bd8c-db6665098e88 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9e7ae0cec613475480c15c615ff1b860)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:53:08.722735 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd96e857-c999-43f0-bd8c-db6665098e88 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:53:08.772820 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-fd96e857-c999-43f0-bd8c-db6665098e88 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9e7ae0cec613475480c15c615ff1b860', 'request_id': 'req-fd96e857-c999-43f0-bd8c-db6665098e88'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:53:08.778451 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-fd96e857-c999-43f0-bd8c-db6665098e88 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9e7ae0cec613475480c15c615ff1b860', 'request_id': 'req-fd96e857-c999-43f0-bd8c-db6665098e88'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:53:08.784773 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-fd96e857-c999-43f0-bd8c-db6665098e88 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9e7ae0cec613475480c15c615ff1b860', 'request_id': 'req-fd96e857-c999-43f0-bd8c-db6665098e88'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:53:08.797478 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-fd96e857-c999-43f0-bd8c-db6665098e88 admin admin] The token cache is being invalidate because project 9e7ae0cec613475480c15c615ff1b860 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80475) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 14:53:08.797768 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-fd96e857-c999-43f0-bd8c-db6665098e88 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:53:08.798385 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-fd96e857-c999-43f0-bd8c-db6665098e88 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:53:08.799959 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1435/2856] 10.222.0.67 () {58 vars in 1232 bytes} [Wed May 25 14:53:08 2022] DELETE /identity/v3/projects/9e7ae0cec613475480c15c615ff1b860 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:53:08.806851 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5ba4d9-262c-4b0c-bafd-46b2f28089bd None None] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:53:08.807184 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5ba4d9-262c-4b0c-bafd-46b2f28089bd None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:53:08.807471 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5ba4d9-262c-4b0c-bafd-46b2f28089bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:53:08.825807 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.auth.core [None req-eb5ba4d9-262c-4b0c-bafd-46b2f28089bd None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:53:08.826962 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-eb5ba4d9-262c-4b0c-bafd-46b2f28089bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:53:08.890118 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1422/2857] 10.222.0.67 () {58 vars in 957 bytes} [Wed May 25 14:53:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:53:08.898890 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c91019-540d-4bf3-bb55-be3befcfb830 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:53:08.899237 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c91019-540d-4bf3-bb55-be3befcfb830 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:53:08.899521 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c91019-540d-4bf3-bb55-be3befcfb830 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:53:08.918487 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-21c91019-540d-4bf3-bb55-be3befcfb830 None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:53:08.919728 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-21c91019-540d-4bf3-bb55-be3befcfb830 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:53:08.928607 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1436/2858] 10.222.0.67 () {58 vars in 957 bytes} [Wed May 25 14:53:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:53:08.932903 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5ba4d9-262c-4b0c-bafd-46b2f28089bd None None] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:53:08.942927 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5ba4d9-262c-4b0c-bafd-46b2f28089bd None None] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:53:08.947788 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43d6edd-7444-417b-af33-d171207deaee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:53:08.948434 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43d6edd-7444-417b-af33-d171207deaee admin admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:53:08.948717 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43d6edd-7444-417b-af33-d171207deaee admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:53:08.948991 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43d6edd-7444-417b-af33-d171207deaee admin admin] PATH_INFO: `/v3/domains` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:53:08.949709 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43d6edd-7444-417b-af33-d171207deaee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:53:08.950015 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43d6edd-7444-417b-af33-d171207deaee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:53:08.951641 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43d6edd-7444-417b-af33-d171207deaee admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:53:08.963783 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1423/2859] 10.222.0.67 () {58 vars in 1152 bytes} [Wed May 25 14:53:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:53:08.968237 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c91019-540d-4bf3-bb55-be3befcfb830 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:53:08.977405 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c91019-540d-4bf3-bb55-be3befcfb830 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:53:08.982069 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082325ce-60bc-4f7f-be59-20a268d33d74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:53:08.982715 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082325ce-60bc-4f7f-be59-20a268d33d74 admin admin] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:53:08.983022 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082325ce-60bc-4f7f-be59-20a268d33d74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:53:08.983308 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082325ce-60bc-4f7f-be59-20a268d33d74 admin admin] PATH_INFO: `/v3/projects` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:53:08.983991 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082325ce-60bc-4f7f-be59-20a268d33d74 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:53:08.985880 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082325ce-60bc-4f7f-be59-20a268d33d74 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:53:09.019332 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1437/2860] 10.222.0.67 () {60 vars in 1152 bytes} [Wed May 25 14:53:08 2022] POST /identity/v3/projects => generated 383 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:53:09.023692 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43d6edd-7444-417b-af33-d171207deaee admin admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:53:09.033937 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43d6edd-7444-417b-af33-d171207deaee admin admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:53:09.093373 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4cb59b-6afe-4685-9205-19fe0e14f704 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:53:09.093947 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4cb59b-6afe-4685-9205-19fe0e14f704 admin admin] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:53:09.094231 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4cb59b-6afe-4685-9205-19fe0e14f704 admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:53:09.094509 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4cb59b-6afe-4685-9205-19fe0e14f704 admin admin] PATH_INFO: `/v3/users` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:53:09.095230 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4cb59b-6afe-4685-9205-19fe0e14f704 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:53:09.097127 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4cb59b-6afe-4685-9205-19fe0e14f704 admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:53:09.117802 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1424/2861] 10.222.0.67 () {60 vars in 1143 bytes} [Wed May 25 14:53:09 2022] POST /identity/v3/users => generated 292 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:53:09.122004 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082325ce-60bc-4f7f-be59-20a268d33d74 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:53:09.132993 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082325ce-60bc-4f7f-be59-20a268d33d74 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:53:09.137573 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd836e4-ae42-400e-8550-e3b8af820df3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:53:09.138490 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd836e4-ae42-400e-8550-e3b8af820df3 admin admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:53:09.138785 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd836e4-ae42-400e-8550-e3b8af820df3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:53:09.139097 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd836e4-ae42-400e-8550-e3b8af820df3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:53:09.139815 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd836e4-ae42-400e-8550-e3b8af820df3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:53:09.141428 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd836e4-ae42-400e-8550-e3b8af820df3 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:53:09.152224 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1438/2862] 10.222.0.67 () {58 vars in 1121 bytes} [Wed May 25 14:53:09 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:53:09.156058 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4cb59b-6afe-4685-9205-19fe0e14f704 admin admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:53:09.166227 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4cb59b-6afe-4685-9205-19fe0e14f704 admin admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:53:09.170710 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d0645e-6798-4302-8085-c8970aea33e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:53:09.171398 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d0645e-6798-4302-8085-c8970aea33e5 admin admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:53:09.171679 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d0645e-6798-4302-8085-c8970aea33e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:53:09.171955 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d0645e-6798-4302-8085-c8970aea33e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:53:09.172677 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d0645e-6798-4302-8085-c8970aea33e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:53:09.174256 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d0645e-6798-4302-8085-c8970aea33e5 admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:53:09.185148 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1425/2863] 10.222.0.67 () {58 vars in 1121 bytes} [Wed May 25 14:53:09 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 25 14:53:09.189199 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd836e4-ae42-400e-8550-e3b8af820df3 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:53:09.202111 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd836e4-ae42-400e-8550-e3b8af820df3 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:53:09.206852 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a56c78-09b2-4e0a-820b-8b1fb35e1484 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:53:09.207748 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a56c78-09b2-4e0a-820b-8b1fb35e1484 admin admin] REQUEST_METHOD: `PUT` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:53:09.208080 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a56c78-09b2-4e0a-820b-8b1fb35e1484 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:53:09.208361 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a56c78-09b2-4e0a-820b-8b1fb35e1484 admin admin] PATH_INFO: `/v3/projects/6dc57d9933194dbc978293408827e7dc/users/823e26b6c5424fd291bab8cea98598df/roles/48808901834b4d5eab2c7e6b5b03791e` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:53:09.223148 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a56c78-09b2-4e0a-820b-8b1fb35e1484 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6dc57d9933194dbc978293408827e7dc, user_id=823e26b6c5424fd291bab8cea98598df, role_id=48808901834b4d5eab2c7e6b5b03791e)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:53:09.225966 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a56c78-09b2-4e0a-820b-8b1fb35e1484 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:53:09.238897 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1439/2864] 10.222.0.67 () {60 vars in 1482 bytes} [Wed May 25 14:53:09 2022] PUT /identity/v3/projects/6dc57d9933194dbc978293408827e7dc/users/823e26b6c5424fd291bab8cea98598df/roles/48808901834b4d5eab2c7e6b5b03791e => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:53:09.251454 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a986fc-36ea-4e07-a086-ad84c211cabd None None] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:53:09.251971 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a986fc-36ea-4e07-a086-ad84c211cabd None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:53:09.252075 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a986fc-36ea-4e07-a086-ad84c211cabd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:53:09.279355 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.auth.core [None req-95a986fc-36ea-4e07-a086-ad84c211cabd None None] MFA Rules not processed for user `823e26b6c5424fd291bab8cea98598df`. Rule list: `[]` (Enabled: `True`). {{(pid=80474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:53:09.280564 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-95a986fc-36ea-4e07-a086-ad84c211cabd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:53:09.306233 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:53:09.348143 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1426/2865] 10.222.0.67 () {58 vars in 957 bytes} [Wed May 25 14:53:09 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:53:09.352655 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a56c78-09b2-4e0a-820b-8b1fb35e1484 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:53:09.401475 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:53:09.415360 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a56c78-09b2-4e0a-820b-8b1fb35e1484 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:53:09.420266 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c570074-ea8f-48d3-b716-4bacdd67e4f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:53:09.420925 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c570074-ea8f-48d3-b716-4bacdd67e4f9 admin admin] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:53:09.421214 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c570074-ea8f-48d3-b716-4bacdd67e4f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:53:09.421494 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c570074-ea8f-48d3-b716-4bacdd67e4f9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:53:09.422210 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c570074-ea8f-48d3-b716-4bacdd67e4f9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:53:09.424139 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c570074-ea8f-48d3-b716-4bacdd67e4f9 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:53:09.449858 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1440/2866] 10.222.0.67 () {60 vars in 1152 bytes} [Wed May 25 14:53:09 2022] POST /identity/v3/projects => generated 381 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:53:09.453948 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a986fc-36ea-4e07-a086-ad84c211cabd None None] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:53:09.464787 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a986fc-36ea-4e07-a086-ad84c211cabd None None] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:53:09.521003 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a07f956-4b34-4252-a996-9788ed1d5e98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:53:09.521670 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a07f956-4b34-4252-a996-9788ed1d5e98 admin admin] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:53:09.521963 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a07f956-4b34-4252-a996-9788ed1d5e98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:53:09.522248 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a07f956-4b34-4252-a996-9788ed1d5e98 admin admin] PATH_INFO: `/v3/users` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:53:09.522935 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a07f956-4b34-4252-a996-9788ed1d5e98 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:53:09.524894 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a07f956-4b34-4252-a996-9788ed1d5e98 admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:53:09.544876 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1427/2867] 10.222.0.67 () {60 vars in 1143 bytes} [Wed May 25 14:53:09 2022] POST /identity/v3/users => generated 297 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:53:09.548875 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c570074-ea8f-48d3-b716-4bacdd67e4f9 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:53:09.560094 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c570074-ea8f-48d3-b716-4bacdd67e4f9 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:53:09.564761 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b66e712-5c20-468a-8545-c51e83d1ab85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:53:09.565397 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b66e712-5c20-468a-8545-c51e83d1ab85 admin admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:53:09.565680 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b66e712-5c20-468a-8545-c51e83d1ab85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:53:09.565952 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b66e712-5c20-468a-8545-c51e83d1ab85 admin admin] PATH_INFO: `/v3/roles` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:53:09.566664 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b66e712-5c20-468a-8545-c51e83d1ab85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:53:09.568459 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b66e712-5c20-468a-8545-c51e83d1ab85 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:53:09.579954 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1441/2868] 10.222.0.67 () {58 vars in 1121 bytes} [Wed May 25 14:53:09 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:53:09.584243 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a07f956-4b34-4252-a996-9788ed1d5e98 admin admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:53:09.594879 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a07f956-4b34-4252-a996-9788ed1d5e98 admin admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:53:09.600375 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58460358-ed1a-46c6-af87-2983c228a67a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:53:09.601198 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58460358-ed1a-46c6-af87-2983c228a67a admin admin] REQUEST_METHOD: `PUT` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:53:09.601491 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58460358-ed1a-46c6-af87-2983c228a67a admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:53:09.601770 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58460358-ed1a-46c6-af87-2983c228a67a admin admin] PATH_INFO: `/v3/projects/dea007e432644f99b764d9a3e6f94323/users/efdbac0a9a8c457aa7ab9b74ad60e20b/roles/399893e19eac4ab5a8e596f7c07be13c` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:53:09.617326 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58460358-ed1a-46c6-af87-2983c228a67a admin admin] RBAC: Authorizing `identity:create_grant(project_id=dea007e432644f99b764d9a3e6f94323, user_id=efdbac0a9a8c457aa7ab9b74ad60e20b, role_id=399893e19eac4ab5a8e596f7c07be13c)` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:53:09.620061 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58460358-ed1a-46c6-af87-2983c228a67a admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:53:09.632909 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1428/2869] 10.222.0.67 () {60 vars in 1482 bytes} [Wed May 25 14:53:09 2022] PUT /identity/v3/projects/dea007e432644f99b764d9a3e6f94323/users/efdbac0a9a8c457aa7ab9b74ad60e20b/roles/399893e19eac4ab5a8e596f7c07be13c => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:53:09.636832 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b66e712-5c20-468a-8545-c51e83d1ab85 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:53:09.647423 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b66e712-5c20-468a-8545-c51e83d1ab85 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:53:09.703585 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998e3cb7-dd9d-48c4-8e53-8c66eaa1e649 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:53:09.704250 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998e3cb7-dd9d-48c4-8e53-8c66eaa1e649 admin admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:53:09.704534 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998e3cb7-dd9d-48c4-8e53-8c66eaa1e649 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:53:09.704806 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998e3cb7-dd9d-48c4-8e53-8c66eaa1e649 admin admin] PATH_INFO: `/v3/roles` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:53:09.705528 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998e3cb7-dd9d-48c4-8e53-8c66eaa1e649 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:53:09.707146 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998e3cb7-dd9d-48c4-8e53-8c66eaa1e649 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:53:09.717645 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1442/2870] 10.222.0.67 () {58 vars in 1121 bytes} [Wed May 25 14:53:09 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:53:09.721720 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58460358-ed1a-46c6-af87-2983c228a67a admin admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:53:09.732419 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58460358-ed1a-46c6-af87-2983c228a67a admin admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:53:09.736938 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00738414-f413-423a-94ad-b6c43943f362 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:53:09.737845 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00738414-f413-423a-94ad-b6c43943f362 admin admin] REQUEST_METHOD: `PUT` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:53:09.738133 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00738414-f413-423a-94ad-b6c43943f362 admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:53:09.738409 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00738414-f413-423a-94ad-b6c43943f362 admin admin] PATH_INFO: `/v3/projects/dea007e432644f99b764d9a3e6f94323/users/efdbac0a9a8c457aa7ab9b74ad60e20b/roles/399893e19eac4ab5a8e596f7c07be13c` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:53:09.741025 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00738414-f413-423a-94ad-b6c43943f362 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dea007e432644f99b764d9a3e6f94323, user_id=efdbac0a9a8c457aa7ab9b74ad60e20b, role_id=399893e19eac4ab5a8e596f7c07be13c)` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:53:09.743658 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00738414-f413-423a-94ad-b6c43943f362 admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:53:09.753632 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1429/2871] 10.222.0.67 () {60 vars in 1482 bytes} [Wed May 25 14:53:09 2022] PUT /identity/v3/projects/dea007e432644f99b764d9a3e6f94323/users/efdbac0a9a8c457aa7ab9b74ad60e20b/roles/399893e19eac4ab5a8e596f7c07be13c => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:53:09.815715 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327f044f-780d-4f6d-b6a3-800277a89f5f None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:53:09.816026 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327f044f-780d-4f6d-b6a3-800277a89f5f None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:53:09.816306 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327f044f-780d-4f6d-b6a3-800277a89f5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:53:09.845156 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-327f044f-780d-4f6d-b6a3-800277a89f5f None None] MFA Rules not processed for user `efdbac0a9a8c457aa7ab9b74ad60e20b`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:53:09.846364 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-327f044f-780d-4f6d-b6a3-800277a89f5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:53:09.915642 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1443/2872] 10.222.0.67 () {58 vars in 957 bytes} [Wed May 25 14:53:09 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:53:09.927761 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00738414-f413-423a-94ad-b6c43943f362 admin admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:53:09.929442 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-00738414-f413-423a-94ad-b6c43943f362 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:53:09.986557 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00738414-f413-423a-94ad-b6c43943f362 admin admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:53:09.991341 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ff3f4b-11b1-4446-a62d-42951644daa9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e462acc9da84a61bb23998dd54e1858', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfe93ee8d32a441295efc0b885de4bd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:53:09.991989 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ff3f4b-11b1-4446-a62d-42951644daa9 service cinder] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:53:09.992272 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ff3f4b-11b1-4446-a62d-42951644daa9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:53:09.992548 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ff3f4b-11b1-4446-a62d-42951644daa9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:53:10.001762 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ff3f4b-11b1-4446-a62d-42951644daa9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:53:10.003218 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ff3f4b-11b1-4446-a62d-42951644daa9 service cinder] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:53:10.014115 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1430/2873] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 14:53:09 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:53:10.101841 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327f044f-780d-4f6d-b6a3-800277a89f5f None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:53:10.111795 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327f044f-780d-4f6d-b6a3-800277a89f5f None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:53:10.115952 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34502e59-c887-47d1-a340-e8923c03dfe9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e462acc9da84a61bb23998dd54e1858', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfe93ee8d32a441295efc0b885de4bd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:53:10.116589 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34502e59-c887-47d1-a340-e8923c03dfe9 service cinder] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:53:10.116872 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34502e59-c887-47d1-a340-e8923c03dfe9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:53:10.117151 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34502e59-c887-47d1-a340-e8923c03dfe9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:53:10.160468 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:53:10.176523 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34502e59-c887-47d1-a340-e8923c03dfe9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:53:10.178413 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34502e59-c887-47d1-a340-e8923c03dfe9 service cinder] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:53:10.187417 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1444/2874] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 14:53:10 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:53:10.453505 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ff3f4b-11b1-4446-a62d-42951644daa9 service cinder] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:53:10.479598 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:53:10.518473 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ff3f4b-11b1-4446-a62d-42951644daa9 service cinder] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:53:10.523905 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f531d0-c418-41fe-bf06-613664644237 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:53:10.524777 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f531d0-c418-41fe-bf06-613664644237 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:53:10.525065 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f531d0-c418-41fe-bf06-613664644237 admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:53:10.525348 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f531d0-c418-41fe-bf06-613664644237 admin admin] PATH_INFO: `/v3/users/823e26b6c5424fd291bab8cea98598df` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:53:10.526529 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f531d0-c418-41fe-bf06-613664644237 admin admin] RBAC: Authorizing `identity:delete_user(user_id=823e26b6c5424fd291bab8cea98598df)` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:53:10.528483 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f531d0-c418-41fe-bf06-613664644237 admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:53:10.575799 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-60f531d0-c418-41fe-bf06-613664644237 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '823e26b6c5424fd291bab8cea98598df'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:53:10.576487 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-60f531d0-c418-41fe-bf06-613664644237 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '823e26b6c5424fd291bab8cea98598df'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:53:10.577241 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-60f531d0-c418-41fe-bf06-613664644237 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '823e26b6c5424fd291bab8cea98598df'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:53:10.589665 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-60f531d0-c418-41fe-bf06-613664644237 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '823e26b6c5424fd291bab8cea98598df'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:53:10.596711 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-60f531d0-c418-41fe-bf06-613664644237 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '823e26b6c5424fd291bab8cea98598df'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:53:10.609346 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1431/2875] 10.222.0.67 () {58 vars in 1223 bytes} [Wed May 25 14:53:10 2022] DELETE /identity/v3/users/823e26b6c5424fd291bab8cea98598df => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:53:10.613931 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aef1223-2e69-49e3-a617-16637b508f1a None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:53:10.614230 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aef1223-2e69-49e3-a617-16637b508f1a None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:53:10.614588 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aef1223-2e69-49e3-a617-16637b508f1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:53:10.631650 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-6aef1223-2e69-49e3-a617-16637b508f1a None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:53:10.632823 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-6aef1223-2e69-49e3-a617-16637b508f1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:53:10.692055 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1445/2876] 10.222.0.67 () {58 vars in 957 bytes} [Wed May 25 14:53:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:53:10.702082 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f531d0-c418-41fe-bf06-613664644237 admin admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:53:10.703512 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-60f531d0-c418-41fe-bf06-613664644237 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:53:10.763626 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f531d0-c418-41fe-bf06-613664644237 admin admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:53:10.767393 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0507f01-c639-4bbf-8477-7f4e4017d5be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b68eed985c7b49839bcdd173186ad4ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfe93ee8d32a441295efc0b885de4bd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:53:10.768062 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0507f01-c639-4bbf-8477-7f4e4017d5be service neutron] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:53:10.768334 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0507f01-c639-4bbf-8477-7f4e4017d5be service neutron] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:53:10.768615 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0507f01-c639-4bbf-8477-7f4e4017d5be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:53:10.778013 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0507f01-c639-4bbf-8477-7f4e4017d5be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:53:10.779545 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0507f01-c639-4bbf-8477-7f4e4017d5be service neutron] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:53:10.791190 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1432/2877] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 14:53:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 14:53:11.057588 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aef1223-2e69-49e3-a617-16637b508f1a None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:53:11.059069 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-6aef1223-2e69-49e3-a617-16637b508f1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:53:11.072263 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aef1223-2e69-49e3-a617-16637b508f1a None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:53:11.076770 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8791b1c-2197-475b-90e0-f5ffa3156f44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:53:11.077814 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8791b1c-2197-475b-90e0-f5ffa3156f44 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:53:11.078086 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8791b1c-2197-475b-90e0-f5ffa3156f44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:53:11.078356 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8791b1c-2197-475b-90e0-f5ffa3156f44 admin admin] PATH_INFO: `/v3/projects/6dc57d9933194dbc978293408827e7dc` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:53:11.079602 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8791b1c-2197-475b-90e0-f5ffa3156f44 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6dc57d9933194dbc978293408827e7dc)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:53:11.081504 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8791b1c-2197-475b-90e0-f5ffa3156f44 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:53:11.127550 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-f8791b1c-2197-475b-90e0-f5ffa3156f44 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6dc57d9933194dbc978293408827e7dc', 'request_id': 'req-f8791b1c-2197-475b-90e0-f5ffa3156f44'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:53:11.133720 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-f8791b1c-2197-475b-90e0-f5ffa3156f44 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6dc57d9933194dbc978293408827e7dc', 'request_id': 'req-f8791b1c-2197-475b-90e0-f5ffa3156f44'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:53:11.140036 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-f8791b1c-2197-475b-90e0-f5ffa3156f44 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6dc57d9933194dbc978293408827e7dc', 'request_id': 'req-f8791b1c-2197-475b-90e0-f5ffa3156f44'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:53:11.152629 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-f8791b1c-2197-475b-90e0-f5ffa3156f44 admin admin] The token cache is being invalidate because project 6dc57d9933194dbc978293408827e7dc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80475) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 14:53:11.152975 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-f8791b1c-2197-475b-90e0-f5ffa3156f44 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:53:11.154008 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-f8791b1c-2197-475b-90e0-f5ffa3156f44 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:53:11.155626 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1446/2878] 10.222.0.67 () {58 vars in 1232 bytes} [Wed May 25 14:53:11 2022] DELETE /identity/v3/projects/6dc57d9933194dbc978293408827e7dc => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 14:53:11.159638 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0507f01-c639-4bbf-8477-7f4e4017d5be service neutron] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:53:11.170488 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0507f01-c639-4bbf-8477-7f4e4017d5be service neutron] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:53:11.214237 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:53:11.233639 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d29de6-b51b-45a2-965c-33e5561abbe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:53:11.234428 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d29de6-b51b-45a2-965c-33e5561abbe2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:53:11.234714 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d29de6-b51b-45a2-965c-33e5561abbe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:53:11.235007 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d29de6-b51b-45a2-965c-33e5561abbe2 admin admin] PATH_INFO: `/v3/users/efdbac0a9a8c457aa7ab9b74ad60e20b` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:53:11.236226 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d29de6-b51b-45a2-965c-33e5561abbe2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=efdbac0a9a8c457aa7ab9b74ad60e20b)` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:53:11.238194 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d29de6-b51b-45a2-965c-33e5561abbe2 admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:53:11.286663 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-01d29de6-b51b-45a2-965c-33e5561abbe2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'efdbac0a9a8c457aa7ab9b74ad60e20b'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:53:11.287456 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-01d29de6-b51b-45a2-965c-33e5561abbe2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'efdbac0a9a8c457aa7ab9b74ad60e20b'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:53:11.288063 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-01d29de6-b51b-45a2-965c-33e5561abbe2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'efdbac0a9a8c457aa7ab9b74ad60e20b'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:53:11.299669 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-01d29de6-b51b-45a2-965c-33e5561abbe2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'efdbac0a9a8c457aa7ab9b74ad60e20b'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:53:11.306510 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-01d29de6-b51b-45a2-965c-33e5561abbe2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'efdbac0a9a8c457aa7ab9b74ad60e20b'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:53:11.319856 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1433/2879] 10.222.0.67 () {58 vars in 1223 bytes} [Wed May 25 14:53:11 2022] DELETE /identity/v3/users/efdbac0a9a8c457aa7ab9b74ad60e20b => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:53:11.585028 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8791b1c-2197-475b-90e0-f5ffa3156f44 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:53:11.586798 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-f8791b1c-2197-475b-90e0-f5ffa3156f44 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:53:11.609605 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8791b1c-2197-475b-90e0-f5ffa3156f44 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:53:11.678464 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097fe898-2a1a-4402-b7f6-9332c494d7c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:53:11.679387 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097fe898-2a1a-4402-b7f6-9332c494d7c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:53:11.679672 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097fe898-2a1a-4402-b7f6-9332c494d7c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:53:11.679944 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097fe898-2a1a-4402-b7f6-9332c494d7c9 admin admin] PATH_INFO: `/v3/projects/dea007e432644f99b764d9a3e6f94323` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:53:11.681139 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097fe898-2a1a-4402-b7f6-9332c494d7c9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dea007e432644f99b764d9a3e6f94323)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:53:11.683062 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097fe898-2a1a-4402-b7f6-9332c494d7c9 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:53:11.691044 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:53:11.733654 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-097fe898-2a1a-4402-b7f6-9332c494d7c9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dea007e432644f99b764d9a3e6f94323', 'request_id': 'req-097fe898-2a1a-4402-b7f6-9332c494d7c9'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:53:11.739303 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-097fe898-2a1a-4402-b7f6-9332c494d7c9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dea007e432644f99b764d9a3e6f94323', 'request_id': 'req-097fe898-2a1a-4402-b7f6-9332c494d7c9'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:53:11.745712 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-097fe898-2a1a-4402-b7f6-9332c494d7c9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dea007e432644f99b764d9a3e6f94323', 'request_id': 'req-097fe898-2a1a-4402-b7f6-9332c494d7c9'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:53:11.758929 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-097fe898-2a1a-4402-b7f6-9332c494d7c9 admin admin] The token cache is being invalidate because project dea007e432644f99b764d9a3e6f94323 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80475) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 14:53:11.759299 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-097fe898-2a1a-4402-b7f6-9332c494d7c9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:53:11.759867 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-097fe898-2a1a-4402-b7f6-9332c494d7c9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:53:11.761413 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1447/2880] 10.222.0.67 () {58 vars in 1232 bytes} [Wed May 25 14:53:11 2022] DELETE /identity/v3/projects/dea007e432644f99b764d9a3e6f94323 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:53:11.766765 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31c23e4-4ebc-4a05-a413-d3fa90c12a8b None None] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:53:11.767300 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31c23e4-4ebc-4a05-a413-d3fa90c12a8b None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:53:11.767410 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31c23e4-4ebc-4a05-a413-d3fa90c12a8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:53:11.786582 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.auth.core [None req-d31c23e4-4ebc-4a05-a413-d3fa90c12a8b None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:53:11.787906 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-d31c23e4-4ebc-4a05-a413-d3fa90c12a8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:53:11.849352 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1434/2881] 10.222.0.67 () {58 vars in 957 bytes} [Wed May 25 14:53:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:53:11.857480 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2c2bb4-e058-432a-864b-c6bc130a2f80 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:53:11.857769 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2c2bb4-e058-432a-864b-c6bc130a2f80 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:53:11.858048 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2c2bb4-e058-432a-864b-c6bc130a2f80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:53:11.876462 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-0d2c2bb4-e058-432a-864b-c6bc130a2f80 None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:53:11.877706 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-0d2c2bb4-e058-432a-864b-c6bc130a2f80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:53:11.886357 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1448/2882] 10.222.0.67 () {58 vars in 957 bytes} [Wed May 25 14:53:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:53:11.890928 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31c23e4-4ebc-4a05-a413-d3fa90c12a8b None None] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:53:11.901486 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31c23e4-4ebc-4a05-a413-d3fa90c12a8b None None] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:53:11.906044 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3379158-1905-4458-9ac8-fa678a961c2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:53:11.906705 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3379158-1905-4458-9ac8-fa678a961c2b admin admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:53:11.907020 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3379158-1905-4458-9ac8-fa678a961c2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:53:11.907311 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3379158-1905-4458-9ac8-fa678a961c2b admin admin] PATH_INFO: `/v3/domains` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:53:11.908072 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3379158-1905-4458-9ac8-fa678a961c2b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:53:11.908383 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3379158-1905-4458-9ac8-fa678a961c2b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:53:11.909992 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3379158-1905-4458-9ac8-fa678a961c2b admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:53:11.922378 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1435/2883] 10.222.0.67 () {58 vars in 1152 bytes} [Wed May 25 14:53:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:53:11.927526 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2c2bb4-e058-432a-864b-c6bc130a2f80 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:53:11.936824 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2c2bb4-e058-432a-864b-c6bc130a2f80 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:53:11.941491 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c857f168-e7cf-4bdf-b48d-20fcad5f0039 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:53:11.942138 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c857f168-e7cf-4bdf-b48d-20fcad5f0039 admin admin] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:53:11.942561 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c857f168-e7cf-4bdf-b48d-20fcad5f0039 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:53:11.942847 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c857f168-e7cf-4bdf-b48d-20fcad5f0039 admin admin] PATH_INFO: `/v3/projects` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:53:11.943586 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c857f168-e7cf-4bdf-b48d-20fcad5f0039 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:53:11.945484 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c857f168-e7cf-4bdf-b48d-20fcad5f0039 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:53:11.973930 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1449/2884] 10.222.0.67 () {60 vars in 1152 bytes} [Wed May 25 14:53:11 2022] POST /identity/v3/projects => generated 377 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:53:11.975845 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3379158-1905-4458-9ac8-fa678a961c2b admin admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:53:11.985865 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3379158-1905-4458-9ac8-fa678a961c2b admin admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:53:12.033617 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:53:12.045149 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5ec3fa-ca04-4622-9e0a-046d00b8f903 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:53:12.045842 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5ec3fa-ca04-4622-9e0a-046d00b8f903 admin admin] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:53:12.046130 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5ec3fa-ca04-4622-9e0a-046d00b8f903 admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:53:12.046409 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5ec3fa-ca04-4622-9e0a-046d00b8f903 admin admin] PATH_INFO: `/v3/users` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:53:12.047178 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5ec3fa-ca04-4622-9e0a-046d00b8f903 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:53:12.049084 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5ec3fa-ca04-4622-9e0a-046d00b8f903 admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:53:12.069171 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1436/2885] 10.222.0.67 () {60 vars in 1143 bytes} [Wed May 25 14:53:11 2022] POST /identity/v3/users => generated 289 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 14:53:12.073361 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c857f168-e7cf-4bdf-b48d-20fcad5f0039 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:53:12.084853 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c857f168-e7cf-4bdf-b48d-20fcad5f0039 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:53:12.089352 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4230dd33-bacf-482a-adeb-543542a8da7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:53:12.090007 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4230dd33-bacf-482a-adeb-543542a8da7f admin admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:53:12.090292 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4230dd33-bacf-482a-adeb-543542a8da7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:53:12.090567 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4230dd33-bacf-482a-adeb-543542a8da7f admin admin] PATH_INFO: `/v3/roles` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:53:12.091323 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4230dd33-bacf-482a-adeb-543542a8da7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:53:12.092918 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4230dd33-bacf-482a-adeb-543542a8da7f admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:53:12.103651 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1450/2886] 10.222.0.67 () {58 vars in 1121 bytes} [Wed May 25 14:53:12 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:53:12.107566 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5ec3fa-ca04-4622-9e0a-046d00b8f903 admin admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:53:12.117866 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5ec3fa-ca04-4622-9e0a-046d00b8f903 admin admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:53:12.122533 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a2cfd5-bbba-4442-8d1c-0759fe085d7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:53:12.123307 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a2cfd5-bbba-4442-8d1c-0759fe085d7f admin admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:53:12.123601 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a2cfd5-bbba-4442-8d1c-0759fe085d7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:53:12.123882 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a2cfd5-bbba-4442-8d1c-0759fe085d7f admin admin] PATH_INFO: `/v3/roles` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:53:12.124614 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a2cfd5-bbba-4442-8d1c-0759fe085d7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:53:12.126202 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a2cfd5-bbba-4442-8d1c-0759fe085d7f admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:53:12.137092 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1437/2887] 10.222.0.67 () {58 vars in 1121 bytes} [Wed May 25 14:53:12 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:53:12.141267 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4230dd33-bacf-482a-adeb-543542a8da7f admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:53:12.152226 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4230dd33-bacf-482a-adeb-543542a8da7f admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:53:12.156863 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204f312b-fa68-49b0-b6e9-a86411248a22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:53:12.157768 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204f312b-fa68-49b0-b6e9-a86411248a22 admin admin] REQUEST_METHOD: `PUT` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:53:12.158053 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204f312b-fa68-49b0-b6e9-a86411248a22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:53:12.158333 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204f312b-fa68-49b0-b6e9-a86411248a22 admin admin] PATH_INFO: `/v3/projects/80b0da1eda724f60ad7d9bc2f71ceaeb/users/3db005df9861465cb952a9d3ddada4b1/roles/48808901834b4d5eab2c7e6b5b03791e` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:53:12.173607 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204f312b-fa68-49b0-b6e9-a86411248a22 admin admin] RBAC: Authorizing `identity:create_grant(project_id=80b0da1eda724f60ad7d9bc2f71ceaeb, user_id=3db005df9861465cb952a9d3ddada4b1, role_id=48808901834b4d5eab2c7e6b5b03791e)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:53:12.176418 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204f312b-fa68-49b0-b6e9-a86411248a22 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:53:12.190568 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1451/2888] 10.222.0.67 () {60 vars in 1482 bytes} [Wed May 25 14:53:12 2022] PUT /identity/v3/projects/80b0da1eda724f60ad7d9bc2f71ceaeb/users/3db005df9861465cb952a9d3ddada4b1/roles/48808901834b4d5eab2c7e6b5b03791e => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:53:12.202719 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9b0602-2bf0-4fe7-8f61-9977ca6185f6 None None] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:53:12.203062 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9b0602-2bf0-4fe7-8f61-9977ca6185f6 None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:53:12.203355 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9b0602-2bf0-4fe7-8f61-9977ca6185f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:53:12.229636 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.auth.core [None req-eb9b0602-2bf0-4fe7-8f61-9977ca6185f6 None None] MFA Rules not processed for user `3db005df9861465cb952a9d3ddada4b1`. Rule list: `[]` (Enabled: `True`). {{(pid=80474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:53:12.230830 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-eb9b0602-2bf0-4fe7-8f61-9977ca6185f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:53:12.294565 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1438/2889] 10.222.0.67 () {58 vars in 957 bytes} [Wed May 25 14:53:12 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 14:53:12.306676 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204f312b-fa68-49b0-b6e9-a86411248a22 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:53:12.308365 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-204f312b-fa68-49b0-b6e9-a86411248a22 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:53:12.371838 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204f312b-fa68-49b0-b6e9-a86411248a22 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:53:12.375839 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300f5019-7bb5-4d52-abc6-ef9ba469fb9b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5e4d67668ce40509e057f4f4c994521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfe93ee8d32a441295efc0b885de4bd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:53:12.376505 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300f5019-7bb5-4d52-abc6-ef9ba469fb9b service glance] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:53:12.376820 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300f5019-7bb5-4d52-abc6-ef9ba469fb9b service glance] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:53:12.377101 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300f5019-7bb5-4d52-abc6-ef9ba469fb9b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:53:12.386338 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300f5019-7bb5-4d52-abc6-ef9ba469fb9b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:53:12.387809 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300f5019-7bb5-4d52-abc6-ef9ba469fb9b service glance] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:53:12.396905 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1452/2890] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 14:53:12 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 14:53:22.291586 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=43,keystone:INSERT=3 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:53:22.392875 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=74,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:53:27.850965 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9b0602-2bf0-4fe7-8f61-9977ca6185f6 None None] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:53:27.958925 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9b0602-2bf0-4fe7-8f61-9977ca6185f6 None None] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:53:27.963544 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804eee5b-8e6e-4d01-8aed-e3ef0a97d09d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:53:27.964412 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804eee5b-8e6e-4d01-8aed-e3ef0a97d09d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:53:27.964699 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804eee5b-8e6e-4d01-8aed-e3ef0a97d09d admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:53:27.964980 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804eee5b-8e6e-4d01-8aed-e3ef0a97d09d admin admin] PATH_INFO: `/v3/users/3db005df9861465cb952a9d3ddada4b1` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:53:27.966177 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804eee5b-8e6e-4d01-8aed-e3ef0a97d09d admin admin] RBAC: Authorizing `identity:delete_user(user_id=3db005df9861465cb952a9d3ddada4b1)` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:53:27.968133 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804eee5b-8e6e-4d01-8aed-e3ef0a97d09d admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:53:28.014839 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-804eee5b-8e6e-4d01-8aed-e3ef0a97d09d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3db005df9861465cb952a9d3ddada4b1'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:53:28.015517 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-804eee5b-8e6e-4d01-8aed-e3ef0a97d09d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3db005df9861465cb952a9d3ddada4b1'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:53:28.016126 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-804eee5b-8e6e-4d01-8aed-e3ef0a97d09d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3db005df9861465cb952a9d3ddada4b1'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:53:28.028455 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-804eee5b-8e6e-4d01-8aed-e3ef0a97d09d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3db005df9861465cb952a9d3ddada4b1'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:53:28.035170 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-804eee5b-8e6e-4d01-8aed-e3ef0a97d09d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3db005df9861465cb952a9d3ddada4b1'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:53:28.047885 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1439/2891] 10.222.0.67 () {58 vars in 1223 bytes} [Wed May 25 14:53:27 2022] DELETE /identity/v3/users/3db005df9861465cb952a9d3ddada4b1 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:53:28.052941 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89d2c99-a21f-476f-bca6-eab9d4207ec7 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:53:28.053428 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89d2c99-a21f-476f-bca6-eab9d4207ec7 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:53:28.053528 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89d2c99-a21f-476f-bca6-eab9d4207ec7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:53:28.103455 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-b89d2c99-a21f-476f-bca6-eab9d4207ec7 None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:53:28.104588 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-b89d2c99-a21f-476f-bca6-eab9d4207ec7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:53:28.162353 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1453/2892] 10.222.0.67 () {58 vars in 957 bytes} [Wed May 25 14:53:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:53:28.172013 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804eee5b-8e6e-4d01-8aed-e3ef0a97d09d admin admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:53:28.173421 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-804eee5b-8e6e-4d01-8aed-e3ef0a97d09d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:53:28.215804 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:53:28.271090 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804eee5b-8e6e-4d01-8aed-e3ef0a97d09d admin admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:53:28.274735 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95f568a-d42e-4bfe-81a1-5d5aec0c4b5a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b68eed985c7b49839bcdd173186ad4ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfe93ee8d32a441295efc0b885de4bd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:53:28.275415 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95f568a-d42e-4bfe-81a1-5d5aec0c4b5a service neutron] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:53:28.275706 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95f568a-d42e-4bfe-81a1-5d5aec0c4b5a service neutron] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:53:28.275989 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95f568a-d42e-4bfe-81a1-5d5aec0c4b5a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:53:28.285466 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95f568a-d42e-4bfe-81a1-5d5aec0c4b5a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:53:28.287588 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95f568a-d42e-4bfe-81a1-5d5aec0c4b5a service neutron] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:53:28.297208 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1440/2893] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 14:53:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:53:28.572035 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89d2c99-a21f-476f-bca6-eab9d4207ec7 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:53:28.574854 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-b89d2c99-a21f-476f-bca6-eab9d4207ec7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:53:28.593761 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89d2c99-a21f-476f-bca6-eab9d4207ec7 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:53:28.601087 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8674097-e889-45f8-be86-40b17b6b4dfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:53:28.601986 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8674097-e889-45f8-be86-40b17b6b4dfa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:53:28.602306 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8674097-e889-45f8-be86-40b17b6b4dfa admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:53:28.602496 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8674097-e889-45f8-be86-40b17b6b4dfa admin admin] PATH_INFO: `/v3/projects/80b0da1eda724f60ad7d9bc2f71ceaeb` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:53:28.603809 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8674097-e889-45f8-be86-40b17b6b4dfa admin admin] RBAC: Authorizing `identity:delete_project(project_id=80b0da1eda724f60ad7d9bc2f71ceaeb)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:53:28.605744 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8674097-e889-45f8-be86-40b17b6b4dfa admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:53:28.655301 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-a8674097-e889-45f8-be86-40b17b6b4dfa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '80b0da1eda724f60ad7d9bc2f71ceaeb', 'request_id': 'req-a8674097-e889-45f8-be86-40b17b6b4dfa'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:53:28.660721 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-a8674097-e889-45f8-be86-40b17b6b4dfa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '80b0da1eda724f60ad7d9bc2f71ceaeb', 'request_id': 'req-a8674097-e889-45f8-be86-40b17b6b4dfa'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:53:28.666842 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-a8674097-e889-45f8-be86-40b17b6b4dfa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '80b0da1eda724f60ad7d9bc2f71ceaeb', 'request_id': 'req-a8674097-e889-45f8-be86-40b17b6b4dfa'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:53:28.679796 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-a8674097-e889-45f8-be86-40b17b6b4dfa admin admin] The token cache is being invalidate because project 80b0da1eda724f60ad7d9bc2f71ceaeb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80475) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 14:53:28.680108 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-a8674097-e889-45f8-be86-40b17b6b4dfa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:53:28.680734 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-a8674097-e889-45f8-be86-40b17b6b4dfa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:53:28.682303 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1454/2894] 10.222.0.67 () {58 vars in 1232 bytes} [Wed May 25 14:53:28 2022] DELETE /identity/v3/projects/80b0da1eda724f60ad7d9bc2f71ceaeb => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:53:28.687165 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c031fa6-9034-48c1-9930-280cc004c521 None None] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:53:28.687463 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c031fa6-9034-48c1-9930-280cc004c521 None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:53:28.687770 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c031fa6-9034-48c1-9930-280cc004c521 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:53:28.726236 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.auth.core [None req-0c031fa6-9034-48c1-9930-280cc004c521 None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:53:28.727464 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-0c031fa6-9034-48c1-9930-280cc004c521 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:53:28.786624 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1441/2895] 10.222.0.67 () {58 vars in 957 bytes} [Wed May 25 14:53:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:53:28.794487 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98cf81f-b0d1-4eae-b44d-cfbf35e1f7c1 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:53:28.794782 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98cf81f-b0d1-4eae-b44d-cfbf35e1f7c1 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:53:28.795155 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98cf81f-b0d1-4eae-b44d-cfbf35e1f7c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:53:28.824262 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-f98cf81f-b0d1-4eae-b44d-cfbf35e1f7c1 None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:53:28.825469 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-f98cf81f-b0d1-4eae-b44d-cfbf35e1f7c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:53:28.833461 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1455/2896] 10.222.0.67 () {58 vars in 957 bytes} [Wed May 25 14:53:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:53:28.838003 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c031fa6-9034-48c1-9930-280cc004c521 None None] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:53:28.848007 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c031fa6-9034-48c1-9930-280cc004c521 None None] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:53:28.852698 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c6f5e1-0986-40d3-864c-8976ec0c22f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:53:28.853359 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c6f5e1-0986-40d3-864c-8976ec0c22f8 admin admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:53:28.853646 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c6f5e1-0986-40d3-864c-8976ec0c22f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:53:28.853931 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c6f5e1-0986-40d3-864c-8976ec0c22f8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:53:28.854665 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c6f5e1-0986-40d3-864c-8976ec0c22f8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:53:28.854977 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c6f5e1-0986-40d3-864c-8976ec0c22f8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:53:28.856602 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c6f5e1-0986-40d3-864c-8976ec0c22f8 admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:53:28.868787 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1442/2897] 10.222.0.67 () {58 vars in 1152 bytes} [Wed May 25 14:53:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:53:28.873860 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98cf81f-b0d1-4eae-b44d-cfbf35e1f7c1 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:53:28.884061 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98cf81f-b0d1-4eae-b44d-cfbf35e1f7c1 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:53:28.889003 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88700cc6-c6b7-4387-b725-2c0c690d66f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:53:28.889658 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88700cc6-c6b7-4387-b725-2c0c690d66f0 admin admin] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:53:28.889948 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88700cc6-c6b7-4387-b725-2c0c690d66f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:53:28.890233 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88700cc6-c6b7-4387-b725-2c0c690d66f0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:53:28.890921 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88700cc6-c6b7-4387-b725-2c0c690d66f0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:53:28.892855 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88700cc6-c6b7-4387-b725-2c0c690d66f0 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:53:28.918336 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1456/2898] 10.222.0.67 () {60 vars in 1152 bytes} [Wed May 25 14:53:28 2022] POST /identity/v3/projects => generated 375 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:53:28.922336 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c6f5e1-0986-40d3-864c-8976ec0c22f8 admin admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:53:28.932787 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c6f5e1-0986-40d3-864c-8976ec0c22f8 admin admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:53:28.988234 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e326b8-4ea0-40ef-afbe-d229fe709a72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:53:28.989682 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e326b8-4ea0-40ef-afbe-d229fe709a72 admin admin] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:53:28.989827 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e326b8-4ea0-40ef-afbe-d229fe709a72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:53:28.990047 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e326b8-4ea0-40ef-afbe-d229fe709a72 admin admin] PATH_INFO: `/v3/users` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:53:28.990739 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e326b8-4ea0-40ef-afbe-d229fe709a72 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:53:28.992660 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e326b8-4ea0-40ef-afbe-d229fe709a72 admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:53:29.015407 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1443/2899] 10.222.0.67 () {60 vars in 1143 bytes} [Wed May 25 14:53:28 2022] POST /identity/v3/users => generated 288 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:53:29.019489 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88700cc6-c6b7-4387-b725-2c0c690d66f0 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:53:29.030160 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88700cc6-c6b7-4387-b725-2c0c690d66f0 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:53:29.034787 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7e6e63-a293-401e-90ba-7247b3178738 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:53:29.035985 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7e6e63-a293-401e-90ba-7247b3178738 admin admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:53:29.036365 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7e6e63-a293-401e-90ba-7247b3178738 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:53:29.036657 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7e6e63-a293-401e-90ba-7247b3178738 admin admin] PATH_INFO: `/v3/roles` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:53:29.037381 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7e6e63-a293-401e-90ba-7247b3178738 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:53:29.039002 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7e6e63-a293-401e-90ba-7247b3178738 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:53:29.049424 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1457/2900] 10.222.0.67 () {58 vars in 1121 bytes} [Wed May 25 14:53:29 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:53:29.053882 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e326b8-4ea0-40ef-afbe-d229fe709a72 admin admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:53:29.063628 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e326b8-4ea0-40ef-afbe-d229fe709a72 admin admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:53:29.068841 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ece3ac-9a5f-4576-918d-077bf525fb3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:53:29.069486 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ece3ac-9a5f-4576-918d-077bf525fb3f admin admin] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:53:29.069774 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ece3ac-9a5f-4576-918d-077bf525fb3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:53:29.070047 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ece3ac-9a5f-4576-918d-077bf525fb3f admin admin] PATH_INFO: `/v3/roles` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:53:29.070769 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ece3ac-9a5f-4576-918d-077bf525fb3f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:53:29.072409 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ece3ac-9a5f-4576-918d-077bf525fb3f admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:53:29.073706 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:53:29.085067 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1444/2901] 10.222.0.67 () {58 vars in 1121 bytes} [Wed May 25 14:53:29 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:53:29.088983 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7e6e63-a293-401e-90ba-7247b3178738 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:53:29.099415 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7e6e63-a293-401e-90ba-7247b3178738 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:53:29.104026 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38352b19-d575-4d5b-8141-b222609290db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:53:29.104900 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38352b19-d575-4d5b-8141-b222609290db admin admin] REQUEST_METHOD: `PUT` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:53:29.105189 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38352b19-d575-4d5b-8141-b222609290db admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:53:29.105465 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38352b19-d575-4d5b-8141-b222609290db admin admin] PATH_INFO: `/v3/projects/73c11478a53e413c9f19a9a00a51bcec/users/b647c8f818ac472bba6a7a2288263321/roles/48808901834b4d5eab2c7e6b5b03791e` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:53:29.108702 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:53:29.122211 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38352b19-d575-4d5b-8141-b222609290db admin admin] RBAC: Authorizing `identity:create_grant(project_id=73c11478a53e413c9f19a9a00a51bcec, user_id=b647c8f818ac472bba6a7a2288263321, role_id=48808901834b4d5eab2c7e6b5b03791e)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:53:29.125346 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38352b19-d575-4d5b-8141-b222609290db admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:53:29.140764 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1458/2902] 10.222.0.67 () {60 vars in 1482 bytes} [Wed May 25 14:53:29 2022] PUT /identity/v3/projects/73c11478a53e413c9f19a9a00a51bcec/users/b647c8f818ac472bba6a7a2288263321/roles/48808901834b4d5eab2c7e6b5b03791e => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 14:53:29.151681 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4b08aa-223b-4181-bb4b-a665fab03ce2 None None] REQUEST_METHOD: `POST` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:53:29.151977 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4b08aa-223b-4181-bb4b-a665fab03ce2 None None] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:53:29.152260 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4b08aa-223b-4181-bb4b-a665fab03ce2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:53:29.178022 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.auth.core [None req-cf4b08aa-223b-4181-bb4b-a665fab03ce2 None None] MFA Rules not processed for user `b647c8f818ac472bba6a7a2288263321`. Rule list: `[]` (Enabled: `True`). {{(pid=80474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:53:29.179228 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-cf4b08aa-223b-4181-bb4b-a665fab03ce2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:53:29.243117 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1445/2903] 10.222.0.67 () {58 vars in 957 bytes} [Wed May 25 14:53:29 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:53:29.253579 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38352b19-d575-4d5b-8141-b222609290db admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:53:29.255897 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-38352b19-d575-4d5b-8141-b222609290db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:53:29.314526 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38352b19-d575-4d5b-8141-b222609290db admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:53:29.318214 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a5c00b-00c5-4731-b33a-88c4fccd900a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e462acc9da84a61bb23998dd54e1858', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfe93ee8d32a441295efc0b885de4bd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:53:29.318857 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a5c00b-00c5-4731-b33a-88c4fccd900a service cinder] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:53:29.319186 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a5c00b-00c5-4731-b33a-88c4fccd900a service cinder] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:53:29.319467 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a5c00b-00c5-4731-b33a-88c4fccd900a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:53:29.327867 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a5c00b-00c5-4731-b33a-88c4fccd900a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:53:29.329299 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a5c00b-00c5-4731-b33a-88c4fccd900a service cinder] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:53:29.338294 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1459/2904] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 14:53:29 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:53:39.240234 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=34 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:53:39.334197 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=32,keystone:INSERT=1 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:53:39.444622 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4b08aa-223b-4181-bb4b-a665fab03ce2 None None] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:53:39.507036 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4b08aa-223b-4181-bb4b-a665fab03ce2 None None] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:53:39.511521 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7184e4cc-07c3-42d6-817e-98145aa9026a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:53:39.512397 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7184e4cc-07c3-42d6-817e-98145aa9026a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:53:39.512683 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7184e4cc-07c3-42d6-817e-98145aa9026a admin admin] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:53:39.512962 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7184e4cc-07c3-42d6-817e-98145aa9026a admin admin] PATH_INFO: `/v3/users/b647c8f818ac472bba6a7a2288263321` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:53:39.514413 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7184e4cc-07c3-42d6-817e-98145aa9026a admin admin] RBAC: Authorizing `identity:delete_user(user_id=b647c8f818ac472bba6a7a2288263321)` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:53:39.516374 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7184e4cc-07c3-42d6-817e-98145aa9026a admin admin] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:53:39.563622 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-7184e4cc-07c3-42d6-817e-98145aa9026a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b647c8f818ac472bba6a7a2288263321'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:53:39.564339 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-7184e4cc-07c3-42d6-817e-98145aa9026a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b647c8f818ac472bba6a7a2288263321'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:53:39.564945 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-7184e4cc-07c3-42d6-817e-98145aa9026a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b647c8f818ac472bba6a7a2288263321'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:53:39.576795 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-7184e4cc-07c3-42d6-817e-98145aa9026a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b647c8f818ac472bba6a7a2288263321'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:53:39.583787 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.notifications [None req-7184e4cc-07c3-42d6-817e-98145aa9026a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b647c8f818ac472bba6a7a2288263321'} {{(pid=80474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:53:39.596520 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1446/2905] 10.222.0.67 () {58 vars in 1223 bytes} [Wed May 25 14:53:39 2022] DELETE /identity/v3/users/b647c8f818ac472bba6a7a2288263321 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:53:39.602270 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ade269e-932c-491f-a085-e8742f9c7fea None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:53:39.602596 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ade269e-932c-491f-a085-e8742f9c7fea None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:53:39.602882 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ade269e-932c-491f-a085-e8742f9c7fea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:53:39.620851 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-9ade269e-932c-491f-a085-e8742f9c7fea None None] MFA Rules not processed for user `be354bf3692549b095099e6268f938f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:53:39.622062 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-9ade269e-932c-491f-a085-e8742f9c7fea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:53:39.680183 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1460/2906] 10.222.0.67 () {58 vars in 957 bytes} [Wed May 25 14:53:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 14:53:39.689817 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7184e4cc-07c3-42d6-817e-98145aa9026a admin admin] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:53:39.691254 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-7184e4cc-07c3-42d6-817e-98145aa9026a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:53:39.750977 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7184e4cc-07c3-42d6-817e-98145aa9026a admin admin] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:53:39.755443 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f66f9ad-e98d-4bc7-9963-d6649acedcf0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b68eed985c7b49839bcdd173186ad4ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfe93ee8d32a441295efc0b885de4bd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:53:39.756096 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f66f9ad-e98d-4bc7-9963-d6649acedcf0 service neutron] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:53:39.756387 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f66f9ad-e98d-4bc7-9963-d6649acedcf0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:53:39.756668 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f66f9ad-e98d-4bc7-9963-d6649acedcf0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:53:39.766243 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f66f9ad-e98d-4bc7-9963-d6649acedcf0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:53:39.767673 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f66f9ad-e98d-4bc7-9963-d6649acedcf0 service neutron] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:53:39.777926 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1447/2907] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 14:53:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:53:40.047932 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ade269e-932c-491f-a085-e8742f9c7fea None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:53:40.049382 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-9ade269e-932c-491f-a085-e8742f9c7fea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:53:40.061902 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ade269e-932c-491f-a085-e8742f9c7fea None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:53:40.067218 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d8b2d6-4843-4828-9335-c6adcb34c7ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be354bf3692549b095099e6268f938f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '277acbf9eb0e4a9b87508241a478db4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:53:40.068107 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d8b2d6-4843-4828-9335-c6adcb34c7ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:53:40.068393 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d8b2d6-4843-4828-9335-c6adcb34c7ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:53:40.068671 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d8b2d6-4843-4828-9335-c6adcb34c7ba admin admin] PATH_INFO: `/v3/projects/73c11478a53e413c9f19a9a00a51bcec` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:53:40.069963 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d8b2d6-4843-4828-9335-c6adcb34c7ba admin admin] RBAC: Authorizing `identity:delete_project(project_id=73c11478a53e413c9f19a9a00a51bcec)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:53:40.071884 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d8b2d6-4843-4828-9335-c6adcb34c7ba admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:53:40.121164 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-d6d8b2d6-4843-4828-9335-c6adcb34c7ba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '73c11478a53e413c9f19a9a00a51bcec', 'request_id': 'req-d6d8b2d6-4843-4828-9335-c6adcb34c7ba'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:53:40.126676 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-d6d8b2d6-4843-4828-9335-c6adcb34c7ba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '73c11478a53e413c9f19a9a00a51bcec', 'request_id': 'req-d6d8b2d6-4843-4828-9335-c6adcb34c7ba'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:53:40.135452 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-d6d8b2d6-4843-4828-9335-c6adcb34c7ba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '73c11478a53e413c9f19a9a00a51bcec', 'request_id': 'req-d6d8b2d6-4843-4828-9335-c6adcb34c7ba'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:53:40.149342 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-d6d8b2d6-4843-4828-9335-c6adcb34c7ba admin admin] The token cache is being invalidate because project 73c11478a53e413c9f19a9a00a51bcec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80475) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 14:53:40.149633 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-d6d8b2d6-4843-4828-9335-c6adcb34c7ba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:53:40.150245 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-d6d8b2d6-4843-4828-9335-c6adcb34c7ba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:53:40.151868 dv-cinder-787296-9-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1461/2908] 10.222.0.67 () {58 vars in 1232 bytes} [Wed May 25 14:53:40 2022] DELETE /identity/v3/projects/73c11478a53e413c9f19a9a00a51bcec => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:53:49.773700 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=79,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:53:50.146132 dv-cinder-787296-9-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=54,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:55:43.868179 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f66f9ad-e98d-4bc7-9963-d6649acedcf0 service neutron] Authenticating user token {{(pid=80474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:55:43.869594 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-1f66f9ad-e98d-4bc7-9963-d6649acedcf0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:55:43.966064 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f66f9ad-e98d-4bc7-9963-d6649acedcf0 service neutron] Validating token access rules against request {{(pid=80474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:55:44.028878 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e242d23f-72d2-47fe-8a1e-0288a1091ca6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad2b99c2122a4311996364e982e1c801', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfe93ee8d32a441295efc0b885de4bd7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:55:44.029539 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e242d23f-72d2-47fe-8a1e-0288a1091ca6 service placement] REQUEST_METHOD: `GET` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:55:44.029827 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e242d23f-72d2-47fe-8a1e-0288a1091ca6 service placement] SCRIPT_NAME: `/identity` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:55:44.030108 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e242d23f-72d2-47fe-8a1e-0288a1091ca6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:55:44.031927 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.fernet_utils [None req-e242d23f-72d2-47fe-8a1e-0288a1091ca6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:55:44.043247 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e242d23f-72d2-47fe-8a1e-0288a1091ca6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:55:44.044827 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e242d23f-72d2-47fe-8a1e-0288a1091ca6 service placement] RBAC: Authorization granted {{(pid=80474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:55:44.055358 dv-cinder-787296-9-smb devstack@keystone.service[80474]: [pid: 80474|app: 0|req: 1448/2909] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 14:55:43 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:55:54.051059 dv-cinder-787296-9-smb devstack@keystone.service[80474]: DEBUG dbcounter [-] [80474] Writing DB stats keystone:SELECT=67 {{(pid=80474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}